2024-09-15T12:06:48.752 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-15T12:06:48.772 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T12:06:48.850 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905530 branch: wip-matanb-crimson-testing-59543 description: crimson-rados/thrash_simple/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/simple thrashosds-health workloads/radosbench} email: null first_in_suite: false job_id: '7905530' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-matanb-crimson-testing-59543 ceph: conf: client.0: debug ms: 1 debug objecter: 20 debug rados: 20 global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc osd_pool_default_min_size: 2 osd_pool_default_size: 3 mgr: debug mgr: 20 debug ms: 1 mgr stats period: 30 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 osd pool default crimson: true paxos service trim min: 10 osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true bluestore rocksdb cf: false crimson alien thread cpu cores: 6-7 crimson osd obc lru size: 10 debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 err to stderr: true log flush on exit: true log to file: false log to stderr: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd debug reject backfill probability: 0.3 osd delete sleep: 1 osd failsafe full ratio: 0.95 osd max backfills: 3 osd max markdown count: 1000 osd objectstore: bluestore osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true osd snap trim sleep: 2 osd.0: crimson seastar cpu cores: 0-2 osd.1: crimson seastar cpu cores: 3-5 osd.2: crimson seastar cpu cores: 0-2 osd.3: crimson seastar cpu cores: 3-5 flavor: crimson fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: crimson sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: min_in: 4 workunit: branch: main env: CRIMSON_COMPAT: '1' sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 owner: scheduled_matan@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 1236 sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 sleep_before_teardown: 0 suite: crimson-rados suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 targets: smithi077.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHK7A5WIs9hfm6Stwawjo7HbwGP68oDmNZi+xkdNAUjvrI5ceu8TwkHm1aXyo5vURYiTeZb04Z2W1FeW4WEfEfw= smithi138.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKVy1a+7A5bOqmjMczvhz2VpSSjDw/a6hgTgV4qO45huIVuEzljfUiHtDlKO6MFZoD6wyM+FC1Dw3Y7ooEE3nzA= tasks: - install: null - ceph: conf: osd: debug monc: 20 flavor: crimson - thrashosds: ceph_objectstore_tool: false chance_down: 0 chance_inject_pause_short: 0 chance_reset_purged_snaps_last: 0 chance_thrash_cluster_full: 0 chance_thrash_pg_upmap: 0 dump_ops_enable: false min_in: 3 noscrub_toggle_delay: 0 reweight_osd: 0 sighup_delay: 0 thrash_primary_affinity: false timeout: 2400 - full_sequential: - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 - radosbench: clients: - client.0 time: 90 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_11:59:21 tube: smithi user: matan verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-15T12:06:48.850 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa; will attempt to use it 2024-09-15T12:06:48.851 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks 2024-09-15T12:06:48.851 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-15T12:06:48.852 INFO:teuthology.task.internal:Checking packages... 2024-09-15T12:06:48.873 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash '81fedcb3b484c843d22ffbc8d179cb567b7083b5' 2024-09-15T12:06:48.873 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-15T12:06:48.873 INFO:teuthology.packaging:ref: None 2024-09-15T12:06:48.873 INFO:teuthology.packaging:tag: None 2024-09-15T12:06:48.873 INFO:teuthology.packaging:branch: wip-matanb-crimson-testing-59543 2024-09-15T12:06:48.873 INFO:teuthology.packaging:sha1: 81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-15T12:06:48.873 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=wip-matanb-crimson-testing-59543 2024-09-15T12:06:49.015 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4879.g81fedcb3 2024-09-15T12:06:49.016 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-15T12:06:49.023 INFO:teuthology.task.internal:no buildpackages task found 2024-09-15T12:06:49.023 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-15T12:06:49.036 INFO:teuthology.task.internal:Saving configuration 2024-09-15T12:06:49.050 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-15T12:06:49.057 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-15T12:06:49.082 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi077.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905530', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 12:00:39.192765', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHK7A5WIs9hfm6Stwawjo7HbwGP68oDmNZi+xkdNAUjvrI5ceu8TwkHm1aXyo5vURYiTeZb04Z2W1FeW4WEfEfw='} 2024-09-15T12:06:49.105 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905530', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 12:00:39.194296', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKVy1a+7A5bOqmjMczvhz2VpSSjDw/a6hgTgV4qO45huIVuEzljfUiHtDlKO6MFZoD6wyM+FC1Dw3Y7ooEE3nzA='} 2024-09-15T12:06:49.106 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-15T12:06:49.112 INFO:teuthology.task.internal:roles: ubuntu@smithi077.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2024-09-15T12:06:49.113 INFO:teuthology.task.internal:roles: ubuntu@smithi138.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-15T12:06:49.113 INFO:teuthology.run_tasks:Running task console_log... 2024-09-15T12:06:49.185 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc99c30fbe0>, signals=[15]) 2024-09-15T12:06:49.185 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-15T12:06:49.191 INFO:teuthology.task.internal:Opening connections... 2024-09-15T12:06:49.191 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi077.front.sepia.ceph.com 2024-09-15T12:06:49.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T12:06:49.268 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi138.front.sepia.ceph.com 2024-09-15T12:06:49.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T12:06:49.341 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-15T12:06:49.348 DEBUG:teuthology.orchestra.run.smithi077:> uname -m 2024-09-15T12:06:49.366 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64 2024-09-15T12:06:49.366 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2024-09-15T12:06:49.423 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Stream" 2024-09-15T12:06:49.423 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="9" 2024-09-15T12:06:49.424 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos" 2024-09-15T12:06:49.424 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora" 2024-09-15T12:06:49.424 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="9" 2024-09-15T12:06:49.424 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el9" 2024-09-15T12:06:49.424 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-15T12:06:49.424 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31" 2024-09-15T12:06:49.424 INFO:teuthology.orchestra.run.smithi077.stdout:LOGO="fedora-logo-icon" 2024-09-15T12:06:49.424 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-15T12:06:49.424 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://centos.org/" 2024-09-15T12:06:49.424 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-15T12:06:49.424 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-15T12:06:49.424 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-15T12:06:49.425 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2024-09-15T12:06:49.443 DEBUG:teuthology.orchestra.run.smithi138:> uname -m 2024-09-15T12:06:49.460 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2024-09-15T12:06:49.460 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2024-09-15T12:06:49.517 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="CentOS Stream" 2024-09-15T12:06:49.517 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="9" 2024-09-15T12:06:49.518 INFO:teuthology.orchestra.run.smithi138.stdout:ID="centos" 2024-09-15T12:06:49.518 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="rhel fedora" 2024-09-15T12:06:49.518 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="9" 2024-09-15T12:06:49.518 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el9" 2024-09-15T12:06:49.518 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-15T12:06:49.518 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2024-09-15T12:06:49.518 INFO:teuthology.orchestra.run.smithi138.stdout:LOGO="fedora-logo-icon" 2024-09-15T12:06:49.518 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-15T12:06:49.518 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://centos.org/" 2024-09-15T12:06:49.518 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-15T12:06:49.518 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-15T12:06:49.518 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-15T12:06:49.519 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2024-09-15T12:06:49.542 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-15T12:06:49.552 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-15T12:06:49.557 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-15T12:06:49.557 DEBUG:teuthology.orchestra.run.smithi077:> test '!' -e /home/ubuntu/cephtest 2024-09-15T12:06:49.560 DEBUG:teuthology.orchestra.run.smithi138:> test '!' -e /home/ubuntu/cephtest 2024-09-15T12:06:49.575 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-15T12:06:49.589 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-15T12:06:49.589 DEBUG:teuthology.orchestra.run.smithi077:> test -z $(ls -A /var/lib/ceph) 2024-09-15T12:06:49.617 DEBUG:teuthology.orchestra.run.smithi138:> test -z $(ls -A /var/lib/ceph) 2024-09-15T12:06:49.803 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-15T12:06:49.855 INFO:teuthology.run_tasks:Running task kernel... 2024-09-15T12:06:49.868 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-09-15T12:06:49.868 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-09-15T12:06:49.868 DEBUG:teuthology.orchestra.run.smithi077:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T12:06:49.869 DEBUG:teuthology.orchestra.run.smithi138:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T12:06:49.885 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T12:06:49.886 DEBUG:teuthology.orchestra.run.smithi077:> uname -r 2024-09-15T12:06:49.886 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T12:06:49.887 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2024-09-15T12:06:49.943 INFO:teuthology.orchestra.run.smithi077.stdout:5.14.0-503.el9.x86_64 2024-09-15T12:06:49.943 INFO:teuthology.task.kernel:Running kernel on smithi077: 5.14.0-503.el9.x86_64 2024-09-15T12:06:49.943 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum install -y kernel 2024-09-15T12:06:49.944 INFO:teuthology.orchestra.run.smithi138.stdout:5.14.0-503.el9.x86_64 2024-09-15T12:06:49.944 INFO:teuthology.task.kernel:Running kernel on smithi138: 5.14.0-503.el9.x86_64 2024-09-15T12:06:49.945 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum install -y kernel 2024-09-15T12:06:53.771 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 8.2 MB 00:02 2024-09-15T12:06:54.943 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - BaseOS 2.6 MB/s | 8.2 MB 00:03 2024-09-15T12:06:56.865 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:01 2024-09-15T12:06:58.519 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - AppStream 8.3 MB/s | 20 MB 00:02 2024-09-15T12:07:01.123 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-15T12:07:02.666 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - Extras packages 54 kB/s | 19 kB 00:00 2024-09-15T12:07:02.885 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-15T12:07:03.429 INFO:teuthology.orchestra.run.smithi077.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-15T12:07:04.478 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - Extras packages 76 kB/s | 19 kB 00:00 2024-09-15T12:07:05.416 INFO:teuthology.orchestra.run.smithi138.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-15T12:07:08.859 INFO:teuthology.orchestra.run.smithi077.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-09-15T12:07:10.866 INFO:teuthology.orchestra.run.smithi077.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-15T12:07:10.866 INFO:teuthology.orchestra.run.smithi077.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-15T12:07:10.888 INFO:teuthology.orchestra.run.smithi138.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-15T12:07:10.960 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-15T12:07:10.970 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:07:10.970 INFO:teuthology.orchestra.run.smithi077.stdout: Package Architecture Version Repository Size 2024-09-15T12:07:10.970 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:07:10.970 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-15T12:07:10.970 INFO:teuthology.orchestra.run.smithi077.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-15T12:07:10.970 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-09-15T12:07:10.970 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-15T12:07:10.971 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-15T12:07:10.971 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-15T12:07:10.971 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:07:10.971 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-15T12:07:10.971 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:07:10.971 INFO:teuthology.orchestra.run.smithi077.stdout:Install 4 Packages 2024-09-15T12:07:10.971 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:07:10.971 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 79 M 2024-09-15T12:07:10.971 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 126 M 2024-09-15T12:07:10.971 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-15T12:07:11.344 INFO:teuthology.orchestra.run.smithi077.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 195 kB/s | 23 kB 00:00 2024-09-15T12:07:12.153 INFO:teuthology.orchestra.run.smithi077.stdout:(2/4): kernel-modules-core-5.14.0-505.el9.x86_6 35 MB/s | 29 MB 00:00 2024-09-15T12:07:12.903 INFO:teuthology.orchestra.run.smithi138.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-15T12:07:12.904 INFO:teuthology.orchestra.run.smithi138.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-15T12:07:13.001 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-15T12:07:13.007 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:07:13.007 INFO:teuthology.orchestra.run.smithi138.stdout: Package Architecture Version Repository Size 2024-09-15T12:07:13.007 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:07:13.007 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-15T12:07:13.007 INFO:teuthology.orchestra.run.smithi138.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-15T12:07:13.007 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-09-15T12:07:13.008 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-15T12:07:13.008 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-15T12:07:13.008 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-15T12:07:13.008 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:07:13.008 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-15T12:07:13.008 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:07:13.008 INFO:teuthology.orchestra.run.smithi138.stdout:Install 4 Packages 2024-09-15T12:07:13.008 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:07:13.009 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 79 M 2024-09-15T12:07:13.009 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 126 M 2024-09-15T12:07:13.009 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-15T12:07:13.140 INFO:teuthology.orchestra.run.smithi138.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 267 kB/s | 23 kB 00:00 2024-09-15T12:07:13.336 INFO:teuthology.orchestra.run.smithi077.stdout:(3/4): kernel-core-5.14.0-505.el9.x86_64.rpm 7.4 MB/s | 16 MB 00:02 2024-09-15T12:07:13.748 INFO:teuthology.orchestra.run.smithi138.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2024-09-15T12:07:14.428 INFO:teuthology.orchestra.run.smithi077.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 11 MB/s | 35 MB 00:03 2024-09-15T12:07:14.429 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:07:14.429 INFO:teuthology.orchestra.run.smithi077.stdout:Total 23 MB/s | 79 MB 00:03 2024-09-15T12:07:14.449 INFO:teuthology.orchestra.run.smithi138.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 25 MB/s | 35 MB 00:01 2024-09-15T12:07:14.983 INFO:teuthology.orchestra.run.smithi138.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 16 MB/s | 29 MB 00:01 2024-09-15T12:07:14.983 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:07:14.983 INFO:teuthology.orchestra.run.smithi138.stdout:Total 40 MB/s | 79 MB 00:01 2024-09-15T12:07:15.115 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-15T12:07:15.453 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-15T12:07:15.454 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-15T12:07:15.664 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-15T12:07:16.020 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-15T12:07:16.021 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-15T12:07:16.438 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-15T12:07:16.438 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-15T12:07:16.980 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-15T12:07:16.980 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-15T12:07:18.880 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-15T12:07:19.395 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-15T12:07:19.516 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-15T12:07:19.596 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T12:07:20.074 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-15T12:07:20.151 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T12:07:22.359 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T12:07:22.509 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T12:07:22.930 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T12:07:23.069 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T12:07:27.373 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T12:07:27.409 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:07:27.912 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T12:07:28.219 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:07:32.259 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:07:33.045 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:08:10.338 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:08:10.385 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:08:10.802 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:08:10.802 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-15T12:08:10.802 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T12:08:10.802 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T12:08:11.375 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:08:11.414 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:08:11.630 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:08:11.630 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:08:11.630 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-15T12:08:11.630 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-15T12:08:11.630 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-15T12:08:11.631 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-15T12:08:11.631 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-15T12:08:11.631 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:08:11.631 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-15T12:08:11.814 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:08:11.814 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-15T12:08:11.814 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T12:08:11.814 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T12:08:11.954 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T12:08:12.037 INFO:teuthology.orchestra.run.smithi077.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T12:08:12.037 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T12:08:12.037 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-15T12:08:12.037 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-15T12:08:12.037 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-15T12:08:12.037 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-15T12:08:12.038 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi077.front.sepia.ceph.com, path=None, version=distro) 2024-09-15T12:08:12.038 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T12:08:12.097 INFO:teuthology.orchestra.run.smithi077.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T12:08:12.097 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T12:08:12.100 DEBUG:teuthology.orchestra.run.smithi077:> sudo rpm -qi grub2-tools 2024-09-15T12:08:12.132 INFO:teuthology.orchestra.run.smithi077.stdout:Name : grub2-tools 2024-09-15T12:08:12.132 INFO:teuthology.orchestra.run.smithi077.stdout:Epoch : 1 2024-09-15T12:08:12.132 INFO:teuthology.orchestra.run.smithi077.stdout:Version : 2.06 2024-09-15T12:08:12.132 INFO:teuthology.orchestra.run.smithi077.stdout:Release : 82.el9 2024-09-15T12:08:12.132 INFO:teuthology.orchestra.run.smithi077.stdout:Architecture: x86_64 2024-09-15T12:08:12.132 INFO:teuthology.orchestra.run.smithi077.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-15T12:08:12.132 INFO:teuthology.orchestra.run.smithi077.stdout:Group : Unspecified 2024-09-15T12:08:12.132 INFO:teuthology.orchestra.run.smithi077.stdout:Size : 8274670 2024-09-15T12:08:12.132 INFO:teuthology.orchestra.run.smithi077.stdout:License : GPLv3+ 2024-09-15T12:08:12.132 INFO:teuthology.orchestra.run.smithi077.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-15T12:08:12.132 INFO:teuthology.orchestra.run.smithi077.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-15T12:08:12.133 INFO:teuthology.orchestra.run.smithi077.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-15T12:08:12.133 INFO:teuthology.orchestra.run.smithi077.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-15T12:08:12.133 INFO:teuthology.orchestra.run.smithi077.stdout:Packager : builder@centos.org 2024-09-15T12:08:12.133 INFO:teuthology.orchestra.run.smithi077.stdout:Vendor : CentOS 2024-09-15T12:08:12.133 INFO:teuthology.orchestra.run.smithi077.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-15T12:08:12.133 INFO:teuthology.orchestra.run.smithi077.stdout:Summary : Support tools for GRUB. 2024-09-15T12:08:12.133 INFO:teuthology.orchestra.run.smithi077.stdout:Description : 2024-09-15T12:08:12.133 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:08:12.133 INFO:teuthology.orchestra.run.smithi077.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-15T12:08:12.133 INFO:teuthology.orchestra.run.smithi077.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-15T12:08:12.133 INFO:teuthology.orchestra.run.smithi077.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-15T12:08:12.133 INFO:teuthology.orchestra.run.smithi077.stdout:hardware devices. 2024-09-15T12:08:12.133 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:08:12.133 INFO:teuthology.orchestra.run.smithi077.stdout:This subpackage provides tools for support of all platforms. 2024-09-15T12:08:12.134 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-15T12:08:12.134 INFO:teuthology.task.kernel:Updating grub on smithi077 to boot 5.14.0-505.el9.x86_64 2024-09-15T12:08:12.134 DEBUG:teuthology.orchestra.run.smithi077:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-15T12:08:12.651 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T12:08:12.652 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:08:12.652 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-15T12:08:12.652 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-15T12:08:12.652 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-15T12:08:12.652 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-15T12:08:12.652 INFO:teuthology.orchestra.run.smithi138.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-15T12:08:12.652 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:08:12.652 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-15T12:08:12.747 INFO:teuthology.orchestra.run.smithi077.stderr:Generating grub configuration file ... 2024-09-15T12:08:13.046 DEBUG:teuthology.orchestra.run.smithi138:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T12:08:13.137 INFO:teuthology.orchestra.run.smithi138.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T12:08:13.138 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T12:08:13.138 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-15T12:08:13.138 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-15T12:08:13.138 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-15T12:08:13.138 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-15T12:08:13.138 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi138.front.sepia.ceph.com, path=None, version=distro) 2024-09-15T12:08:13.138 DEBUG:teuthology.orchestra.run.smithi138:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T12:08:13.196 INFO:teuthology.orchestra.run.smithi138.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T12:08:13.197 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T12:08:13.198 DEBUG:teuthology.orchestra.run.smithi138:> sudo rpm -qi grub2-tools 2024-09-15T12:08:13.229 INFO:teuthology.orchestra.run.smithi138.stdout:Name : grub2-tools 2024-09-15T12:08:13.229 INFO:teuthology.orchestra.run.smithi138.stdout:Epoch : 1 2024-09-15T12:08:13.229 INFO:teuthology.orchestra.run.smithi138.stdout:Version : 2.06 2024-09-15T12:08:13.229 INFO:teuthology.orchestra.run.smithi138.stdout:Release : 82.el9 2024-09-15T12:08:13.229 INFO:teuthology.orchestra.run.smithi138.stdout:Architecture: x86_64 2024-09-15T12:08:13.229 INFO:teuthology.orchestra.run.smithi138.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-15T12:08:13.229 INFO:teuthology.orchestra.run.smithi138.stdout:Group : Unspecified 2024-09-15T12:08:13.230 INFO:teuthology.orchestra.run.smithi138.stdout:Size : 8274670 2024-09-15T12:08:13.230 INFO:teuthology.orchestra.run.smithi138.stdout:License : GPLv3+ 2024-09-15T12:08:13.230 INFO:teuthology.orchestra.run.smithi138.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-15T12:08:13.230 INFO:teuthology.orchestra.run.smithi138.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-15T12:08:13.230 INFO:teuthology.orchestra.run.smithi138.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-15T12:08:13.230 INFO:teuthology.orchestra.run.smithi138.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-15T12:08:13.230 INFO:teuthology.orchestra.run.smithi138.stdout:Packager : builder@centos.org 2024-09-15T12:08:13.230 INFO:teuthology.orchestra.run.smithi138.stdout:Vendor : CentOS 2024-09-15T12:08:13.230 INFO:teuthology.orchestra.run.smithi138.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-15T12:08:13.230 INFO:teuthology.orchestra.run.smithi138.stdout:Summary : Support tools for GRUB. 2024-09-15T12:08:13.230 INFO:teuthology.orchestra.run.smithi138.stdout:Description : 2024-09-15T12:08:13.230 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:08:13.230 INFO:teuthology.orchestra.run.smithi138.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-15T12:08:13.230 INFO:teuthology.orchestra.run.smithi138.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-15T12:08:13.230 INFO:teuthology.orchestra.run.smithi138.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-15T12:08:13.231 INFO:teuthology.orchestra.run.smithi138.stdout:hardware devices. 2024-09-15T12:08:13.231 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:08:13.231 INFO:teuthology.orchestra.run.smithi138.stdout:This subpackage provides tools for support of all platforms. 2024-09-15T12:08:13.231 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-15T12:08:13.232 INFO:teuthology.task.kernel:Updating grub on smithi138 to boot 5.14.0-505.el9.x86_64 2024-09-15T12:08:13.232 DEBUG:teuthology.orchestra.run.smithi138:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-15T12:08:13.885 INFO:teuthology.orchestra.run.smithi138.stderr:Generating grub configuration file ... 2024-09-15T12:08:14.083 INFO:teuthology.orchestra.run.smithi077.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-15T12:08:14.109 INFO:teuthology.orchestra.run.smithi077.stderr:done 2024-09-15T12:08:14.112 DEBUG:teuthology.orchestra.run.smithi077:> mktemp 2024-09-15T12:08:14.127 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.0fKsiyo3ny 2024-09-15T12:08:14.127 DEBUG:teuthology.orchestra.run.smithi077:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.0fKsiyo3ny 2024-09-15T12:08:14.194 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0666 /tmp/tmp.0fKsiyo3ny 2024-09-15T12:08:14.336 DEBUG:teuthology.orchestra.remote:smithi077:/tmp/tmp.0fKsiyo3ny is 6KB 2024-09-15T12:08:14.384 DEBUG:teuthology.orchestra.run.smithi077:> rm -fr /tmp/tmp.0fKsiyo3ny 2024-09-15T12:08:14.399 DEBUG:teuthology.orchestra.run.smithi077:> sudo /bin/ls /boot/loader/entries || true 2024-09-15T12:08:14.461 INFO:teuthology.orchestra.run.smithi077.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-15T12:08:14.461 INFO:teuthology.orchestra.run.smithi077.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-15T12:08:14.461 INFO:teuthology.orchestra.run.smithi077.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-15T12:08:14.462 INFO:teuthology.orchestra.run.smithi077.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-15T12:08:14.463 DEBUG:teuthology.orchestra.run.smithi077:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-15T12:08:14.626 DEBUG:teuthology.orchestra.run.smithi077:> sudo shutdown -r now 2024-09-15T12:08:15.336 INFO:teuthology.orchestra.run.smithi138.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-15T12:08:15.358 INFO:teuthology.orchestra.run.smithi138.stderr:done 2024-09-15T12:08:15.361 DEBUG:teuthology.orchestra.run.smithi138:> mktemp 2024-09-15T12:08:15.377 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.HYe69DyqzQ 2024-09-15T12:08:15.377 DEBUG:teuthology.orchestra.run.smithi138:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.HYe69DyqzQ 2024-09-15T12:08:15.444 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.HYe69DyqzQ 2024-09-15T12:08:15.583 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.HYe69DyqzQ is 6KB 2024-09-15T12:08:15.631 DEBUG:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.HYe69DyqzQ 2024-09-15T12:08:15.646 DEBUG:teuthology.orchestra.run.smithi138:> sudo /bin/ls /boot/loader/entries || true 2024-09-15T12:08:15.709 INFO:teuthology.orchestra.run.smithi138.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-15T12:08:15.709 INFO:teuthology.orchestra.run.smithi138.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-15T12:08:15.709 INFO:teuthology.orchestra.run.smithi138.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-15T12:08:15.709 INFO:teuthology.orchestra.run.smithi138.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-15T12:08:15.710 DEBUG:teuthology.orchestra.run.smithi138:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-15T12:08:15.877 DEBUG:teuthology.orchestra.run.smithi138:> sudo shutdown -r now 2024-09-15T12:08:44.654 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-15T12:08:44.655 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-15T12:08:44.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T12:08:45.881 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-15T12:08:45.881 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-15T12:08:45.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T12:09:03.037 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.77 2024-09-15T12:09:04.321 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-09-15T12:09:12.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-15T12:09:12.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T12:09:13.323 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-15T12:09:13.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T12:09:15.105 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.77 2024-09-15T12:09:16.381 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-09-15T12:09:27.107 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-15T12:09:27.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T12:09:28.383 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-15T12:09:28.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T12:09:45.537 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.77 2024-09-15T12:10:00.270 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-09-15T12:10:00.538 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-15T12:10:00.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T12:10:00.733 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-15T12:10:00.733 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-505.el9.x86_64"... 2024-09-15T12:10:00.734 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2024-09-15T12:10:00.748 INFO:teuthology.orchestra.run.smithi138.stdout:5.14.0-505.el9.x86_64 2024-09-15T12:10:00.749 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-15T12:10:00.749 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-15T12:10:00.749 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-15T12:10:00.904 DEBUG:teuthology.orchestra.run.smithi077:> true 2024-09-15T12:10:01.295 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-15T12:10:01.295 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-15T12:10:01.295 DEBUG:teuthology.orchestra.run.smithi077:> uname -r 2024-09-15T12:10:01.310 INFO:teuthology.orchestra.run.smithi077.stdout:5.14.0-505.el9.x86_64 2024-09-15T12:10:01.310 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-15T12:10:01.310 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-15T12:10:01.310 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-15T12:10:01.750 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-15T12:10:01.750 DEBUG:teuthology.orchestra.run.smithi138:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-15T12:10:01.918 INFO:teuthology.orchestra.run.smithi138.stdout:ttyS1 2024-09-15T12:10:01.940 DEBUG:teuthology.parallel:result is None 2024-09-15T12:10:02.311 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-15T12:10:02.311 DEBUG:teuthology.orchestra.run.smithi077:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-15T12:10:02.399 INFO:teuthology.orchestra.run.smithi077.stdout:ttyS1 2024-09-15T12:10:02.423 DEBUG:teuthology.parallel:result is None 2024-09-15T12:10:02.424 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-15T12:10:02.431 INFO:teuthology.task.internal:Creating test directory... 2024-09-15T12:10:02.432 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T12:10:02.434 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T12:10:02.469 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-15T12:10:02.476 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-15T12:10:02.487 INFO:teuthology.task.internal:Creating archive directory... 2024-09-15T12:10:02.487 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T12:10:02.490 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T12:10:02.572 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-15T12:10:02.579 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-15T12:10:02.579 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T12:10:02.581 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T12:10:02.604 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T12:10:02.614 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T12:10:02.673 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T12:10:02.696 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T12:10:02.699 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-15T12:10:02.706 INFO:teuthology.task.internal:Configuring sudo... 2024-09-15T12:10:02.707 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T12:10:02.709 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T12:10:02.772 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-15T12:10:02.781 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-15T12:10:02.782 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T12:10:02.784 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T12:10:02.835 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T12:10:02.878 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T12:10:02.926 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T12:10:03.005 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T12:10:03.041 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T12:10:03.041 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T12:10:03.102 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T12:10:03.146 DEBUG:teuthology.orchestra.run.smithi138:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T12:10:03.190 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T12:10:03.271 DEBUG:teuthology.orchestra.run.smithi138:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T12:10:03.311 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-15T12:10:03.312 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T12:10:03.376 DEBUG:teuthology.orchestra.run.smithi077:> sudo service rsyslog restart 2024-09-15T12:10:03.379 DEBUG:teuthology.orchestra.run.smithi138:> sudo service rsyslog restart 2024-09-15T12:10:03.439 INFO:teuthology.orchestra.run.smithi077.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T12:10:03.471 INFO:teuthology.orchestra.run.smithi138.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T12:10:03.695 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-15T12:10:03.702 INFO:teuthology.task.internal:Starting timer... 2024-09-15T12:10:03.702 INFO:teuthology.run_tasks:Running task pcp... 2024-09-15T12:10:03.714 INFO:teuthology.run_tasks:Running task selinux... 2024-09-15T12:10:03.741 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-15T12:10:03.742 DEBUG:teuthology.orchestra.run.smithi077:> sudo service auditd rotate 2024-09-15T12:10:03.863 INFO:teuthology.orchestra.run.smithi077.stdout:Rotating logs: 2024-09-15T12:10:03.866 DEBUG:teuthology.orchestra.run.smithi138:> sudo service auditd rotate 2024-09-15T12:10:03.900 INFO:teuthology.orchestra.run.smithi138.stdout:Rotating logs: 2024-09-15T12:10:03.902 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-15T12:10:03.902 DEBUG:teuthology.orchestra.run.smithi077:> /usr/sbin/getenforce 2024-09-15T12:10:04.220 INFO:teuthology.orchestra.run.smithi077.stdout:Permissive 2024-09-15T12:10:04.220 DEBUG:teuthology.orchestra.run.smithi138:> /usr/sbin/getenforce 2024-09-15T12:10:04.239 INFO:teuthology.orchestra.run.smithi138.stdout:Permissive 2024-09-15T12:10:04.239 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi077.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi138.front.sepia.ceph.com': 'permissive'} 2024-09-15T12:10:04.240 DEBUG:teuthology.orchestra.run.smithi077:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T12:10:04.325 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T12:10:04.326 DEBUG:teuthology.orchestra.run.smithi138:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T12:10:04.350 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T12:10:04.351 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-15T12:10:04.351 DEBUG:teuthology.orchestra.run.smithi077:> sudo /usr/sbin/setenforce permissive 2024-09-15T12:10:04.426 DEBUG:teuthology.orchestra.run.smithi138:> sudo /usr/sbin/setenforce permissive 2024-09-15T12:10:04.456 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-15T12:10:04.465 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-15T12:10:04.468 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-15T12:10:04.588 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-15T12:10:04.603 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-15T12:10:04.614 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi077.front.sepia.ceph.com,smithi138.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-15T12:14:15.884 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi077.front.sepia.ceph.com'), Remote(name='ubuntu@smithi138.front.sepia.ceph.com')] 2024-09-15T12:14:15.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-15T12:14:15.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T12:14:16.026 DEBUG:teuthology.orchestra.run.smithi077:> true 2024-09-15T12:14:16.106 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-15T12:14:16.106 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-15T12:14:16.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T12:14:16.206 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-09-15T12:14:16.293 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-15T12:14:16.294 INFO:teuthology.run_tasks:Running task clock... 2024-09-15T12:14:16.306 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-15T12:14:16.306 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T12:14:16.307 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T12:14:16.309 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T12:14:16.310 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T12:14:16.340 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-15T12:14:16.356 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-15T12:14:16.366 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-15T12:14:16.381 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-15T12:14:16.384 INFO:teuthology.orchestra.run.smithi077.stderr:sudo: ntpd: command not found 2024-09-15T12:14:16.396 INFO:teuthology.orchestra.run.smithi077.stdout:506 Cannot talk to daemon 2024-09-15T12:14:16.408 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: ntpd: command not found 2024-09-15T12:14:16.411 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-15T12:14:16.419 INFO:teuthology.orchestra.run.smithi138.stdout:506 Cannot talk to daemon 2024-09-15T12:14:16.425 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-15T12:14:16.435 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-15T12:14:16.448 INFO:teuthology.orchestra.run.smithi138.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-15T12:14:16.485 INFO:teuthology.orchestra.run.smithi077.stderr:bash: line 1: ntpq: command not found 2024-09-15T12:14:16.489 INFO:teuthology.orchestra.run.smithi077.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T12:14:16.489 INFO:teuthology.orchestra.run.smithi077.stdout:=============================================================================== 2024-09-15T12:14:16.489 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T12:14:16.490 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T12:14:16.490 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T12:14:16.490 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T12:14:16.511 INFO:teuthology.orchestra.run.smithi138.stderr:bash: line 1: ntpq: command not found 2024-09-15T12:14:16.514 INFO:teuthology.orchestra.run.smithi138.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T12:14:16.515 INFO:teuthology.orchestra.run.smithi138.stdout:=============================================================================== 2024-09-15T12:14:16.515 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T12:14:16.515 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T12:14:16.515 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T12:14:16.515 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T12:14:16.516 INFO:teuthology.run_tasks:Running task install... 2024-09-15T12:14:16.524 DEBUG:teuthology.task.install:project ceph 2024-09-15T12:14:16.525 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}} 2024-09-15T12:14:16.525 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'} 2024-09-15T12:14:16.525 INFO:teuthology.task.install:Using flavor: crimson 2024-09-15T12:14:16.541 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-15T12:14:16.541 INFO:teuthology.task.install:extra packages: [] 2024-09-15T12:14:16.542 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'tag': None, 'wait_for_package': False} 2024-09-15T12:14:16.542 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-15T12:14:16.544 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'tag': None, 'wait_for_package': False} 2024-09-15T12:14:16.545 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-15T12:14:16.693 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/ 2024-09-15T12:14:16.693 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4879.g81fedcb3 2024-09-15T12:14:16.696 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/ 2024-09-15T12:14:16.696 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4879.g81fedcb3 2024-09-15T12:14:16.805 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-15T12:14:16.806 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T12:14:16.806 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-15T12:14:16.813 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-matanb-crimson-testing-59543/81fedcb3b484c843d22ffbc8d179cb567b7083b5/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-15T12:14:16.813 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-15T12:14:16.813 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-15T12:14:16.832 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-15T12:14:16.832 DEBUG:teuthology.orchestra.run.smithi077:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81fedcb3b484c843d22ffbc8d179cb567b7083b5/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-15T12:14:16.839 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-15T12:14:16.839 DEBUG:teuthology.orchestra.run.smithi138:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/81fedcb3b484c843d22ffbc8d179cb567b7083b5/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-15T12:14:16.898 DEBUG:teuthology.orchestra.run.smithi077:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-15T12:14:16.905 DEBUG:teuthology.orchestra.run.smithi138:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-15T12:14:16.973 DEBUG:teuthology.orchestra.run.smithi077:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-15T12:14:16.981 DEBUG:teuthology.orchestra.run.smithi138:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-15T12:14:17.042 INFO:teuthology.orchestra.run.smithi077.stdout:check_obsoletes = 1 2024-09-15T12:14:17.042 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum clean all 2024-09-15T12:14:17.045 INFO:teuthology.orchestra.run.smithi138.stdout:check_obsoletes = 1 2024-09-15T12:14:17.048 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum clean all 2024-09-15T12:14:17.275 INFO:teuthology.orchestra.run.smithi138.stdout:45 files removed 2024-09-15T12:14:17.302 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-radosgw 2024-09-15T12:14:17.305 INFO:teuthology.orchestra.run.smithi077.stdout:45 files removed 2024-09-15T12:14:17.335 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-radosgw 2024-09-15T12:14:17.868 INFO:teuthology.orchestra.run.smithi138.stdout:ceph packages for x86_64 314 kB/s | 88 kB 00:00 2024-09-15T12:14:17.888 INFO:teuthology.orchestra.run.smithi077.stdout:ceph packages for x86_64 333 kB/s | 88 kB 00:00 2024-09-15T12:14:18.160 INFO:teuthology.orchestra.run.smithi138.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-15T12:14:18.205 INFO:teuthology.orchestra.run.smithi077.stdout:ceph noarch packages 88 kB/s | 24 kB 00:00 2024-09-15T12:14:18.436 INFO:teuthology.orchestra.run.smithi138.stdout:ceph source packages 8.7 kB/s | 2.1 kB 00:00 2024-09-15T12:14:18.497 INFO:teuthology.orchestra.run.smithi077.stdout:ceph source packages 8.1 kB/s | 2.1 kB 00:00 2024-09-15T12:14:20.023 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - BaseOS 5.5 MB/s | 8.2 MB 00:01 2024-09-15T12:14:21.003 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - BaseOS 3.3 MB/s | 8.2 MB 00:02 2024-09-15T12:14:22.797 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-15T12:14:28.540 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.5 MB 00:01 2024-09-15T12:14:30.214 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - AppStream 2.2 MB/s | 20 MB 00:09 2024-09-15T12:14:30.351 INFO:teuthology.orchestra.run.smithi138.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 19 kB 00:00 2024-09-15T12:14:31.137 INFO:teuthology.orchestra.run.smithi138.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-15T12:14:34.515 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-15T12:14:36.016 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - Extras packages 112 kB/s | 19 kB 00:00 2024-09-15T12:14:36.459 INFO:teuthology.orchestra.run.smithi138.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-09-15T12:14:36.773 INFO:teuthology.orchestra.run.smithi077.stdout:Extra Packages for Enterprise Linux 36 MB/s | 23 MB 00:00 2024-09-15T12:14:38.821 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-15T12:14:38.836 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:14:38.837 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-09-15T12:14:38.837 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:14:38.837 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-15T12:14:38.837 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-radosgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 10 M 2024-09-15T12:14:38.837 INFO:teuthology.orchestra.run.smithi138.stdout:Upgrading: 2024-09-15T12:14:38.837 INFO:teuthology.orchestra.run.smithi138.stdout: librados2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-15T12:14:38.837 INFO:teuthology.orchestra.run.smithi138.stdout: librbd1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.8 M 2024-09-15T12:14:38.837 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-09-15T12:14:38.837 INFO:teuthology.orchestra.run.smithi138.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-15T12:14:38.837 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-base x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.1 M 2024-09-15T12:14:38.837 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 20 M 2024-09-15T12:14:38.838 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-selinux x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 25 k 2024-09-15T12:14:38.838 INFO:teuthology.orchestra.run.smithi138.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-15T12:14:38.838 INFO:teuthology.orchestra.run.smithi138.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-15T12:14:38.838 INFO:teuthology.orchestra.run.smithi138.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-15T12:14:38.838 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 809 k 2024-09-15T12:14:38.838 INFO:teuthology.orchestra.run.smithi138.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-15T12:14:38.838 INFO:teuthology.orchestra.run.smithi138.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-15T12:14:38.838 INFO:teuthology.orchestra.run.smithi138.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-15T12:14:38.838 INFO:teuthology.orchestra.run.smithi138.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-15T12:14:38.838 INFO:teuthology.orchestra.run.smithi138.stdout: libradosstriper1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 558 k 2024-09-15T12:14:38.838 INFO:teuthology.orchestra.run.smithi138.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-15T12:14:38.838 INFO:teuthology.orchestra.run.smithi138.stdout: librgw2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.4 M 2024-09-15T12:14:38.839 INFO:teuthology.orchestra.run.smithi138.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-15T12:14:38.839 INFO:teuthology.orchestra.run.smithi138.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-15T12:14:38.839 INFO:teuthology.orchestra.run.smithi138.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-15T12:14:38.839 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-argparse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 45 k 2024-09-15T12:14:38.839 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 143 k 2024-09-15T12:14:38.839 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cephfs x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 160 k 2024-09-15T12:14:38.839 INFO:teuthology.orchestra.run.smithi138.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-15T12:14:38.839 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rados x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 315 k 2024-09-15T12:14:38.839 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 302 k 2024-09-15T12:14:38.839 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 99 k 2024-09-15T12:14:38.839 INFO:teuthology.orchestra.run.smithi138.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-15T12:14:38.839 INFO:teuthology.orchestra.run.smithi138.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-15T12:14:38.839 INFO:teuthology.orchestra.run.smithi138.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-15T12:14:38.840 INFO:teuthology.orchestra.run.smithi138.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-15T12:14:38.840 INFO:teuthology.orchestra.run.smithi138.stdout:Installing weak dependencies: 2024-09-15T12:14:38.840 INFO:teuthology.orchestra.run.smithi138.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-15T12:14:38.840 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:14:38.840 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-15T12:14:38.840 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:14:38.840 INFO:teuthology.orchestra.run.smithi138.stdout:Install 31 Packages 2024-09-15T12:14:38.840 INFO:teuthology.orchestra.run.smithi138.stdout:Upgrade 2 Packages 2024-09-15T12:14:38.840 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:14:38.841 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 60 M 2024-09-15T12:14:38.841 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-15T12:14:39.711 INFO:teuthology.orchestra.run.smithi138.stdout:(1/33): ceph-base-19.3.0-4879.g81fedcb3.el9.x86 10 MB/s | 6.1 MB 00:00 2024-09-15T12:14:39.762 INFO:teuthology.orchestra.run.smithi138.stdout:(2/33): ceph-selinux-19.3.0-4879.g81fedcb3.el9. 503 kB/s | 25 kB 00:00 2024-09-15T12:14:39.846 INFO:teuthology.orchestra.run.smithi138.stdout:(3/33): libcephfs2-19.3.0-4879.g81fedcb3.el9.x8 9.5 MB/s | 809 kB 00:00 2024-09-15T12:14:39.912 INFO:teuthology.orchestra.run.smithi138.stdout:(4/33): libradosstriper1-19.3.0-4879.g81fedcb3. 8.2 MB/s | 558 kB 00:00 2024-09-15T12:14:40.245 INFO:teuthology.orchestra.run.smithi138.stdout:(5/33): librgw2-19.3.0-4879.g81fedcb3.el9.x86_6 16 MB/s | 5.4 MB 00:00 2024-09-15T12:14:40.371 INFO:teuthology.orchestra.run.smithi138.stdout:(6/33): ceph-radosgw-19.3.0-4879.g81fedcb3.el9. 8.4 MB/s | 10 MB 00:01 2024-09-15T12:14:40.396 INFO:teuthology.orchestra.run.smithi138.stdout:(7/33): python3-ceph-argparse-19.3.0-4879.g81fe 300 kB/s | 45 kB 00:00 2024-09-15T12:14:40.421 INFO:teuthology.orchestra.run.smithi138.stdout:(8/33): python3-ceph-common-19.3.0-4879.g81fedc 2.8 MB/s | 143 kB 00:00 2024-09-15T12:14:40.447 INFO:teuthology.orchestra.run.smithi138.stdout:(9/33): python3-cephfs-19.3.0-4879.g81fedcb3.el 3.1 MB/s | 160 kB 00:00 2024-09-15T12:14:40.472 INFO:teuthology.orchestra.run.smithi138.stdout:(10/33): python3-rados-19.3.0-4879.g81fedcb3.el 6.1 MB/s | 315 kB 00:00 2024-09-15T12:14:40.506 INFO:teuthology.orchestra.run.smithi138.stdout:(11/33): python3-rbd-19.3.0-4879.g81fedcb3.el9. 5.0 MB/s | 302 kB 00:00 2024-09-15T12:14:40.531 INFO:teuthology.orchestra.run.smithi138.stdout:(12/33): python3-rgw-19.3.0-4879.g81fedcb3.el9. 1.7 MB/s | 99 kB 00:00 2024-09-15T12:14:40.732 INFO:teuthology.orchestra.run.smithi138.stdout:(13/33): ceph-common-19.3.0-4879.g81fedcb3.el9. 12 MB/s | 20 MB 00:01 2024-09-15T12:14:40.874 INFO:teuthology.orchestra.run.smithi138.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 291 kB/s | 107 kB 00:00 2024-09-15T12:14:40.907 INFO:teuthology.orchestra.run.smithi138.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 454 kB/s | 171 kB 00:00 2024-09-15T12:14:40.932 INFO:teuthology.orchestra.run.smithi138.stdout:(16/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 773 kB/s | 45 kB 00:00 2024-09-15T12:14:40.958 INFO:teuthology.orchestra.run.smithi138.stdout:(17/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 709 kB/s | 160 kB 00:00 2024-09-15T12:14:41.013 INFO:teuthology.orchestra.run.smithi138.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 843 kB/s | 42 kB 00:00 2024-09-15T12:14:41.067 INFO:teuthology.orchestra.run.smithi138.stdout:(19/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-15T12:14:41.093 INFO:teuthology.orchestra.run.smithi138.stdout:(20/33): librdkafka-1.6.1-102.el9.x86_64.rpm 3.5 MB/s | 662 kB 00:00 2024-09-15T12:14:41.126 INFO:teuthology.orchestra.run.smithi138.stdout:(21/33): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-15T12:14:41.143 INFO:teuthology.orchestra.run.smithi138.stdout:(22/33): qatlib-service-24.02.0-1.el9.x86_64.rp 475 kB/s | 36 kB 00:00 2024-09-15T12:14:41.169 INFO:teuthology.orchestra.run.smithi138.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 627 kB/s | 47 kB 00:00 2024-09-15T12:14:41.236 INFO:teuthology.orchestra.run.smithi138.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-15T12:14:41.261 INFO:teuthology.orchestra.run.smithi138.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2024-09-15T12:14:41.288 INFO:teuthology.orchestra.run.smithi138.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 253 kB/s | 26 kB 00:00 2024-09-15T12:14:41.312 INFO:teuthology.orchestra.run.smithi138.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-15T12:14:41.345 INFO:teuthology.orchestra.run.smithi138.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-15T12:14:41.396 INFO:teuthology.orchestra.run.smithi138.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-15T12:14:41.447 INFO:teuthology.orchestra.run.smithi138.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-15T12:14:41.539 INFO:teuthology.orchestra.run.smithi138.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-15T12:14:41.674 INFO:teuthology.orchestra.run.smithi138.stdout:(32/33): librados2-19.3.0-4879.g81fedcb3.el9.x8 13 MB/s | 3.5 MB 00:00 2024-09-15T12:14:41.747 INFO:teuthology.orchestra.run.smithi138.stdout:(33/33): librbd1-19.3.0-4879.g81fedcb3.el9.x86_ 13 MB/s | 3.8 MB 00:00 2024-09-15T12:14:41.753 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:14:41.753 INFO:teuthology.orchestra.run.smithi138.stdout:Total 21 MB/s | 60 MB 00:02 2024-09-15T12:14:41.871 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-15T12:14:41.908 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-15T12:14:41.909 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-15T12:14:42.228 INFO:teuthology.orchestra.run.smithi077.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-09-15T12:14:42.585 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-15T12:14:42.585 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-15T12:14:44.093 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-15T12:14:44.605 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-15T12:14:44.613 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-15T12:14:44.622 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:14:44.622 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-09-15T12:14:44.622 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:14:44.622 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-15T12:14:44.622 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-radosgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 10 M 2024-09-15T12:14:44.622 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrading: 2024-09-15T12:14:44.622 INFO:teuthology.orchestra.run.smithi077.stdout: librados2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-15T12:14:44.622 INFO:teuthology.orchestra.run.smithi077.stdout: librbd1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.8 M 2024-09-15T12:14:44.622 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-09-15T12:14:44.622 INFO:teuthology.orchestra.run.smithi077.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-15T12:14:44.623 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.1 M 2024-09-15T12:14:44.623 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 20 M 2024-09-15T12:14:44.623 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-selinux x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 25 k 2024-09-15T12:14:44.623 INFO:teuthology.orchestra.run.smithi077.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-15T12:14:44.623 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-15T12:14:44.623 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-15T12:14:44.623 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 809 k 2024-09-15T12:14:44.623 INFO:teuthology.orchestra.run.smithi077.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-15T12:14:44.623 INFO:teuthology.orchestra.run.smithi077.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-15T12:14:44.623 INFO:teuthology.orchestra.run.smithi077.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-15T12:14:44.623 INFO:teuthology.orchestra.run.smithi077.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-15T12:14:44.623 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 558 k 2024-09-15T12:14:44.623 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-15T12:14:44.623 INFO:teuthology.orchestra.run.smithi077.stdout: librgw2 x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.4 M 2024-09-15T12:14:44.624 INFO:teuthology.orchestra.run.smithi077.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-15T12:14:44.624 INFO:teuthology.orchestra.run.smithi077.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-15T12:14:44.624 INFO:teuthology.orchestra.run.smithi077.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-15T12:14:44.624 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-argparse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 45 k 2024-09-15T12:14:44.624 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-common x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 143 k 2024-09-15T12:14:44.624 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cephfs x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 160 k 2024-09-15T12:14:44.624 INFO:teuthology.orchestra.run.smithi077.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-15T12:14:44.624 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 315 k 2024-09-15T12:14:44.624 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 302 k 2024-09-15T12:14:44.624 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rgw x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 99 k 2024-09-15T12:14:44.624 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-15T12:14:44.624 INFO:teuthology.orchestra.run.smithi077.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-15T12:14:44.624 INFO:teuthology.orchestra.run.smithi077.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-15T12:14:44.625 INFO:teuthology.orchestra.run.smithi077.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-15T12:14:44.625 INFO:teuthology.orchestra.run.smithi077.stdout:Installing weak dependencies: 2024-09-15T12:14:44.625 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-15T12:14:44.625 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:14:44.625 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-15T12:14:44.625 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:14:44.625 INFO:teuthology.orchestra.run.smithi077.stdout:Install 31 Packages 2024-09-15T12:14:44.625 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrade 2 Packages 2024-09-15T12:14:44.625 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:14:44.626 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 60 M 2024-09-15T12:14:44.626 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-15T12:14:44.675 INFO:teuthology.orchestra.run.smithi138.stdout: Upgrading : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-15T12:14:44.768 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-15T12:14:44.857 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-15T12:14:44.885 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-15T12:14:44.948 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-15T12:14:44.994 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-15T12:14:45.024 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-15T12:14:45.049 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-15T12:14:45.072 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-15T12:14:45.104 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-15T12:14:45.309 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-15T12:14:45.339 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-15T12:14:45.374 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-15T12:14:45.418 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 11/35 2024-09-15T12:14:45.455 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-15T12:14:45.543 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-15T12:14:45.569 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-15T12:14:45.639 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-15T12:14:45.694 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-15T12:14:45.806 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-15T12:14:45.837 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-15T12:14:45.888 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-15T12:14:45.919 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 19/35 2024-09-15T12:14:45.948 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-15T12:14:45.985 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-15T12:14:46.279 INFO:teuthology.orchestra.run.smithi077.stdout:(1/33): ceph-base-19.3.0-4879.g81fedcb3.el9.x86 6.1 MB/s | 6.1 MB 00:00 2024-09-15T12:14:46.352 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-15T12:14:46.403 INFO:teuthology.orchestra.run.smithi138.stdout: Upgrading : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-15T12:14:46.430 INFO:teuthology.orchestra.run.smithi077.stdout:(2/33): ceph-radosgw-19.3.0-4879.g81fedcb3.el9. 9.0 MB/s | 10 MB 00:01 2024-09-15T12:14:46.448 INFO:teuthology.orchestra.run.smithi077.stdout:(3/33): ceph-selinux-19.3.0-4879.g81fedcb3.el9. 150 kB/s | 25 kB 00:00 2024-09-15T12:14:46.494 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-15T12:14:46.497 INFO:teuthology.orchestra.run.smithi077.stdout:(4/33): libcephfs2-19.3.0-4879.g81fedcb3.el9.x8 12 MB/s | 809 kB 00:00 2024-09-15T12:14:46.525 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 24/35 2024-09-15T12:14:46.530 INFO:teuthology.orchestra.run.smithi077.stdout:(5/33): libradosstriper1-19.3.0-4879.g81fedcb3. 6.5 MB/s | 558 kB 00:00 2024-09-15T12:14:46.569 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-15T12:14:46.589 INFO:teuthology.orchestra.run.smithi077.stdout:(6/33): python3-ceph-argparse-19.3.0-4879.g81fe 772 kB/s | 45 kB 00:00 2024-09-15T12:14:46.673 INFO:teuthology.orchestra.run.smithi077.stdout:(7/33): python3-ceph-common-19.3.0-4879.g81fedc 1.7 MB/s | 143 kB 00:00 2024-09-15T12:14:46.764 INFO:teuthology.orchestra.run.smithi077.stdout:(8/33): python3-cephfs-19.3.0-4879.g81fedcb3.el 1.7 MB/s | 160 kB 00:00 2024-09-15T12:14:46.865 INFO:teuthology.orchestra.run.smithi077.stdout:(9/33): python3-rados-19.3.0-4879.g81fedcb3.el9 3.1 MB/s | 315 kB 00:00 2024-09-15T12:14:46.932 INFO:teuthology.orchestra.run.smithi077.stdout:(10/33): librgw2-19.3.0-4879.g81fedcb3.el9.x86_ 12 MB/s | 5.4 MB 00:00 2024-09-15T12:14:46.957 INFO:teuthology.orchestra.run.smithi077.stdout:(11/33): python3-rbd-19.3.0-4879.g81fedcb3.el9. 3.2 MB/s | 302 kB 00:00 2024-09-15T12:14:47.149 INFO:teuthology.orchestra.run.smithi077.stdout:(12/33): ceph-common-19.3.0-4879.g81fedcb3.el9. 11 MB/s | 20 MB 00:01 2024-09-15T12:14:47.167 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-15T12:14:47.181 INFO:teuthology.orchestra.run.smithi077.stdout:(13/33): python3-rgw-19.3.0-4879.g81fedcb3.el9. 411 kB/s | 99 kB 00:00 2024-09-15T12:14:47.198 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-15T12:14:47.253 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-15T12:14:47.282 INFO:teuthology.orchestra.run.smithi077.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 328 kB/s | 107 kB 00:00 2024-09-15T12:14:47.308 INFO:teuthology.orchestra.run.smithi077.stdout:(15/33): libnbd-1.20.2-2.el9.x86_64.rpm 1.1 MB/s | 171 kB 00:00 2024-09-15T12:14:47.325 INFO:teuthology.orchestra.run.smithi077.stdout:(16/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-15T12:14:47.332 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 28/35 2024-09-15T12:14:47.350 INFO:teuthology.orchestra.run.smithi077.stdout:(17/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 911 kB/s | 160 kB 00:00 2024-09-15T12:14:47.376 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 29/35 2024-09-15T12:14:47.436 INFO:teuthology.orchestra.run.smithi077.stdout:(18/33): python3-prettytable-0.7.2-27.el9.noarc 507 kB/s | 42 kB 00:00 2024-09-15T12:14:47.459 INFO:teuthology.orchestra.run.smithi077.stdout:(19/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-15T12:14:47.501 INFO:teuthology.orchestra.run.smithi077.stdout:(20/33): qatlib-service-24.02.0-1.el9.x86_64.rp 866 kB/s | 36 kB 00:00 2024-09-15T12:14:47.526 INFO:teuthology.orchestra.run.smithi077.stdout:(21/33): qatlib-24.02.0-1.el9.x86_64.rpm 2.3 MB/s | 221 kB 00:00 2024-09-15T12:14:47.560 INFO:teuthology.orchestra.run.smithi077.stdout:(22/33): librdkafka-1.6.1-102.el9.x86_64.rpm 2.6 MB/s | 662 kB 00:00 2024-09-15T12:14:47.594 INFO:teuthology.orchestra.run.smithi077.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 512 kB/s | 47 kB 00:00 2024-09-15T12:14:47.644 INFO:teuthology.orchestra.run.smithi077.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.6 MB/s | 308 kB 00:00 2024-09-15T12:14:47.669 INFO:teuthology.orchestra.run.smithi077.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-15T12:14:47.720 INFO:teuthology.orchestra.run.smithi077.stdout:(26/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 233 kB/s | 26 kB 00:00 2024-09-15T12:14:47.745 INFO:teuthology.orchestra.run.smithi077.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 896 kB/s | 67 kB 00:00 2024-09-15T12:14:47.778 INFO:teuthology.orchestra.run.smithi077.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.7 MB/s | 191 kB 00:00 2024-09-15T12:14:47.820 INFO:teuthology.orchestra.run.smithi077.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-15T12:14:47.887 INFO:teuthology.orchestra.run.smithi077.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-15T12:14:47.956 INFO:teuthology.orchestra.run.smithi077.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-15T12:14:48.113 INFO:teuthology.orchestra.run.smithi077.stdout:(32/33): librbd1-19.3.0-4879.g81fedcb3.el9.x86_ 17 MB/s | 3.8 MB 00:00 2024-09-15T12:14:48.171 INFO:teuthology.orchestra.run.smithi077.stdout:(33/33): librados2-19.3.0-4879.g81fedcb3.el9.x8 9.9 MB/s | 3.5 MB 00:00 2024-09-15T12:14:48.176 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:14:48.176 INFO:teuthology.orchestra.run.smithi077.stdout:Total 17 MB/s | 60 MB 00:03 2024-09-15T12:14:48.287 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-15T12:14:48.324 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-15T12:14:48.324 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-15T12:14:48.989 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-15T12:14:48.990 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-15T12:14:49.815 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-15T12:14:49.857 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-15T12:14:50.504 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-15T12:14:50.588 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-15T12:14:50.633 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-15T12:14:50.706 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-15T12:14:50.706 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-15T12:14:50.706 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-15T12:14:50.706 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:14:50.750 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-15T12:14:51.027 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-15T12:14:51.090 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-15T12:14:51.181 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-15T12:14:51.271 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-15T12:14:51.291 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-15T12:14:51.379 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-15T12:14:51.424 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/35 2024-09-15T12:14:51.454 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/35 2024-09-15T12:14:51.480 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/35 2024-09-15T12:14:51.504 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-15T12:14:51.524 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/35 2024-09-15T12:14:51.685 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-15T12:14:51.719 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/35 2024-09-15T12:14:51.753 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/35 2024-09-15T12:14:51.797 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 11/35 2024-09-15T12:14:51.826 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-15T12:14:51.905 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 13/35 2024-09-15T12:14:51.931 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-15T12:14:52.002 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 14/35 2024-09-15T12:14:52.039 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : thrift-0.15.0-2.el9.x86_64 15/35 2024-09-15T12:14:52.152 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : re2-1:20211101-20.el9.x86_64 16/35 2024-09-15T12:14:52.181 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/35 2024-09-15T12:14:52.239 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 18/35 2024-09-15T12:14:52.273 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 19/35 2024-09-15T12:14:52.301 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 20/35 2024-09-15T12:14:52.337 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 21/35 2024-09-15T12:14:52.708 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-15T12:14:52.762 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-15T12:14:52.859 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 23/35 2024-09-15T12:14:52.884 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 24/35 2024-09-15T12:14:52.920 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-15T12:14:53.513 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-15T12:14:53.540 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-15T12:14:53.612 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 27/35 2024-09-15T12:14:53.690 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 28/35 2024-09-15T12:14:53.726 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 29/35 2024-09-15T12:14:56.211 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-15T12:14:56.247 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-15T12:14:56.939 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 30/35 2024-09-15T12:14:56.977 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-15T12:14:57.050 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 31/35 2024-09-15T12:14:57.050 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-15T12:14:57.050 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-15T12:14:57.050 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:14:57.097 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-15T12:15:01.395 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-15T12:15:01.395 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /sys 2024-09-15T12:15:01.396 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /proc 2024-09-15T12:15:01.396 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /mnt 2024-09-15T12:15:01.396 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /var/tmp 2024-09-15T12:15:01.396 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /home 2024-09-15T12:15:01.396 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /root 2024-09-15T12:15:01.396 INFO:teuthology.orchestra.run.smithi138.stdout:skipping the directory /tmp 2024-09-15T12:15:01.396 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:15:02.505 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-15T12:15:02.532 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-15T12:15:02.533 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:15:02.533 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-15T12:15:02.533 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T12:15:02.533 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T12:15:02.533 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:15:02.534 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-15T12:15:02.624 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-15T12:15:02.625 INFO:teuthology.orchestra.run.smithi138.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-15T12:15:03.974 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-15T12:15:03.974 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/35 2024-09-15T12:15:03.974 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-15T12:15:03.974 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-15T12:15:03.974 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-15T12:15:03.974 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/35 2024-09-15T12:15:03.974 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 6/35 2024-09-15T12:15:03.974 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 7/35 2024-09-15T12:15:03.974 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 8/35 2024-09-15T12:15:03.974 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 9/35 2024-09-15T12:15:03.974 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 10/35 2024-09-15T12:15:03.975 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 11/35 2024-09-15T12:15:03.975 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-15T12:15:03.975 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 13/35 2024-09-15T12:15:03.975 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-15T12:15:03.975 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-15T12:15:03.975 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-15T12:15:03.975 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-15T12:15:03.975 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-15T12:15:03.975 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-15T12:15:03.975 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-15T12:15:03.975 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-15T12:15:03.975 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-15T12:15:03.975 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-15T12:15:03.976 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-15T12:15:03.976 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-15T12:15:03.976 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-15T12:15:03.976 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-15T12:15:03.976 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-15T12:15:03.976 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-15T12:15:03.976 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-15T12:15:03.976 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-15T12:15:03.976 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-15T12:15:03.976 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-15T12:15:03.976 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/35 2024-09-15T12:15:04.772 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-15T12:15:04.773 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:15:04.773 INFO:teuthology.orchestra.run.smithi138.stdout:Upgraded: 2024-09-15T12:15:04.773 INFO:teuthology.orchestra.run.smithi138.stdout: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:04.773 INFO:teuthology.orchestra.run.smithi138.stdout: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:04.773 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-15T12:15:04.773 INFO:teuthology.orchestra.run.smithi138.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-15T12:15:04.773 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:04.773 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:04.773 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:04.773 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:04.773 INFO:teuthology.orchestra.run.smithi138.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-15T12:15:04.773 INFO:teuthology.orchestra.run.smithi138.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-15T12:15:04.773 INFO:teuthology.orchestra.run.smithi138.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-15T12:15:04.774 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:04.774 INFO:teuthology.orchestra.run.smithi138.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-15T12:15:04.774 INFO:teuthology.orchestra.run.smithi138.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-15T12:15:04.774 INFO:teuthology.orchestra.run.smithi138.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-15T12:15:04.774 INFO:teuthology.orchestra.run.smithi138.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-15T12:15:04.774 INFO:teuthology.orchestra.run.smithi138.stdout: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:04.774 INFO:teuthology.orchestra.run.smithi138.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-15T12:15:04.774 INFO:teuthology.orchestra.run.smithi138.stdout: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:04.774 INFO:teuthology.orchestra.run.smithi138.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-15T12:15:04.774 INFO:teuthology.orchestra.run.smithi138.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-15T12:15:04.774 INFO:teuthology.orchestra.run.smithi138.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-15T12:15:04.774 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:04.774 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:04.774 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:04.775 INFO:teuthology.orchestra.run.smithi138.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-15T12:15:04.775 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:04.775 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:04.775 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:04.775 INFO:teuthology.orchestra.run.smithi138.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-15T12:15:04.775 INFO:teuthology.orchestra.run.smithi138.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-15T12:15:04.775 INFO:teuthology.orchestra.run.smithi138.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-15T12:15:04.775 INFO:teuthology.orchestra.run.smithi138.stdout: re2-1:20211101-20.el9.x86_64 2024-09-15T12:15:04.775 INFO:teuthology.orchestra.run.smithi138.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-15T12:15:04.775 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:15:04.775 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-15T12:15:05.106 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-test 2024-09-15T12:15:05.675 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:00:29 ago on Sun 15 Sep 2024 12:14:36 PM UTC. 2024-09-15T12:15:05.809 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-15T12:15:05.811 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:15:05.811 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-09-15T12:15:05.811 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:15:05.812 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-15T12:15:05.812 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-test x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 85 M 2024-09-15T12:15:05.812 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-09-15T12:15:05.812 INFO:teuthology.orchestra.run.smithi138.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-15T12:15:05.812 INFO:teuthology.orchestra.run.smithi138.stdout: libcephsqlite x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 175 k 2024-09-15T12:15:05.812 INFO:teuthology.orchestra.run.smithi138.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-15T12:15:05.812 INFO:teuthology.orchestra.run.smithi138.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-15T12:15:05.812 INFO:teuthology.orchestra.run.smithi138.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-15T12:15:05.812 INFO:teuthology.orchestra.run.smithi138.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-15T12:15:05.812 INFO:teuthology.orchestra.run.smithi138.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-15T12:15:05.812 INFO:teuthology.orchestra.run.smithi138.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-15T12:15:05.812 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:15:05.813 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-15T12:15:05.813 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:15:05.813 INFO:teuthology.orchestra.run.smithi138.stdout:Install 9 Packages 2024-09-15T12:15:05.813 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:15:05.813 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 87 M 2024-09-15T12:15:05.813 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 797 M 2024-09-15T12:15:05.814 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-15T12:15:06.486 INFO:teuthology.orchestra.run.smithi138.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 660 kB/s | 94 kB 00:00 2024-09-15T12:15:06.653 INFO:teuthology.orchestra.run.smithi138.stdout:(2/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 3.0 MB/s | 513 kB 00:00 2024-09-15T12:15:06.695 INFO:teuthology.orchestra.run.smithi138.stdout:(3/9): libubsan-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 183 kB 00:00 2024-09-15T12:15:06.770 INFO:teuthology.orchestra.run.smithi138.stdout:(4/9): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-15T12:15:06.813 INFO:teuthology.orchestra.run.smithi138.stdout:(5/9): socat-1.7.4.1-6.el9.x86_64.rpm 7.1 MB/s | 304 kB 00:00 2024-09-15T12:15:06.854 INFO:teuthology.orchestra.run.smithi138.stdout:(6/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-15T12:15:06.896 INFO:teuthology.orchestra.run.smithi138.stdout:(7/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 2.9 MB/s | 122 kB 00:00 2024-09-15T12:15:06.955 INFO:teuthology.orchestra.run.smithi138.stdout:(8/9): libcephsqlite-19.3.0-4879.g81fedcb3.el9. 286 kB/s | 175 kB 00:00 2024-09-15T12:15:07.372 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-15T12:15:07.373 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /sys 2024-09-15T12:15:07.373 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /proc 2024-09-15T12:15:07.373 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /mnt 2024-09-15T12:15:07.373 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /var/tmp 2024-09-15T12:15:07.373 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /home 2024-09-15T12:15:07.373 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /root 2024-09-15T12:15:07.373 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /tmp 2024-09-15T12:15:07.373 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:15:08.486 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-15T12:15:08.515 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/35 2024-09-15T12:15:08.515 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:15:08.515 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-15T12:15:08.515 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T12:15:08.515 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T12:15:08.515 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:15:08.517 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-15T12:15:08.611 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-15T12:15:08.612 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-15T12:15:09.936 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-15T12:15:09.936 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/35 2024-09-15T12:15:09.936 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/35 2024-09-15T12:15:09.936 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/35 2024-09-15T12:15:09.936 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/35 2024-09-15T12:15:09.936 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/35 2024-09-15T12:15:09.936 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_6 6/35 2024-09-15T12:15:09.936 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 7/35 2024-09-15T12:15:09.937 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9. 8/35 2024-09-15T12:15:09.937 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x8 9/35 2024-09-15T12:15:09.937 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 10/35 2024-09-15T12:15:09.937 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 11/35 2024-09-15T12:15:09.937 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 12/35 2024-09-15T12:15:09.937 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 13/35 2024-09-15T12:15:09.937 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-15T12:15:09.937 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-15T12:15:09.937 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-15T12:15:09.937 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-15T12:15:09.937 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-15T12:15:09.937 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-15T12:15:09.937 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-15T12:15:09.937 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-15T12:15:09.938 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-15T12:15:09.938 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-15T12:15:09.938 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-15T12:15:09.938 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-15T12:15:09.938 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-15T12:15:09.938 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-15T12:15:09.939 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-15T12:15:09.939 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-15T12:15:09.939 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-15T12:15:09.939 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-15T12:15:09.939 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 32/35 2024-09-15T12:15:09.939 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-15T12:15:09.939 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/35 2024-09-15T12:15:11.028 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-15T12:15:11.028 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:15:11.028 INFO:teuthology.orchestra.run.smithi077.stdout:Upgraded: 2024-09-15T12:15:11.028 INFO:teuthology.orchestra.run.smithi077.stdout: librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:11.028 INFO:teuthology.orchestra.run.smithi077.stdout: librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:11.028 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-15T12:15:11.028 INFO:teuthology.orchestra.run.smithi077.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-15T12:15:11.028 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:11.029 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:11.029 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-radosgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:11.029 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-selinux-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:11.029 INFO:teuthology.orchestra.run.smithi077.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-15T12:15:11.029 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-15T12:15:11.029 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-15T12:15:11.029 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:11.029 INFO:teuthology.orchestra.run.smithi077.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-15T12:15:11.029 INFO:teuthology.orchestra.run.smithi077.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-15T12:15:11.029 INFO:teuthology.orchestra.run.smithi077.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-15T12:15:11.029 INFO:teuthology.orchestra.run.smithi077.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-15T12:15:11.029 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:11.029 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-15T12:15:11.030 INFO:teuthology.orchestra.run.smithi077.stdout: librgw2-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:11.030 INFO:teuthology.orchestra.run.smithi077.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-15T12:15:11.030 INFO:teuthology.orchestra.run.smithi077.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-15T12:15:11.030 INFO:teuthology.orchestra.run.smithi077.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-15T12:15:11.030 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-argparse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:11.030 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-common-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:11.030 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:11.030 INFO:teuthology.orchestra.run.smithi077.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-15T12:15:11.030 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:11.030 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:11.030 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:11.030 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-15T12:15:11.030 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-15T12:15:11.030 INFO:teuthology.orchestra.run.smithi077.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-15T12:15:11.031 INFO:teuthology.orchestra.run.smithi077.stdout: re2-1:20211101-20.el9.x86_64 2024-09-15T12:15:11.031 INFO:teuthology.orchestra.run.smithi077.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-15T12:15:11.031 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:15:11.031 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-15T12:15:11.359 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-test 2024-09-15T12:15:11.922 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:00:29 ago on Sun 15 Sep 2024 12:14:42 PM UTC. 2024-09-15T12:15:12.060 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-15T12:15:12.062 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:15:12.062 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-09-15T12:15:12.062 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:15:12.062 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-15T12:15:12.062 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-test x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 85 M 2024-09-15T12:15:12.062 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-09-15T12:15:12.063 INFO:teuthology.orchestra.run.smithi077.stdout: libasan8 x86_64 14.2.1-1.2.el9 appstream 513 k 2024-09-15T12:15:12.063 INFO:teuthology.orchestra.run.smithi077.stdout: libcephsqlite x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 175 k 2024-09-15T12:15:12.063 INFO:teuthology.orchestra.run.smithi077.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-15T12:15:12.063 INFO:teuthology.orchestra.run.smithi077.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-15T12:15:12.063 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-15T12:15:12.063 INFO:teuthology.orchestra.run.smithi077.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-15T12:15:12.063 INFO:teuthology.orchestra.run.smithi077.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-15T12:15:12.063 INFO:teuthology.orchestra.run.smithi077.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-15T12:15:12.064 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:15:12.064 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-15T12:15:12.064 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:15:12.064 INFO:teuthology.orchestra.run.smithi077.stdout:Install 9 Packages 2024-09-15T12:15:12.064 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:15:12.064 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 87 M 2024-09-15T12:15:12.064 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 797 M 2024-09-15T12:15:12.064 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-15T12:15:13.166 INFO:teuthology.orchestra.run.smithi077.stdout:(1/9): libcephsqlite-19.3.0-4879.g81fedcb3.el9. 351 kB/s | 175 kB 00:00 2024-09-15T12:15:13.308 INFO:teuthology.orchestra.run.smithi077.stdout:(2/9): libasan8-14.2.1-1.2.el9.x86_64.rpm 3.5 MB/s | 513 kB 00:00 2024-09-15T12:15:13.333 INFO:teuthology.orchestra.run.smithi077.stdout:(3/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 141 kB/s | 94 kB 00:00 2024-09-15T12:15:13.358 INFO:teuthology.orchestra.run.smithi077.stdout:(4/9): libubsan-11.5.0-2.el9.x86_64.rpm 3.6 MB/s | 183 kB 00:00 2024-09-15T12:15:13.432 INFO:teuthology.orchestra.run.smithi077.stdout:(5/9): socat-1.7.4.1-6.el9.x86_64.rpm 4.2 MB/s | 304 kB 00:00 2024-09-15T12:15:13.467 INFO:teuthology.orchestra.run.smithi077.stdout:(6/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.7 MB/s | 64 kB 00:00 2024-09-15T12:15:13.501 INFO:teuthology.orchestra.run.smithi077.stdout:(7/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 3.6 MB/s | 122 kB 00:00 2024-09-15T12:15:13.554 INFO:teuthology.orchestra.run.smithi077.stdout:(8/9): protobuf-3.14.0-13.el9.x86_64.rpm 4.6 MB/s | 1.0 MB 00:00 2024-09-15T12:15:19.709 INFO:teuthology.orchestra.run.smithi077.stdout:(9/9): ceph-test-19.3.0-4879.g81fedcb3.el9.x86_ 12 MB/s | 85 MB 00:07 2024-09-15T12:15:19.712 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:15:19.712 INFO:teuthology.orchestra.run.smithi077.stdout:Total 11 MB/s | 87 MB 00:07 2024-09-15T12:15:19.796 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-15T12:15:19.819 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-15T12:15:19.819 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-15T12:15:20.435 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-15T12:15:20.435 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-15T12:15:21.321 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-15T12:15:21.396 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-15T12:15:21.444 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-15T12:15:21.497 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-15T12:15:21.532 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-15T12:15:21.563 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-15T12:15:21.587 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-15T12:15:21.655 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-15T12:15:21.697 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-15T12:15:21.723 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-15T12:15:28.621 INFO:teuthology.orchestra.run.smithi138.stdout:(9/9): ceph-test-19.3.0-4879.g81fedcb3.el9.x86_ 3.8 MB/s | 85 MB 00:22 2024-09-15T12:15:28.623 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:15:28.623 INFO:teuthology.orchestra.run.smithi138.stdout:Total 3.8 MB/s | 87 MB 00:22 2024-09-15T12:15:28.703 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-15T12:15:28.726 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-15T12:15:28.726 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-15T12:15:29.348 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-15T12:15:29.349 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-15T12:15:30.248 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-15T12:15:30.332 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-09-15T12:15:30.382 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-09-15T12:15:30.454 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/9 2024-09-15T12:15:30.454 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-09-15T12:15:30.484 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-15T12:15:30.508 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-15T12:15:30.581 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libasan8-14.2.1-1.2.el9.x86_64 6/9 2024-09-15T12:15:30.626 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-09-15T12:15:30.652 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-15T12:15:32.880 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-15T12:15:32.955 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-15T12:15:39.072 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-15T12:15:39.073 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/9 2024-09-15T12:15:39.073 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/9 2024-09-15T12:15:39.073 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-15T12:15:39.073 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-15T12:15:39.073 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-15T12:15:39.073 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-15T12:15:39.073 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-15T12:15:39.073 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-15T12:15:39.500 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-15T12:15:39.500 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:15:39.501 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-15T12:15:39.501 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:39.501 INFO:teuthology.orchestra.run.smithi077.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-15T12:15:39.501 INFO:teuthology.orchestra.run.smithi077.stdout: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:39.501 INFO:teuthology.orchestra.run.smithi077.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-15T12:15:39.501 INFO:teuthology.orchestra.run.smithi077.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-15T12:15:39.501 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-15T12:15:39.501 INFO:teuthology.orchestra.run.smithi077.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-15T12:15:39.501 INFO:teuthology.orchestra.run.smithi077.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-15T12:15:39.501 INFO:teuthology.orchestra.run.smithi077.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-15T12:15:39.501 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:15:39.501 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-15T12:15:39.801 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph 2024-09-15T12:15:40.368 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:00:58 ago on Sun 15 Sep 2024 12:14:42 PM UTC. 2024-09-15T12:15:40.505 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-15T12:15:40.507 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:15:40.507 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-09-15T12:15:40.508 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:15:40.508 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-15T12:15:40.508 INFO:teuthology.orchestra.run.smithi077.stdout: ceph x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.5 k 2024-09-15T12:15:40.508 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-09-15T12:15:40.508 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mds x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 2.2 M 2024-09-15T12:15:40.508 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 1.6 M 2024-09-15T12:15:40.508 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 291 k 2024-09-15T12:15:40.508 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mon x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.1 M 2024-09-15T12:15:40.508 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-osd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 70 M 2024-09-15T12:15:40.508 INFO:teuthology.orchestra.run.smithi077.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-15T12:15:40.508 INFO:teuthology.orchestra.run.smithi077.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-15T12:15:40.508 INFO:teuthology.orchestra.run.smithi077.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-15T12:15:40.509 INFO:teuthology.orchestra.run.smithi077.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-15T12:15:40.509 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-15T12:15:40.509 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-15T12:15:40.509 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-15T12:15:40.509 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-15T12:15:40.509 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-15T12:15:40.509 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-15T12:15:40.509 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-collections 2024-09-15T12:15:40.509 INFO:teuthology.orchestra.run.smithi077.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-15T12:15:40.509 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-15T12:15:40.509 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-15T12:15:40.509 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-15T12:15:40.509 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-15T12:15:40.510 INFO:teuthology.orchestra.run.smithi077.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-15T12:15:40.510 INFO:teuthology.orchestra.run.smithi077.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-15T12:15:40.510 INFO:teuthology.orchestra.run.smithi077.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-15T12:15:40.510 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-15T12:15:40.510 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-15T12:15:40.510 INFO:teuthology.orchestra.run.smithi077.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-15T12:15:40.510 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-15T12:15:40.510 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-15T12:15:40.510 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-15T12:15:40.510 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-15T12:15:40.510 INFO:teuthology.orchestra.run.smithi077.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-15T12:15:40.510 INFO:teuthology.orchestra.run.smithi077.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-15T12:15:40.510 INFO:teuthology.orchestra.run.smithi077.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-15T12:15:40.511 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-15T12:15:40.511 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-15T12:15:40.511 INFO:teuthology.orchestra.run.smithi077.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-15T12:15:40.511 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:15:40.511 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-15T12:15:40.511 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:15:40.511 INFO:teuthology.orchestra.run.smithi077.stdout:Install 37 Packages 2024-09-15T12:15:40.511 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:15:40.512 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 84 M 2024-09-15T12:15:40.512 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 897 M 2024-09-15T12:15:40.512 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-15T12:15:41.200 INFO:teuthology.orchestra.run.smithi077.stdout:(1/37): ceph-19.3.0-4879.g81fedcb3.el9.x86_64.r 20 kB/s | 6.5 kB 00:00 2024-09-15T12:15:41.818 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 8/9 2024-09-15T12:15:41.901 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-15T12:15:42.126 INFO:teuthology.orchestra.run.smithi077.stdout:(2/37): ceph-mgr-19.3.0-4879.g81fedcb3.el9.x86_ 1.3 MB/s | 1.6 MB 00:01 2024-09-15T12:15:42.342 INFO:teuthology.orchestra.run.smithi077.stdout:(3/37): ceph-mds-19.3.0-4879.g81fedcb3.el9.x86_ 1.5 MB/s | 2.2 MB 00:01 2024-09-15T12:15:42.534 INFO:teuthology.orchestra.run.smithi077.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4879.g81fe 1.5 MB/s | 291 kB 00:00 2024-09-15T12:15:42.660 INFO:teuthology.orchestra.run.smithi077.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-09-15T12:15:42.897 INFO:teuthology.orchestra.run.smithi077.stdout:(6/37): python3-cryptography-36.0.1-4.el9.x86_6 5.3 MB/s | 1.2 MB 00:00 2024-09-15T12:15:42.943 INFO:teuthology.orchestra.run.smithi077.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-15T12:15:43.010 INFO:teuthology.orchestra.run.smithi077.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 2.0 MB/s | 135 kB 00:00 2024-09-15T12:15:43.060 INFO:teuthology.orchestra.run.smithi077.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.4 MB/s | 125 kB 00:00 2024-09-15T12:15:43.144 INFO:teuthology.orchestra.run.smithi077.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.5 MB/s | 215 kB 00:00 2024-09-15T12:15:43.319 INFO:teuthology.orchestra.run.smithi077.stdout:(11/37): lua-5.4.4-4.el9.x86_64.rpm 1.1 MB/s | 188 kB 00:00 2024-09-15T12:15:43.411 INFO:teuthology.orchestra.run.smithi077.stdout:(12/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-09-15T12:15:43.503 INFO:teuthology.orchestra.run.smithi077.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 379 kB/s | 35 kB 00:00 2024-09-15T12:15:43.587 INFO:teuthology.orchestra.run.smithi077.stdout:(14/37): python3-packaging-20.9-5.el9.noarch.rp 924 kB/s | 77 kB 00:00 2024-09-15T12:15:43.670 INFO:teuthology.orchestra.run.smithi077.stdout:(15/37): python3-pytz-2021.1-5.el9.noarch.rpm 613 kB/s | 51 kB 00:00 2024-09-15T12:15:43.746 INFO:teuthology.orchestra.run.smithi077.stdout:(16/37): python3-toml-0.10.2-6.el9.noarch.rpm 555 kB/s | 42 kB 00:00 2024-09-15T12:15:43.821 INFO:teuthology.orchestra.run.smithi077.stdout:(17/37): lua-devel-5.4.4-4.el9.x86_64.rpm 297 kB/s | 22 kB 00:00 2024-09-15T12:15:43.863 INFO:teuthology.orchestra.run.smithi077.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-15T12:15:43.888 INFO:teuthology.orchestra.run.smithi077.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-09-15T12:15:43.913 INFO:teuthology.orchestra.run.smithi077.stdout:(20/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 6.7 MB/s | 172 kB 00:00 2024-09-15T12:15:43.947 INFO:teuthology.orchestra.run.smithi077.stdout:(21/37): python3-cherrypy-18.6.1-2.el9.noarch.r 11 MB/s | 358 kB 00:00 2024-09-15T12:15:43.972 INFO:teuthology.orchestra.run.smithi077.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 431 kB/s | 11 kB 00:00 2024-09-15T12:15:43.998 INFO:teuthology.orchestra.run.smithi077.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 703 kB/s | 18 kB 00:00 2024-09-15T12:15:44.023 INFO:teuthology.orchestra.run.smithi077.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 927 kB/s | 23 kB 00:00 2024-09-15T12:15:44.048 INFO:teuthology.orchestra.run.smithi077.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 779 kB/s | 19 kB 00:00 2024-09-15T12:15:44.074 INFO:teuthology.orchestra.run.smithi077.stdout:(26/37): python3-jaraco-text-3.2.0-6.el9.noarch 788 kB/s | 20 kB 00:00 2024-09-15T12:15:44.099 INFO:teuthology.orchestra.run.smithi077.stdout:(27/37): python3-logutils-0.3.5-21.el9.noarch.r 1.8 MB/s | 46 kB 00:00 2024-09-15T12:15:44.124 INFO:teuthology.orchestra.run.smithi077.stdout:(28/37): python3-more-itertools-8.12.0-2.el9.no 3.1 MB/s | 79 kB 00:00 2024-09-15T12:15:44.150 INFO:teuthology.orchestra.run.smithi077.stdout:(29/37): python3-pecan-1.4.2-3.el9.noarch.rpm 11 MB/s | 272 kB 00:00 2024-09-15T12:15:44.175 INFO:teuthology.orchestra.run.smithi077.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 653 kB/s | 16 kB 00:00 2024-09-15T12:15:44.200 INFO:teuthology.orchestra.run.smithi077.stdout:(31/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 3.5 MB/s | 90 kB 00:00 2024-09-15T12:15:44.225 INFO:teuthology.orchestra.run.smithi077.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-15T12:15:44.251 INFO:teuthology.orchestra.run.smithi077.stdout:(33/37): python3-webob-1.8.8-2.el9.noarch.rpm 9.0 MB/s | 230 kB 00:00 2024-09-15T12:15:44.284 INFO:teuthology.orchestra.run.smithi077.stdout:(34/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 13 MB/s | 427 kB 00:00 2024-09-15T12:15:44.309 INFO:teuthology.orchestra.run.smithi077.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 800 kB/s | 20 kB 00:00 2024-09-15T12:15:44.768 INFO:teuthology.orchestra.run.smithi077.stdout:(36/37): ceph-mon-19.3.0-4879.g81fedcb3.el9.x86 1.4 MB/s | 5.1 MB 00:03 2024-09-15T12:15:48.367 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 9/9 2024-09-15T12:15:48.368 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/9 2024-09-15T12:15:48.368 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/9 2024-09-15T12:15:48.368 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-09-15T12:15:48.368 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libasan8-14.2.1-1.2.el9.x86_64 4/9 2024-09-15T12:15:48.368 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 5/9 2024-09-15T12:15:48.368 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-09-15T12:15:48.368 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 7/9 2024-09-15T12:15:48.368 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-09-15T12:15:48.756 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-09-15T12:15:48.756 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:15:48.756 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-15T12:15:48.756 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-test-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:48.756 INFO:teuthology.orchestra.run.smithi138.stdout: libasan8-14.2.1-1.2.el9.x86_64 2024-09-15T12:15:48.756 INFO:teuthology.orchestra.run.smithi138.stdout: libcephsqlite-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:15:48.756 INFO:teuthology.orchestra.run.smithi138.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-15T12:15:48.757 INFO:teuthology.orchestra.run.smithi138.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-15T12:15:48.757 INFO:teuthology.orchestra.run.smithi138.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-15T12:15:48.757 INFO:teuthology.orchestra.run.smithi138.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-15T12:15:48.757 INFO:teuthology.orchestra.run.smithi138.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-15T12:15:48.757 INFO:teuthology.orchestra.run.smithi138.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-15T12:15:48.757 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:15:48.757 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-15T12:15:49.097 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph 2024-09-15T12:15:49.676 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:01:13 ago on Sun 15 Sep 2024 12:14:36 PM UTC. 2024-09-15T12:15:49.819 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-15T12:15:49.821 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:15:49.821 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-09-15T12:15:49.821 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:15:49.821 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-15T12:15:49.821 INFO:teuthology.orchestra.run.smithi138.stdout: ceph x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 6.5 k 2024-09-15T12:15:49.822 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-09-15T12:15:49.822 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mds x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 2.2 M 2024-09-15T12:15:49.822 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 1.6 M 2024-09-15T12:15:49.822 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 291 k 2024-09-15T12:15:49.822 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mon x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 5.1 M 2024-09-15T12:15:49.822 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-osd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 70 M 2024-09-15T12:15:49.822 INFO:teuthology.orchestra.run.smithi138.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-15T12:15:49.822 INFO:teuthology.orchestra.run.smithi138.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-15T12:15:49.822 INFO:teuthology.orchestra.run.smithi138.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-15T12:15:49.822 INFO:teuthology.orchestra.run.smithi138.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-15T12:15:49.822 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-15T12:15:49.822 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-15T12:15:49.822 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-15T12:15:49.823 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-15T12:15:49.823 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-15T12:15:49.823 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-15T12:15:49.823 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-collections 2024-09-15T12:15:49.823 INFO:teuthology.orchestra.run.smithi138.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-15T12:15:49.823 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-15T12:15:49.823 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-15T12:15:49.823 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-15T12:15:49.823 INFO:teuthology.orchestra.run.smithi138.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-15T12:15:49.823 INFO:teuthology.orchestra.run.smithi138.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-15T12:15:49.823 INFO:teuthology.orchestra.run.smithi138.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-15T12:15:49.823 INFO:teuthology.orchestra.run.smithi138.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-15T12:15:49.823 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-15T12:15:49.823 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-15T12:15:49.824 INFO:teuthology.orchestra.run.smithi138.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-15T12:15:49.824 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-15T12:15:49.824 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-15T12:15:49.824 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-15T12:15:49.824 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-15T12:15:49.824 INFO:teuthology.orchestra.run.smithi138.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-15T12:15:49.824 INFO:teuthology.orchestra.run.smithi138.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-15T12:15:49.824 INFO:teuthology.orchestra.run.smithi138.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-15T12:15:49.824 INFO:teuthology.orchestra.run.smithi138.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-15T12:15:49.824 INFO:teuthology.orchestra.run.smithi138.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-15T12:15:49.824 INFO:teuthology.orchestra.run.smithi138.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-15T12:15:49.824 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:15:49.824 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-15T12:15:49.825 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:15:49.825 INFO:teuthology.orchestra.run.smithi138.stdout:Install 37 Packages 2024-09-15T12:15:49.825 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:15:49.825 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 84 M 2024-09-15T12:15:49.825 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 897 M 2024-09-15T12:15:49.825 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-15T12:15:50.385 INFO:teuthology.orchestra.run.smithi138.stdout:(1/37): ceph-19.3.0-4879.g81fedcb3.el9.x86_64.r 32 kB/s | 6.5 kB 00:00 2024-09-15T12:15:51.410 INFO:teuthology.orchestra.run.smithi138.stdout:(2/37): ceph-mgr-19.3.0-4879.g81fedcb3.el9.x86_ 1.3 MB/s | 1.6 MB 00:01 2024-09-15T12:15:51.644 INFO:teuthology.orchestra.run.smithi138.stdout:(3/37): ceph-mds-19.3.0-4879.g81fedcb3.el9.x86_ 1.5 MB/s | 2.2 MB 00:01 2024-09-15T12:15:51.810 INFO:teuthology.orchestra.run.smithi138.stdout:(4/37): ceph-mgr-modules-core-19.3.0-4879.g81fe 1.7 MB/s | 291 kB 00:00 2024-09-15T12:15:52.586 INFO:teuthology.orchestra.run.smithi138.stdout:(5/37): ceph-mon-19.3.0-4879.g81fedcb3.el9.x86_ 2.3 MB/s | 5.1 MB 00:02 2024-09-15T12:15:52.661 INFO:teuthology.orchestra.run.smithi138.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 298 kB/s | 253 kB 00:00 2024-09-15T12:15:53.320 INFO:teuthology.orchestra.run.smithi138.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 162 kB/s | 106 kB 00:00 2024-09-15T12:15:53.562 INFO:teuthology.orchestra.run.smithi138.stdout:(8/37): python3-cryptography-36.0.1-4.el9.x86_6 1.3 MB/s | 1.2 MB 00:00 2024-09-15T12:15:54.046 INFO:teuthology.orchestra.run.smithi138.stdout:(9/37): python3-pycparser-2.20-6.el9.noarch.rpm 186 kB/s | 135 kB 00:00 2024-09-15T12:15:54.254 INFO:teuthology.orchestra.run.smithi138.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 182 kB/s | 125 kB 00:00 2024-09-15T12:15:54.388 INFO:teuthology.orchestra.run.smithi138.stdout:(11/37): lua-5.4.4-4.el9.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2024-09-15T12:15:54.438 INFO:teuthology.orchestra.run.smithi138.stdout:(12/37): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-15T12:15:54.480 INFO:teuthology.orchestra.run.smithi138.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 831 kB/s | 35 kB 00:00 2024-09-15T12:15:54.522 INFO:teuthology.orchestra.run.smithi138.stdout:(14/37): python3-packaging-20.9-5.el9.noarch.rp 1.8 MB/s | 77 kB 00:00 2024-09-15T12:15:54.581 INFO:teuthology.orchestra.run.smithi138.stdout:(15/37): python3-pytz-2021.1-5.el9.noarch.rpm 872 kB/s | 51 kB 00:00 2024-09-15T12:15:54.623 INFO:teuthology.orchestra.run.smithi138.stdout:(16/37): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-15T12:15:54.682 INFO:teuthology.orchestra.run.smithi138.stdout:(17/37): lua-devel-5.4.4-4.el9.x86_64.rpm 382 kB/s | 22 kB 00:00 2024-09-15T12:15:54.724 INFO:teuthology.orchestra.run.smithi138.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-15T12:15:54.749 INFO:teuthology.orchestra.run.smithi138.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-09-15T12:15:54.774 INFO:teuthology.orchestra.run.smithi138.stdout:(20/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 6.8 MB/s | 172 kB 00:00 2024-09-15T12:15:54.808 INFO:teuthology.orchestra.run.smithi138.stdout:(21/37): python3-urllib3-1.26.5-6.el9.noarch.rp 282 kB/s | 215 kB 00:00 2024-09-15T12:15:54.842 INFO:teuthology.orchestra.run.smithi138.stdout:(22/37): python3-cherrypy-18.6.1-2.el9.noarch.r 5.2 MB/s | 358 kB 00:00 2024-09-15T12:15:54.867 INFO:teuthology.orchestra.run.smithi138.stdout:(23/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 182 kB/s | 11 kB 00:00 2024-09-15T12:15:54.892 INFO:teuthology.orchestra.run.smithi138.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 365 kB/s | 18 kB 00:00 2024-09-15T12:15:54.918 INFO:teuthology.orchestra.run.smithi138.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 937 kB/s | 23 kB 00:00 2024-09-15T12:15:54.943 INFO:teuthology.orchestra.run.smithi138.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 388 kB/s | 19 kB 00:00 2024-09-15T12:15:54.968 INFO:teuthology.orchestra.run.smithi138.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 390 kB/s | 20 kB 00:00 2024-09-15T12:15:54.994 INFO:teuthology.orchestra.run.smithi138.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 920 kB/s | 46 kB 00:00 2024-09-15T12:15:55.019 INFO:teuthology.orchestra.run.smithi138.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-15T12:15:55.045 INFO:teuthology.orchestra.run.smithi138.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 661 kB/s | 16 kB 00:00 2024-09-15T12:15:55.079 INFO:teuthology.orchestra.run.smithi138.stdout:(31/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.6 MB/s | 90 kB 00:00 2024-09-15T12:15:55.104 INFO:teuthology.orchestra.run.smithi138.stdout:(32/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-09-15T12:15:55.129 INFO:teuthology.orchestra.run.smithi138.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 711 kB/s | 36 kB 00:00 2024-09-15T12:15:55.155 INFO:teuthology.orchestra.run.smithi138.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-15T12:15:55.172 INFO:teuthology.orchestra.run.smithi138.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 1.2 MB/s | 20 kB 00:00 2024-09-15T12:15:55.197 INFO:teuthology.orchestra.run.smithi138.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 6.2 MB/s | 427 kB 00:00 2024-09-15T12:16:05.408 INFO:teuthology.orchestra.run.smithi077.stdout:(37/37): ceph-osd-19.3.0-4879.g81fedcb3.el9.x86 3.0 MB/s | 70 MB 00:23 2024-09-15T12:16:05.412 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:16:05.412 INFO:teuthology.orchestra.run.smithi077.stdout:Total 3.4 MB/s | 84 MB 00:24 2024-09-15T12:16:05.560 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-15T12:16:05.601 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-15T12:16:05.601 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-15T12:16:06.391 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-15T12:16:06.391 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-15T12:16:08.033 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-15T12:16:08.094 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-15T12:16:08.135 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-15T12:16:08.171 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-15T12:16:08.241 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-15T12:16:08.286 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-15T12:16:08.319 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-15T12:16:08.418 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-15T12:16:08.488 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-15T12:16:08.529 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-15T12:16:08.565 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-15T12:16:08.595 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-15T12:16:08.629 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-15T12:16:08.663 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-15T12:16:08.711 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-15T12:16:08.746 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-15T12:16:08.781 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-15T12:16:08.828 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-15T12:16:08.861 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-15T12:16:08.932 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-15T12:16:09.072 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-15T12:16:09.151 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-15T12:16:09.205 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-15T12:16:09.244 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-15T12:16:09.292 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-15T12:16:09.347 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-15T12:16:09.541 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-15T12:16:09.589 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-15T12:16:09.658 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-15T12:16:09.746 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-15T12:16:09.816 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-15T12:16:09.950 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-15T12:16:10.141 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 32/37 2024-09-15T12:16:10.166 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-15T12:16:10.192 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-15T12:16:10.192 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:16:10.192 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-15T12:16:10.192 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T12:16:10.192 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T12:16:10.193 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:16:15.762 INFO:teuthology.orchestra.run.smithi138.stdout:(37/37): ceph-osd-19.3.0-4879.g81fedcb3.el9.x86 2.9 MB/s | 70 MB 00:24 2024-09-15T12:16:15.767 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:16:15.767 INFO:teuthology.orchestra.run.smithi138.stdout:Total 3.2 MB/s | 84 MB 00:25 2024-09-15T12:16:15.912 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-15T12:16:15.953 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-15T12:16:15.953 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-15T12:16:16.730 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-15T12:16:16.731 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-15T12:16:18.372 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-15T12:16:18.481 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-15T12:16:18.522 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-15T12:16:18.553 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-15T12:16:18.621 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-15T12:16:18.657 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-15T12:16:18.691 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-15T12:16:18.791 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-15T12:16:18.877 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-15T12:16:18.925 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-15T12:16:18.961 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-15T12:16:18.990 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-15T12:16:19.025 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-15T12:16:19.058 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-15T12:16:19.099 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-15T12:16:19.135 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-15T12:16:19.169 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-15T12:16:19.217 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-15T12:16:19.249 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-15T12:16:19.322 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-15T12:16:19.460 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-15T12:16:19.558 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-15T12:16:19.620 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-15T12:16:19.659 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-15T12:16:19.708 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-15T12:16:19.763 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-15T12:16:19.957 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-15T12:16:20.014 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-15T12:16:20.091 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-15T12:16:20.181 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-15T12:16:20.226 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-15T12:16:20.357 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-15T12:16:20.543 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 32/37 2024-09-15T12:16:20.575 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-15T12:16:20.601 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 33/37 2024-09-15T12:16:20.601 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:16:20.601 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-15T12:16:20.601 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T12:16:20.601 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T12:16:20.601 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:16:20.750 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-15T12:16:20.778 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-15T12:16:20.779 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:16:20.779 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-15T12:16:20.779 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T12:16:20.779 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T12:16:20.779 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:16:21.318 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-15T12:16:21.342 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-15T12:16:21.342 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:16:21.342 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-15T12:16:21.342 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T12:16:21.342 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T12:16:21.342 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:16:21.577 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-15T12:16:21.613 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-15T12:16:21.614 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:16:21.614 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-15T12:16:21.614 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T12:16:21.614 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T12:16:21.614 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:16:21.666 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-15T12:16:28.152 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-15T12:16:28.153 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/37 2024-09-15T12:16:28.153 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/37 2024-09-15T12:16:28.153 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/37 2024-09-15T12:16:28.153 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/37 2024-09-15T12:16:28.153 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/37 2024-09-15T12:16:28.153 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 6/37 2024-09-15T12:16:28.153 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-15T12:16:28.153 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-15T12:16:28.153 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-15T12:16:28.153 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-15T12:16:28.153 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-15T12:16:28.154 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-15T12:16:28.154 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-15T12:16:28.154 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-15T12:16:28.154 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-15T12:16:28.154 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-15T12:16:28.154 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-15T12:16:28.154 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-15T12:16:28.154 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-15T12:16:28.154 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-15T12:16:28.154 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-15T12:16:28.154 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-15T12:16:28.155 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-15T12:16:28.155 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-15T12:16:28.155 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-15T12:16:28.155 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-15T12:16:28.155 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-15T12:16:28.155 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-15T12:16:28.155 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-15T12:16:28.155 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-15T12:16:28.155 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-15T12:16:28.155 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-15T12:16:28.155 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-15T12:16:28.155 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-15T12:16:28.156 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-15T12:16:28.156 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-15T12:16:29.223 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-15T12:16:29.223 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:16:29.223 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-15T12:16:29.224 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:29.224 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:29.224 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:29.224 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:16:29.224 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:29.224 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:29.224 INFO:teuthology.orchestra.run.smithi077.stdout: lua-5.4.4-4.el9.x86_64 2024-09-15T12:16:29.224 INFO:teuthology.orchestra.run.smithi077.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-15T12:16:29.224 INFO:teuthology.orchestra.run.smithi077.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-15T12:16:29.224 INFO:teuthology.orchestra.run.smithi077.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-15T12:16:29.224 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-15T12:16:29.224 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-15T12:16:29.225 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-15T12:16:29.225 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-15T12:16:29.225 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-15T12:16:29.225 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-15T12:16:29.225 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-15T12:16:29.225 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-15T12:16:29.225 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-15T12:16:29.225 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-15T12:16:29.225 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-15T12:16:29.225 INFO:teuthology.orchestra.run.smithi077.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-15T12:16:29.226 INFO:teuthology.orchestra.run.smithi077.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-15T12:16:29.226 INFO:teuthology.orchestra.run.smithi077.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-15T12:16:29.226 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-15T12:16:29.226 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ply-3.11-14.el9.noarch 2024-09-15T12:16:29.226 INFO:teuthology.orchestra.run.smithi077.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-15T12:16:29.226 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-15T12:16:29.226 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-15T12:16:29.226 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-15T12:16:29.226 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-15T12:16:29.226 INFO:teuthology.orchestra.run.smithi077.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-15T12:16:29.226 INFO:teuthology.orchestra.run.smithi077.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-15T12:16:29.226 INFO:teuthology.orchestra.run.smithi077.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-15T12:16:29.226 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-15T12:16:29.227 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-15T12:16:29.227 INFO:teuthology.orchestra.run.smithi077.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-15T12:16:29.227 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:16:29.227 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-15T12:16:29.508 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-base 2024-09-15T12:16:30.068 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:48 ago on Sun 15 Sep 2024 12:14:42 PM UTC. 2024-09-15T12:16:30.158 INFO:teuthology.orchestra.run.smithi077.stdout:Package ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:16:30.200 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-15T12:16:30.201 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-09-15T12:16:30.201 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-15T12:16:30.261 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install cephadm 2024-09-15T12:16:30.833 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:48 ago on Sun 15 Sep 2024 12:14:42 PM UTC. 2024-09-15T12:16:30.978 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-15T12:16:30.979 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:16:30.979 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-09-15T12:16:30.979 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:16:30.979 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-15T12:16:30.979 INFO:teuthology.orchestra.run.smithi077.stdout: cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 785 k 2024-09-15T12:16:30.979 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:16:30.979 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-15T12:16:30.980 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:16:30.980 INFO:teuthology.orchestra.run.smithi077.stdout:Install 1 Package 2024-09-15T12:16:30.980 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:16:30.980 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 785 k 2024-09-15T12:16:30.980 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 791 k 2024-09-15T12:16:30.980 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-15T12:16:31.092 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-15T12:16:31.118 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 34/37 2024-09-15T12:16:31.118 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:16:31.118 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-15T12:16:31.118 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T12:16:31.119 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T12:16:31.119 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:16:31.668 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-15T12:16:31.691 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 35/37 2024-09-15T12:16:31.691 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:16:31.691 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-15T12:16:31.691 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T12:16:31.691 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T12:16:31.691 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:16:31.927 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-15T12:16:31.950 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 36/37 2024-09-15T12:16:31.950 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:16:31.950 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-15T12:16:31.950 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T12:16:31.950 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T12:16:31.950 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:16:32.016 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-15T12:16:32.575 INFO:teuthology.orchestra.run.smithi077.stdout:cephadm-19.3.0-4879.g81fedcb3.el9.noarch.rpm 492 kB/s | 785 kB 00:01 2024-09-15T12:16:32.575 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:16:32.575 INFO:teuthology.orchestra.run.smithi077.stdout:Total 492 kB/s | 785 kB 00:01 2024-09-15T12:16:32.576 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-15T12:16:32.582 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-15T12:16:32.582 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-15T12:16:32.588 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-15T12:16:32.589 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-15T12:16:32.662 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-15T12:16:33.049 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:16:33.137 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:16:33.493 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:16:33.746 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:16:33.746 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:16:33.746 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-15T12:16:33.746 INFO:teuthology.orchestra.run.smithi077.stdout: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:16:33.746 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:16:33.746 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-15T12:16:33.935 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-immutable-object-cache 2024-09-15T12:16:34.513 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:52 ago on Sun 15 Sep 2024 12:14:42 PM UTC. 2024-09-15T12:16:34.650 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-15T12:16:34.651 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:16:34.651 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repo Size 2024-09-15T12:16:34.651 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:16:34.651 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-15T12:16:34.652 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 158 k 2024-09-15T12:16:34.652 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:16:34.652 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-15T12:16:34.652 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:16:34.652 INFO:teuthology.orchestra.run.smithi077.stdout:Install 1 Package 2024-09-15T12:16:34.652 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:16:34.652 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 158 k 2024-09-15T12:16:34.652 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 644 k 2024-09-15T12:16:34.652 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-15T12:16:35.307 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-immutable-object-cache-19.3.0-4879.g81fedc 241 kB/s | 158 kB 00:00 2024-09-15T12:16:35.308 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:16:35.308 INFO:teuthology.orchestra.run.smithi077.stdout:Total 241 kB/s | 158 kB 00:00 2024-09-15T12:16:35.308 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-15T12:16:35.318 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-15T12:16:35.318 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-15T12:16:35.375 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-15T12:16:35.376 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-15T12:16:35.522 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-15T12:16:35.583 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-15T12:16:35.608 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-15T12:16:35.608 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:16:35.608 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-15T12:16:35.608 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:16:36.503 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-15T12:16:36.503 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:16:36.503 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-15T12:16:36.503 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:36.503 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:16:36.504 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-15T12:16:36.702 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-mgr 2024-09-15T12:16:37.275 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:55 ago on Sun 15 Sep 2024 12:14:42 PM UTC. 2024-09-15T12:16:37.365 INFO:teuthology.orchestra.run.smithi077.stdout:Package ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:16:37.406 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-15T12:16:37.407 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-09-15T12:16:37.407 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-15T12:16:37.470 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-mgr-dashboard 2024-09-15T12:16:38.028 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:56 ago on Sun 15 Sep 2024 12:14:42 PM UTC. 2024-09-15T12:16:38.160 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-15T12:16:38.161 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:16:38.161 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-09-15T12:16:38.161 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:16:38.161 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-15T12:16:38.161 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 14 M 2024-09-15T12:16:38.161 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-09-15T12:16:38.161 INFO:teuthology.orchestra.run.smithi077.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-15T12:16:38.161 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 34 k 2024-09-15T12:16:38.162 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 16 k 2024-09-15T12:16:38.162 INFO:teuthology.orchestra.run.smithi077.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-15T12:16:38.162 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-15T12:16:38.162 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-15T12:16:38.162 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-15T12:16:38.162 INFO:teuthology.orchestra.run.smithi077.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-15T12:16:38.162 INFO:teuthology.orchestra.run.smithi077.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-15T12:16:38.162 INFO:teuthology.orchestra.run.smithi077.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-15T12:16:38.162 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:16:38.162 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-15T12:16:38.162 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:16:38.162 INFO:teuthology.orchestra.run.smithi077.stdout:Install 11 Packages 2024-09-15T12:16:38.162 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:16:38.163 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 18 M 2024-09-15T12:16:38.163 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 155 M 2024-09-15T12:16:38.163 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-15T12:16:38.914 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 37/37 2024-09-15T12:16:38.914 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/37 2024-09-15T12:16:38.914 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/37 2024-09-15T12:16:38.914 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 3/37 2024-09-15T12:16:38.914 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 4/37 2024-09-15T12:16:38.914 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 5/37 2024-09-15T12:16:38.914 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9. 6/37 2024-09-15T12:16:38.914 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-15T12:16:38.914 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-15T12:16:38.914 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-15T12:16:38.914 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-15T12:16:38.914 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-15T12:16:38.915 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-15T12:16:38.915 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-15T12:16:38.915 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-15T12:16:38.915 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-15T12:16:38.915 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-15T12:16:38.915 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-15T12:16:38.915 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-15T12:16:38.915 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-15T12:16:38.915 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-15T12:16:38.915 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-15T12:16:38.915 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-15T12:16:38.915 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-15T12:16:38.915 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-15T12:16:38.915 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-15T12:16:38.915 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-15T12:16:38.916 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-15T12:16:38.916 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-15T12:16:38.916 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-15T12:16:38.916 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-15T12:16:38.917 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-15T12:16:38.917 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-15T12:16:38.917 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-15T12:16:38.917 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-15T12:16:38.917 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-15T12:16:38.917 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-15T12:16:39.135 INFO:teuthology.orchestra.run.smithi077.stdout:(1/11): ceph-grafana-dashboards-19.3.0-4879.g81 80 kB/s | 34 kB 00:00 2024-09-15T12:16:39.151 INFO:teuthology.orchestra.run.smithi077.stdout:(2/11): ceph-prometheus-alerts-19.3.0-4879.g81f 37 kB/s | 16 kB 00:00 2024-09-15T12:16:39.369 INFO:teuthology.orchestra.run.smithi077.stdout:(3/11): protobuf-compiler-3.14.0-13.el9.x86_64. 3.9 MB/s | 863 kB 00:00 2024-09-15T12:16:39.427 INFO:teuthology.orchestra.run.smithi077.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 9.2 MB/s | 548 kB 00:00 2024-09-15T12:16:39.444 INFO:teuthology.orchestra.run.smithi077.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-15T12:16:39.519 INFO:teuthology.orchestra.run.smithi077.stdout:(6/11): python3-grpcio-1.46.7-10.el9.x86_64.rpm 27 MB/s | 2.0 MB 00:00 2024-09-15T12:16:39.545 INFO:teuthology.orchestra.run.smithi077.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.7 MB/s | 144 kB 00:00 2024-09-15T12:16:39.562 INFO:teuthology.orchestra.run.smithi077.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.8 MB/s | 31 kB 00:00 2024-09-15T12:16:39.587 INFO:teuthology.orchestra.run.smithi077.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 7.4 MB/s | 188 kB 00:00 2024-09-15T12:16:39.712 INFO:teuthology.orchestra.run.smithi077.stdout:(10/11): python3-protobuf-3.14.0-13.el9.noarch. 467 kB/s | 269 kB 00:00 2024-09-15T12:16:39.718 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-15T12:16:39.718 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:16:39.718 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-15T12:16:39.718 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:39.718 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mds-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:39.718 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:39.718 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-modules-core-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:16:39.718 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mon-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:39.718 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-osd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:39.719 INFO:teuthology.orchestra.run.smithi138.stdout: lua-5.4.4-4.el9.x86_64 2024-09-15T12:16:39.719 INFO:teuthology.orchestra.run.smithi138.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-15T12:16:39.719 INFO:teuthology.orchestra.run.smithi138.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-15T12:16:39.719 INFO:teuthology.orchestra.run.smithi138.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-15T12:16:39.719 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-15T12:16:39.719 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-15T12:16:39.719 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-15T12:16:39.719 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-15T12:16:39.719 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-15T12:16:39.719 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-15T12:16:39.719 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-15T12:16:39.719 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-15T12:16:39.720 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-15T12:16:39.720 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-15T12:16:39.720 INFO:teuthology.orchestra.run.smithi138.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-15T12:16:39.720 INFO:teuthology.orchestra.run.smithi138.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-15T12:16:39.720 INFO:teuthology.orchestra.run.smithi138.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-15T12:16:39.720 INFO:teuthology.orchestra.run.smithi138.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-15T12:16:39.720 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-15T12:16:39.720 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ply-3.11-14.el9.noarch 2024-09-15T12:16:39.720 INFO:teuthology.orchestra.run.smithi138.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-15T12:16:39.720 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-15T12:16:39.720 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-15T12:16:39.721 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-15T12:16:39.721 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-15T12:16:39.721 INFO:teuthology.orchestra.run.smithi138.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-15T12:16:39.721 INFO:teuthology.orchestra.run.smithi138.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-15T12:16:39.721 INFO:teuthology.orchestra.run.smithi138.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-15T12:16:39.721 INFO:teuthology.orchestra.run.smithi138.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-15T12:16:39.721 INFO:teuthology.orchestra.run.smithi138.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-15T12:16:39.721 INFO:teuthology.orchestra.run.smithi138.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-15T12:16:39.721 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:16:39.721 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-15T12:16:40.011 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-base 2024-09-15T12:16:40.575 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:04 ago on Sun 15 Sep 2024 12:14:36 PM UTC. 2024-09-15T12:16:40.665 INFO:teuthology.orchestra.run.smithi138.stdout:Package ceph-base-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:16:40.707 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-15T12:16:40.708 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-09-15T12:16:40.708 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-15T12:16:40.792 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install cephadm 2024-09-15T12:16:41.350 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:05 ago on Sun 15 Sep 2024 12:14:36 PM UTC. 2024-09-15T12:16:41.483 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-15T12:16:41.484 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:16:41.484 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-09-15T12:16:41.484 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:16:41.485 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-15T12:16:41.485 INFO:teuthology.orchestra.run.smithi138.stdout: cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 785 k 2024-09-15T12:16:41.485 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:16:41.485 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-15T12:16:41.485 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:16:41.485 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-09-15T12:16:41.485 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:16:41.485 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 785 k 2024-09-15T12:16:41.485 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 791 k 2024-09-15T12:16:41.485 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-15T12:16:42.688 INFO:teuthology.orchestra.run.smithi138.stdout:cephadm-19.3.0-4879.g81fedcb3.el9.noarch.rpm 652 kB/s | 785 kB 00:01 2024-09-15T12:16:42.689 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:16:42.689 INFO:teuthology.orchestra.run.smithi138.stdout:Total 651 kB/s | 785 kB 00:01 2024-09-15T12:16:42.689 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-15T12:16:42.695 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-15T12:16:42.695 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-15T12:16:42.701 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-15T12:16:42.701 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-15T12:16:42.774 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-15T12:16:43.193 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:16:43.276 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:16:43.688 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:16:43.974 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:16:43.974 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:16:43.974 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-15T12:16:43.975 INFO:teuthology.orchestra.run.smithi138.stdout: cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:16:43.975 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:16:43.975 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-15T12:16:44.195 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-immutable-object-cache 2024-09-15T12:16:44.769 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:08 ago on Sun 15 Sep 2024 12:14:36 PM UTC. 2024-09-15T12:16:44.904 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-15T12:16:44.905 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:16:44.905 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repo Size 2024-09-15T12:16:44.905 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:16:44.905 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-15T12:16:44.905 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 158 k 2024-09-15T12:16:44.905 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:16:44.905 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-15T12:16:44.906 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:16:44.906 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-09-15T12:16:44.906 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:16:44.906 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 158 k 2024-09-15T12:16:44.906 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 644 k 2024-09-15T12:16:44.906 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-15T12:16:45.581 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-immutable-object-cache-19.3.0-4879.g81fedc 234 kB/s | 158 kB 00:00 2024-09-15T12:16:45.582 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:16:45.582 INFO:teuthology.orchestra.run.smithi138.stdout:Total 233 kB/s | 158 kB 00:00 2024-09-15T12:16:45.582 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-15T12:16:45.592 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-15T12:16:45.592 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-15T12:16:45.650 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-15T12:16:45.650 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-15T12:16:45.811 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-15T12:16:45.907 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-15T12:16:45.932 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-15T12:16:45.932 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:16:45.932 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-15T12:16:45.932 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:16:46.875 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3. 1/1 2024-09-15T12:16:46.875 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:16:46.875 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-15T12:16:46.875 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-immutable-object-cache-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:16:46.875 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:16:46.875 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-15T12:16:47.103 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr 2024-09-15T12:16:47.677 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:11 ago on Sun 15 Sep 2024 12:14:36 PM UTC. 2024-09-15T12:16:47.771 INFO:teuthology.orchestra.run.smithi138.stdout:Package ceph-mgr-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:16:47.815 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-15T12:16:47.816 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-09-15T12:16:47.816 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-15T12:16:47.889 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr-dashboard 2024-09-15T12:16:48.455 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:12 ago on Sun 15 Sep 2024 12:14:36 PM UTC. 2024-09-15T12:16:48.589 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-15T12:16:48.590 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:16:48.590 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-09-15T12:16:48.590 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:16:48.590 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-15T12:16:48.590 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 14 M 2024-09-15T12:16:48.590 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-09-15T12:16:48.590 INFO:teuthology.orchestra.run.smithi138.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-15T12:16:48.590 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 34 k 2024-09-15T12:16:48.590 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 16 k 2024-09-15T12:16:48.590 INFO:teuthology.orchestra.run.smithi138.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-15T12:16:48.590 INFO:teuthology.orchestra.run.smithi138.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-15T12:16:48.591 INFO:teuthology.orchestra.run.smithi138.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-15T12:16:48.591 INFO:teuthology.orchestra.run.smithi138.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-15T12:16:48.591 INFO:teuthology.orchestra.run.smithi138.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-15T12:16:48.591 INFO:teuthology.orchestra.run.smithi138.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-15T12:16:48.591 INFO:teuthology.orchestra.run.smithi138.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-15T12:16:48.591 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:16:48.591 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-15T12:16:48.591 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:16:48.591 INFO:teuthology.orchestra.run.smithi138.stdout:Install 11 Packages 2024-09-15T12:16:48.591 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:16:48.592 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 18 M 2024-09-15T12:16:48.592 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 155 M 2024-09-15T12:16:48.592 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-15T12:16:49.563 INFO:teuthology.orchestra.run.smithi138.stdout:(1/11): ceph-grafana-dashboards-19.3.0-4879.g81 78 kB/s | 34 kB 00:00 2024-09-15T12:16:49.589 INFO:teuthology.orchestra.run.smithi138.stdout:(2/11): ceph-prometheus-alerts-19.3.0-4879.g81f 35 kB/s | 16 kB 00:00 2024-09-15T12:16:49.706 INFO:teuthology.orchestra.run.smithi138.stdout:(3/11): python3-protobuf-3.14.0-13.el9.noarch.r 1.9 MB/s | 269 kB 00:00 2024-09-15T12:16:49.773 INFO:teuthology.orchestra.run.smithi138.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 8.0 MB/s | 548 kB 00:00 2024-09-15T12:16:49.798 INFO:teuthology.orchestra.run.smithi138.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 774 kB/s | 19 kB 00:00 2024-09-15T12:16:49.907 INFO:teuthology.orchestra.run.smithi138.stdout:(6/11): python3-grpcio-1.46.7-10.el9.x86_64.rpm 19 MB/s | 2.0 MB 00:00 2024-09-15T12:16:49.940 INFO:teuthology.orchestra.run.smithi138.stdout:(7/11): protobuf-compiler-3.14.0-13.el9.x86_64. 2.4 MB/s | 863 kB 00:00 2024-09-15T12:16:49.974 INFO:teuthology.orchestra.run.smithi138.stdout:(8/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.1 MB/s | 144 kB 00:00 2024-09-15T12:16:49.999 INFO:teuthology.orchestra.run.smithi138.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 8.0 MB/s | 188 kB 00:00 2024-09-15T12:16:50.025 INFO:teuthology.orchestra.run.smithi138.stdout:(10/11): python3-repoze-lru-0.7-16.el9.noarch.r 366 kB/s | 31 kB 00:00 2024-09-15T12:16:50.753 INFO:teuthology.orchestra.run.smithi077.stdout:(11/11): ceph-mgr-dashboard-19.3.0-4879.g81fedc 1.2 MB/s | 14 MB 00:12 2024-09-15T12:16:50.757 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:16:50.757 INFO:teuthology.orchestra.run.smithi077.stdout:Total 1.4 MB/s | 18 MB 00:12 2024-09-15T12:16:50.790 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-15T12:16:50.812 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-15T12:16:50.812 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-15T12:16:51.084 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-15T12:16:51.084 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-15T12:16:51.625 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-15T12:16:51.701 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-15T12:16:51.731 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-15T12:16:51.821 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-15T12:16:51.948 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-15T12:16:52.001 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-15T12:16:52.085 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-15T12:16:52.128 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-15T12:16:52.156 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-15T12:16:52.188 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 9/11 2024-09-15T12:16:55.378 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 10/11 2024-09-15T12:16:55.434 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-15T12:16:57.232 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-15T12:16:57.232 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 1/11 2024-09-15T12:16:57.232 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 2/11 2024-09-15T12:16:57.232 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 3/11 2024-09-15T12:16:57.233 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-15T12:16:57.233 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-15T12:16:57.233 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-15T12:16:57.233 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-15T12:16:57.233 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-15T12:16:57.233 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-15T12:16:57.233 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-15T12:16:57.535 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-15T12:16:57.535 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:16:57.535 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-15T12:16:57.535 INFO:teuthology.orchestra.run.smithi077.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-15T12:16:57.535 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:16:57.535 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:16:57.535 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:16:57.535 INFO:teuthology.orchestra.run.smithi077.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-15T12:16:57.535 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-15T12:16:57.535 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-15T12:16:57.536 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-15T12:16:57.536 INFO:teuthology.orchestra.run.smithi077.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-15T12:16:57.536 INFO:teuthology.orchestra.run.smithi077.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-15T12:16:57.536 INFO:teuthology.orchestra.run.smithi077.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-15T12:16:57.536 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:16:57.536 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-15T12:16:57.774 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-15T12:16:58.337 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:02:16 ago on Sun 15 Sep 2024 12:14:42 PM UTC. 2024-09-15T12:16:58.471 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-15T12:16:58.472 INFO:teuthology.orchestra.run.smithi077.stdout:======================================================================================= 2024-09-15T12:16:58.472 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-09-15T12:16:58.472 INFO:teuthology.orchestra.run.smithi077.stdout:======================================================================================= 2024-09-15T12:16:58.472 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-15T12:16:58.472 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 7.4 M 2024-09-15T12:16:58.472 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-09-15T12:16:58.472 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-15T12:16:58.472 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-15T12:16:58.472 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-15T12:16:58.472 INFO:teuthology.orchestra.run.smithi077.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-15T12:16:58.473 INFO:teuthology.orchestra.run.smithi077.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-15T12:16:58.473 INFO:teuthology.orchestra.run.smithi077.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-15T12:16:58.473 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-15T12:16:58.473 INFO:teuthology.orchestra.run.smithi077.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-15T12:16:58.473 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-15T12:16:58.473 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-15T12:16:58.473 INFO:teuthology.orchestra.run.smithi077.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-15T12:16:58.473 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:16:58.473 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-15T12:16:58.473 INFO:teuthology.orchestra.run.smithi077.stdout:======================================================================================= 2024-09-15T12:16:58.473 INFO:teuthology.orchestra.run.smithi077.stdout:Install 12 Packages 2024-09-15T12:16:58.473 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:16:58.474 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 38 M 2024-09-15T12:16:58.474 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 212 M 2024-09-15T12:16:58.474 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-15T12:16:58.641 INFO:teuthology.orchestra.run.smithi077.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-15T12:16:58.725 INFO:teuthology.orchestra.run.smithi077.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 3.7 MB/s | 801 kB 00:00 2024-09-15T12:16:58.750 INFO:teuthology.orchestra.run.smithi077.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-09-15T12:16:58.792 INFO:teuthology.orchestra.run.smithi077.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 440 kB/s | 18 kB 00:00 2024-09-15T12:16:58.834 INFO:teuthology.orchestra.run.smithi077.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 922 kB/s | 38 kB 00:00 2024-09-15T12:16:58.959 INFO:teuthology.orchestra.run.smithi077.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 13 MB/s | 3.0 MB 00:00 2024-09-15T12:16:59.001 INFO:teuthology.orchestra.run.smithi077.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 5.8 MB/s | 245 kB 00:00 2024-09-15T12:16:59.076 INFO:teuthology.orchestra.run.smithi077.stdout:(8/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 20 MB/s | 4.9 MB 00:00 2024-09-15T12:16:59.118 INFO:teuthology.orchestra.run.smithi077.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 5.9 MB/s | 250 kB 00:00 2024-09-15T12:16:59.194 INFO:teuthology.orchestra.run.smithi077.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 27 MB/s | 5.1 MB 00:00 2024-09-15T12:16:59.444 INFO:teuthology.orchestra.run.smithi077.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 50 MB/s | 16 MB 00:00 2024-09-15T12:17:01.374 INFO:teuthology.orchestra.run.smithi138.stdout:(11/11): ceph-mgr-dashboard-19.3.0-4879.g81fedc 1.2 MB/s | 14 MB 00:12 2024-09-15T12:17:01.378 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:17:01.378 INFO:teuthology.orchestra.run.smithi138.stdout:Total 1.4 MB/s | 18 MB 00:12 2024-09-15T12:17:01.409 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-15T12:17:01.430 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-15T12:17:01.431 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-15T12:17:01.688 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-15T12:17:01.689 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-15T12:17:02.241 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-15T12:17:02.330 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-15T12:17:02.361 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-15T12:17:02.448 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-15T12:17:02.578 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-15T12:17:02.632 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-15T12:17:02.724 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-15T12:17:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-15T12:17:02.830 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-15T12:17:02.862 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 9/11 2024-09-15T12:17:06.031 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 10/11 2024-09-15T12:17:06.094 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-15T12:17:08.146 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 11/11 2024-09-15T12:17:08.146 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el 1/11 2024-09-15T12:17:08.146 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noa 2/11 2024-09-15T12:17:08.146 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9 3/11 2024-09-15T12:17:08.146 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-15T12:17:08.146 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-15T12:17:08.146 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-15T12:17:08.146 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-15T12:17:08.146 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-15T12:17:08.146 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-15T12:17:08.147 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-15T12:17:08.480 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-15T12:17:08.481 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:08.481 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-15T12:17:08.481 INFO:teuthology.orchestra.run.smithi138.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-15T12:17:08.481 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-grafana-dashboards-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:17:08.481 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-dashboard-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:17:08.481 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-prometheus-alerts-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:17:08.481 INFO:teuthology.orchestra.run.smithi138.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-15T12:17:08.481 INFO:teuthology.orchestra.run.smithi138.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-15T12:17:08.481 INFO:teuthology.orchestra.run.smithi138.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-15T12:17:08.481 INFO:teuthology.orchestra.run.smithi138.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-15T12:17:08.481 INFO:teuthology.orchestra.run.smithi138.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-15T12:17:08.481 INFO:teuthology.orchestra.run.smithi138.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-15T12:17:08.482 INFO:teuthology.orchestra.run.smithi138.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-15T12:17:08.482 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:08.482 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-15T12:17:08.752 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-15T12:17:09.314 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:33 ago on Sun 15 Sep 2024 12:14:36 PM UTC. 2024-09-15T12:17:09.447 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-15T12:17:09.448 INFO:teuthology.orchestra.run.smithi138.stdout:======================================================================================= 2024-09-15T12:17:09.448 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-09-15T12:17:09.448 INFO:teuthology.orchestra.run.smithi138.stdout:======================================================================================= 2024-09-15T12:17:09.448 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-15T12:17:09.448 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 7.4 M 2024-09-15T12:17:09.448 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-09-15T12:17:09.448 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-15T12:17:09.449 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-15T12:17:09.449 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-15T12:17:09.449 INFO:teuthology.orchestra.run.smithi138.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-15T12:17:09.449 INFO:teuthology.orchestra.run.smithi138.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-15T12:17:09.449 INFO:teuthology.orchestra.run.smithi138.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-15T12:17:09.449 INFO:teuthology.orchestra.run.smithi138.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-15T12:17:09.449 INFO:teuthology.orchestra.run.smithi138.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-15T12:17:09.449 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-15T12:17:09.449 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-15T12:17:09.449 INFO:teuthology.orchestra.run.smithi138.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-15T12:17:09.449 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:09.449 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-15T12:17:09.449 INFO:teuthology.orchestra.run.smithi138.stdout:======================================================================================= 2024-09-15T12:17:09.449 INFO:teuthology.orchestra.run.smithi138.stdout:Install 12 Packages 2024-09-15T12:17:09.450 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:09.450 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 38 M 2024-09-15T12:17:09.450 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 212 M 2024-09-15T12:17:09.450 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-15T12:17:10.046 INFO:teuthology.orchestra.run.smithi138.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 345 kB/s | 191 kB 00:00 2024-09-15T12:17:10.162 INFO:teuthology.orchestra.run.smithi138.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 280 kB/s | 33 kB 00:00 2024-09-15T12:17:10.313 INFO:teuthology.orchestra.run.smithi138.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 976 kB/s | 801 kB 00:00 2024-09-15T12:17:10.422 INFO:teuthology.orchestra.run.smithi138.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 168 kB/s | 18 kB 00:00 2024-09-15T12:17:10.530 INFO:teuthology.orchestra.run.smithi138.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 355 kB/s | 38 kB 00:00 2024-09-15T12:17:10.672 INFO:teuthology.orchestra.run.smithi138.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 5.9 MB/s | 3.0 MB 00:00 2024-09-15T12:17:10.798 INFO:teuthology.orchestra.run.smithi138.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-15T12:17:11.015 INFO:teuthology.orchestra.run.smithi138.stdout:(8/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 10 MB/s | 4.9 MB 00:00 2024-09-15T12:17:11.090 INFO:teuthology.orchestra.run.smithi138.stdout:(9/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 17 MB/s | 5.1 MB 00:00 2024-09-15T12:17:11.132 INFO:teuthology.orchestra.run.smithi138.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.1 MB/s | 250 kB 00:00 2024-09-15T12:17:11.908 INFO:teuthology.orchestra.run.smithi138.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-09-15T12:17:13.891 INFO:teuthology.orchestra.run.smithi138.stdout:(12/12): ceph-mgr-diskprediction-local-19.3.0-4 1.7 MB/s | 7.4 MB 00:04 2024-09-15T12:17:13.892 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:17:13.893 INFO:teuthology.orchestra.run.smithi138.stdout:Total 8.6 MB/s | 38 MB 00:04 2024-09-15T12:17:13.943 INFO:teuthology.orchestra.run.smithi077.stdout:(12/12): ceph-mgr-diskprediction-local-19.3.0-4 491 kB/s | 7.4 MB 00:15 2024-09-15T12:17:13.944 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:17:13.944 INFO:teuthology.orchestra.run.smithi077.stdout:Total 2.5 MB/s | 38 MB 00:15 2024-09-15T12:17:14.252 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-15T12:17:14.278 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-15T12:17:14.278 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-15T12:17:14.304 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-15T12:17:14.331 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-15T12:17:14.331 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-15T12:17:14.710 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-15T12:17:14.711 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-15T12:17:14.759 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-15T12:17:14.759 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-15T12:17:15.464 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-15T12:17:15.524 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-15T12:17:15.530 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-15T12:17:15.572 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-15T12:17:15.595 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-15T12:17:15.640 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-15T12:17:15.673 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-15T12:17:15.716 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-15T12:17:15.751 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-15T12:17:15.784 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-15T12:17:15.900 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-15T12:17:15.940 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-15T12:17:15.967 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-15T12:17:16.000 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-15T12:17:16.017 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-15T12:17:16.076 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-15T12:17:16.677 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-15T12:17:16.741 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-15T12:17:16.806 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-15T12:17:16.854 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-15T12:17:18.060 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-15T12:17:18.088 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-15T12:17:19.104 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-15T12:17:19.121 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-15T12:17:19.136 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-15T12:17:19.148 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-15T12:17:21.732 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-15T12:17:21.732 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 1/12 2024-09-15T12:17:21.732 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-15T12:17:21.732 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-15T12:17:21.732 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-15T12:17:21.732 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-15T12:17:21.732 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-15T12:17:21.732 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-15T12:17:21.732 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-15T12:17:21.733 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-15T12:17:21.733 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-15T12:17:21.733 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-15T12:17:21.839 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 12/12 2024-09-15T12:17:21.839 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fed 1/12 2024-09-15T12:17:21.839 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-15T12:17:21.839 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-15T12:17:21.839 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-15T12:17:21.839 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-15T12:17:21.839 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-15T12:17:21.839 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-15T12:17:21.839 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-15T12:17:21.839 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-15T12:17:21.839 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-15T12:17:21.839 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-15T12:17:22.152 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-15T12:17:22.153 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:22.153 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-15T12:17:22.153 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:17:22.153 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-15T12:17:22.153 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-15T12:17:22.153 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-15T12:17:22.153 INFO:teuthology.orchestra.run.smithi077.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-15T12:17:22.153 INFO:teuthology.orchestra.run.smithi077.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-15T12:17:22.153 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-15T12:17:22.153 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-15T12:17:22.153 INFO:teuthology.orchestra.run.smithi077.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-15T12:17:22.154 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-15T12:17:22.154 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-15T12:17:22.154 INFO:teuthology.orchestra.run.smithi077.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-15T12:17:22.154 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:22.154 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-15T12:17:22.288 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-15T12:17:22.288 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:22.288 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-15T12:17:22.289 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:17:22.289 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-15T12:17:22.289 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-15T12:17:22.289 INFO:teuthology.orchestra.run.smithi138.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-15T12:17:22.289 INFO:teuthology.orchestra.run.smithi138.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-15T12:17:22.289 INFO:teuthology.orchestra.run.smithi138.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-15T12:17:22.289 INFO:teuthology.orchestra.run.smithi138.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-15T12:17:22.289 INFO:teuthology.orchestra.run.smithi138.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-15T12:17:22.289 INFO:teuthology.orchestra.run.smithi138.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-15T12:17:22.289 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-15T12:17:22.289 INFO:teuthology.orchestra.run.smithi138.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-15T12:17:22.289 INFO:teuthology.orchestra.run.smithi138.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-15T12:17:22.289 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:22.290 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-15T12:17:22.512 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-mgr-rook 2024-09-15T12:17:22.691 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr-rook 2024-09-15T12:17:23.089 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:02:41 ago on Sun 15 Sep 2024 12:14:42 PM UTC. 2024-09-15T12:17:23.224 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-15T12:17:23.225 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:17:23.225 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-09-15T12:17:23.225 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:17:23.225 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-15T12:17:23.225 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-rook noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 49 k 2024-09-15T12:17:23.225 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-09-15T12:17:23.225 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-15T12:17:23.225 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-15T12:17:23.225 INFO:teuthology.orchestra.run.smithi077.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-15T12:17:23.225 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-15T12:17:23.226 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-15T12:17:23.226 INFO:teuthology.orchestra.run.smithi077.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-15T12:17:23.226 INFO:teuthology.orchestra.run.smithi077.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-15T12:17:23.226 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-15T12:17:23.226 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-15T12:17:23.226 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-15T12:17:23.226 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-15T12:17:23.226 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-15T12:17:23.226 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:23.226 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-15T12:17:23.226 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:17:23.226 INFO:teuthology.orchestra.run.smithi077.stdout:Install 13 Packages 2024-09-15T12:17:23.226 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:23.227 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 2.2 M 2024-09-15T12:17:23.227 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 26 M 2024-09-15T12:17:23.227 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-15T12:17:23.269 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:47 ago on Sun 15 Sep 2024 12:14:36 PM UTC. 2024-09-15T12:17:23.403 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-15T12:17:23.404 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:17:23.404 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-09-15T12:17:23.404 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:17:23.404 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-15T12:17:23.405 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-rook noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 49 k 2024-09-15T12:17:23.405 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-09-15T12:17:23.405 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-15T12:17:23.405 INFO:teuthology.orchestra.run.smithi138.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-15T12:17:23.405 INFO:teuthology.orchestra.run.smithi138.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-15T12:17:23.405 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-15T12:17:23.405 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-15T12:17:23.405 INFO:teuthology.orchestra.run.smithi138.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-15T12:17:23.405 INFO:teuthology.orchestra.run.smithi138.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-15T12:17:23.405 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-15T12:17:23.405 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-15T12:17:23.405 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-15T12:17:23.406 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-15T12:17:23.406 INFO:teuthology.orchestra.run.smithi138.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-15T12:17:23.406 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:23.406 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-15T12:17:23.406 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:17:23.406 INFO:teuthology.orchestra.run.smithi138.stdout:Install 13 Packages 2024-09-15T12:17:23.406 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:23.406 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 2.2 M 2024-09-15T12:17:23.407 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 26 M 2024-09-15T12:17:23.407 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-15T12:17:23.515 INFO:teuthology.orchestra.run.smithi077.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 215 kB/s | 26 kB 00:00 2024-09-15T12:17:23.540 INFO:teuthology.orchestra.run.smithi077.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 133 kB/s | 19 kB 00:00 2024-09-15T12:17:23.682 INFO:teuthology.orchestra.run.smithi077.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-09-15T12:17:23.707 INFO:teuthology.orchestra.run.smithi077.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.3 MB/s | 222 kB 00:00 2024-09-15T12:17:23.757 INFO:teuthology.orchestra.run.smithi077.stdout:(5/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-15T12:17:23.791 INFO:teuthology.orchestra.run.smithi077.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.5 MB/s | 279 kB 00:00 2024-09-15T12:17:23.824 INFO:teuthology.orchestra.run.smithi077.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 482 kB/s | 32 kB 00:00 2024-09-15T12:17:23.833 INFO:teuthology.orchestra.run.smithi138.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 219 kB/s | 26 kB 00:00 2024-09-15T12:17:23.849 INFO:teuthology.orchestra.run.smithi077.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 247 kB/s | 14 kB 00:00 2024-09-15T12:17:23.858 INFO:teuthology.orchestra.run.smithi138.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 135 kB/s | 19 kB 00:00 2024-09-15T12:17:23.875 INFO:teuthology.orchestra.run.smithi077.stdout:(9/13): ceph-mgr-rook-19.3.0-4879.g81fedcb3.el9 103 kB/s | 49 kB 00:00 2024-09-15T12:17:23.908 INFO:teuthology.orchestra.run.smithi077.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.6 MB/s | 220 kB 00:00 2024-09-15T12:17:23.936 INFO:teuthology.orchestra.run.smithi077.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.8 MB/s | 90 kB 00:00 2024-09-15T12:17:23.959 INFO:teuthology.orchestra.run.smithi077.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 706 kB/s | 59 kB 00:00 2024-09-15T12:17:23.966 INFO:teuthology.orchestra.run.smithi138.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-15T12:17:23.992 INFO:teuthology.orchestra.run.smithi138.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.4 MB/s | 222 kB 00:00 2024-09-15T12:17:23.992 INFO:teuthology.orchestra.run.smithi077.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-09-15T12:17:23.995 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:17:23.996 INFO:teuthology.orchestra.run.smithi077.stdout:Total 2.9 MB/s | 2.2 MB 00:00 2024-09-15T12:17:24.042 INFO:teuthology.orchestra.run.smithi138.stdout:(5/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-15T12:17:24.060 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-15T12:17:24.068 INFO:teuthology.orchestra.run.smithi138.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.7 MB/s | 279 kB 00:00 2024-09-15T12:17:24.075 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-15T12:17:24.075 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-15T12:17:24.110 INFO:teuthology.orchestra.run.smithi138.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 481 kB/s | 32 kB 00:00 2024-09-15T12:17:24.135 INFO:teuthology.orchestra.run.smithi138.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 210 kB/s | 14 kB 00:00 2024-09-15T12:17:24.160 INFO:teuthology.orchestra.run.smithi138.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 4.4 MB/s | 220 kB 00:00 2024-09-15T12:17:24.164 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-15T12:17:24.165 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-15T12:17:24.194 INFO:teuthology.orchestra.run.smithi138.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-09-15T12:17:24.219 INFO:teuthology.orchestra.run.smithi138.stdout:(11/13): ceph-mgr-rook-19.3.0-4879.g81fedcb3.el 98 kB/s | 49 kB 00:00 2024-09-15T12:17:24.245 INFO:teuthology.orchestra.run.smithi138.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-09-15T12:17:24.278 INFO:teuthology.orchestra.run.smithi138.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-09-15T12:17:24.281 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:17:24.281 INFO:teuthology.orchestra.run.smithi138.stdout:Total 2.5 MB/s | 2.2 MB 00:00 2024-09-15T12:17:24.345 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-15T12:17:24.359 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-15T12:17:24.359 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-15T12:17:24.447 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-15T12:17:24.447 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-15T12:17:24.669 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-15T12:17:24.839 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-15T12:17:24.894 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-15T12:17:24.949 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-15T12:17:24.957 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-15T12:17:24.994 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-15T12:17:25.036 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-15T12:17:25.117 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-15T12:17:25.137 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-15T12:17:25.180 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-15T12:17:25.235 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-15T12:17:25.239 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-15T12:17:25.273 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-15T12:17:25.287 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-15T12:17:25.314 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-15T12:17:25.416 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-15T12:17:25.518 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-15T12:17:25.575 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-15T12:17:25.997 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-15T12:17:26.043 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-15T12:17:26.077 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-15T12:17:26.125 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-15T12:17:26.146 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-15T12:17:26.285 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-15T12:17:26.324 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-15T12:17:26.357 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-15T12:17:26.406 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-15T12:17:26.428 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-15T12:17:26.988 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-15T12:17:26.988 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 1/13 2024-09-15T12:17:26.988 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-15T12:17:26.988 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-15T12:17:26.989 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-15T12:17:26.989 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-15T12:17:26.989 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-15T12:17:26.989 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-15T12:17:26.989 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-15T12:17:26.989 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-15T12:17:26.989 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-15T12:17:26.989 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-15T12:17:26.989 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-15T12:17:27.224 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 13/13 2024-09-15T12:17:27.224 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 1/13 2024-09-15T12:17:27.225 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-15T12:17:27.225 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-15T12:17:27.225 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-15T12:17:27.225 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-15T12:17:27.225 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-15T12:17:27.225 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-15T12:17:27.225 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-15T12:17:27.225 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-15T12:17:27.225 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-15T12:17:27.225 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-15T12:17:27.225 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-15T12:17:27.332 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-15T12:17:27.333 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:27.333 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-15T12:17:27.333 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:17:27.333 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-15T12:17:27.333 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-15T12:17:27.333 INFO:teuthology.orchestra.run.smithi077.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-15T12:17:27.333 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-15T12:17:27.333 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-15T12:17:27.333 INFO:teuthology.orchestra.run.smithi077.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-15T12:17:27.333 INFO:teuthology.orchestra.run.smithi077.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-15T12:17:27.333 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-15T12:17:27.333 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-15T12:17:27.333 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-15T12:17:27.334 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-15T12:17:27.334 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-15T12:17:27.334 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:27.334 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-15T12:17:27.567 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-15T12:17:27.567 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:27.567 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-15T12:17:27.567 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-rook-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:17:27.567 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-15T12:17:27.567 INFO:teuthology.orchestra.run.smithi138.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-15T12:17:27.567 INFO:teuthology.orchestra.run.smithi138.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-15T12:17:27.568 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-15T12:17:27.568 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-15T12:17:27.568 INFO:teuthology.orchestra.run.smithi138.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-15T12:17:27.568 INFO:teuthology.orchestra.run.smithi138.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-15T12:17:27.568 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-15T12:17:27.568 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-15T12:17:27.568 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-15T12:17:27.568 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-15T12:17:27.568 INFO:teuthology.orchestra.run.smithi138.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-15T12:17:27.568 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:27.568 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-15T12:17:27.599 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-mgr-cephadm 2024-09-15T12:17:27.840 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-mgr-cephadm 2024-09-15T12:17:28.169 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:02:46 ago on Sun 15 Sep 2024 12:14:42 PM UTC. 2024-09-15T12:17:28.303 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-15T12:17:28.304 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:17:28.304 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-09-15T12:17:28.304 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:17:28.304 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-15T12:17:28.304 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 154 k 2024-09-15T12:17:28.304 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-09-15T12:17:28.304 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-15T12:17:28.304 INFO:teuthology.orchestra.run.smithi077.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-15T12:17:28.304 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-15T12:17:28.304 INFO:teuthology.orchestra.run.smithi077.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-15T12:17:28.305 INFO:teuthology.orchestra.run.smithi077.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-15T12:17:28.305 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:28.305 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-15T12:17:28.305 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:17:28.305 INFO:teuthology.orchestra.run.smithi077.stdout:Install 6 Packages 2024-09-15T12:17:28.305 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:28.305 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 7.0 M 2024-09-15T12:17:28.305 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 33 M 2024-09-15T12:17:28.306 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-15T12:17:28.407 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:52 ago on Sun 15 Sep 2024 12:14:36 PM UTC. 2024-09-15T12:17:28.542 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-15T12:17:28.542 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:17:28.543 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-09-15T12:17:28.543 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:17:28.543 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-15T12:17:28.543 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 154 k 2024-09-15T12:17:28.543 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-09-15T12:17:28.543 INFO:teuthology.orchestra.run.smithi138.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-15T12:17:28.543 INFO:teuthology.orchestra.run.smithi138.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-15T12:17:28.543 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-15T12:17:28.543 INFO:teuthology.orchestra.run.smithi138.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-15T12:17:28.543 INFO:teuthology.orchestra.run.smithi138.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-15T12:17:28.543 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:28.543 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-15T12:17:28.543 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:17:28.544 INFO:teuthology.orchestra.run.smithi138.stdout:Install 6 Packages 2024-09-15T12:17:28.544 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:28.544 INFO:teuthology.orchestra.run.smithi077.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.8 MB/s | 248 kB 00:00 2024-09-15T12:17:28.545 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 7.0 M 2024-09-15T12:17:28.545 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 33 M 2024-09-15T12:17:28.545 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-15T12:17:28.594 INFO:teuthology.orchestra.run.smithi077.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-15T12:17:28.619 INFO:teuthology.orchestra.run.smithi077.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-15T12:17:28.645 INFO:teuthology.orchestra.run.smithi077.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-15T12:17:29.278 INFO:teuthology.orchestra.run.smithi077.stdout:(5/6): ceph-mgr-cephadm-19.3.0-4879.g81fedcb3.e 178 kB/s | 154 kB 00:00 2024-09-15T12:17:29.327 INFO:teuthology.orchestra.run.smithi138.stdout:(1/6): ceph-mgr-cephadm-19.3.0-4879.g81fedcb3.e 228 kB/s | 154 kB 00:00 2024-09-15T12:17:29.377 INFO:teuthology.orchestra.run.smithi138.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-15T12:17:29.417 INFO:teuthology.orchestra.run.smithi138.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.4 MB/s | 58 kB 00:00 2024-09-15T12:17:29.444 INFO:teuthology.orchestra.run.smithi138.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.7 MB/s | 74 kB 00:00 2024-09-15T12:17:29.469 INFO:teuthology.orchestra.run.smithi138.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 303 kB/s | 248 kB 00:00 2024-09-15T12:17:29.920 INFO:teuthology.orchestra.run.smithi138.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.7 MB/s | 6.0 MB 00:01 2024-09-15T12:17:29.922 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:17:29.922 INFO:teuthology.orchestra.run.smithi138.stdout:Total 5.1 MB/s | 7.0 MB 00:01 2024-09-15T12:17:29.986 INFO:teuthology.orchestra.run.smithi077.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 3.8 MB/s | 6.0 MB 00:01 2024-09-15T12:17:29.988 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:17:29.989 INFO:teuthology.orchestra.run.smithi077.stdout:Total 4.2 MB/s | 7.0 MB 00:01 2024-09-15T12:17:29.993 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-15T12:17:30.004 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-15T12:17:30.004 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-15T12:17:30.062 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-15T12:17:30.074 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-15T12:17:30.074 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-15T12:17:30.104 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-15T12:17:30.105 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-15T12:17:30.176 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-15T12:17:30.177 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-15T12:17:30.412 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-15T12:17:30.481 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-15T12:17:30.580 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-15T12:17:30.639 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-15T12:17:30.650 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-15T12:17:30.696 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-15T12:17:31.187 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-15T12:17:31.209 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-15T12:17:31.277 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-15T12:17:31.299 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-15T12:17:31.344 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-15T12:17:31.366 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-15T12:17:31.369 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-15T12:17:31.392 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-15T12:17:32.247 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-15T12:17:32.247 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/6 2024-09-15T12:17:32.247 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-15T12:17:32.247 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-15T12:17:32.247 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-15T12:17:32.247 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-15T12:17:32.297 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 6/6 2024-09-15T12:17:32.297 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 1/6 2024-09-15T12:17:32.297 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-15T12:17:32.298 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-15T12:17:32.298 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-15T12:17:32.298 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-15T12:17:32.517 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-15T12:17:32.518 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:32.518 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-15T12:17:32.518 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:17:32.518 INFO:teuthology.orchestra.run.smithi138.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-15T12:17:32.518 INFO:teuthology.orchestra.run.smithi138.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-15T12:17:32.518 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-15T12:17:32.518 INFO:teuthology.orchestra.run.smithi138.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-15T12:17:32.518 INFO:teuthology.orchestra.run.smithi138.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-15T12:17:32.518 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:32.518 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-15T12:17:32.573 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-15T12:17:32.573 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:32.573 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-15T12:17:32.573 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-cephadm-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:17:32.574 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-15T12:17:32.574 INFO:teuthology.orchestra.run.smithi077.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-15T12:17:32.574 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-15T12:17:32.574 INFO:teuthology.orchestra.run.smithi077.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-15T12:17:32.574 INFO:teuthology.orchestra.run.smithi077.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-15T12:17:32.574 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:32.574 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-15T12:17:32.796 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-fuse 2024-09-15T12:17:32.861 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-fuse 2024-09-15T12:17:33.361 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:02:57 ago on Sun 15 Sep 2024 12:14:36 PM UTC. 2024-09-15T12:17:33.424 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:02:51 ago on Sun 15 Sep 2024 12:14:42 PM UTC. 2024-09-15T12:17:33.495 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-15T12:17:33.495 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:17:33.495 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-09-15T12:17:33.495 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:17:33.495 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-15T12:17:33.495 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 884 k 2024-09-15T12:17:33.495 INFO:teuthology.orchestra.run.smithi138.stdout:Installing dependencies: 2024-09-15T12:17:33.495 INFO:teuthology.orchestra.run.smithi138.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-15T12:17:33.496 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:33.496 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-15T12:17:33.496 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:17:33.496 INFO:teuthology.orchestra.run.smithi138.stdout:Install 2 Packages 2024-09-15T12:17:33.496 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:33.496 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 964 k 2024-09-15T12:17:33.496 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 4.1 M 2024-09-15T12:17:33.496 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-15T12:17:33.557 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-15T12:17:33.558 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:17:33.558 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-09-15T12:17:33.558 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:17:33.558 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-15T12:17:33.558 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 884 k 2024-09-15T12:17:33.558 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-09-15T12:17:33.558 INFO:teuthology.orchestra.run.smithi077.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-15T12:17:33.558 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:33.558 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-15T12:17:33.558 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:17:33.558 INFO:teuthology.orchestra.run.smithi077.stdout:Install 2 Packages 2024-09-15T12:17:33.558 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:33.559 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 964 k 2024-09-15T12:17:33.559 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 4.1 M 2024-09-15T12:17:33.559 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-15T12:17:33.705 INFO:teuthology.orchestra.run.smithi077.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 637 kB/s | 80 kB 00:00 2024-09-15T12:17:34.216 INFO:teuthology.orchestra.run.smithi138.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 114 kB/s | 80 kB 00:00 2024-09-15T12:17:34.433 INFO:teuthology.orchestra.run.smithi138.stdout:(2/2): ceph-fuse-19.3.0-4879.g81fedcb3.el9.x86_ 965 kB/s | 884 kB 00:00 2024-09-15T12:17:34.434 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:17:34.434 INFO:teuthology.orchestra.run.smithi138.stdout:Total 1.0 MB/s | 964 kB 00:00 2024-09-15T12:17:34.446 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-15T12:17:34.470 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-15T12:17:34.470 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-15T12:17:34.552 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-15T12:17:34.553 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-15T12:17:34.741 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-15T12:17:34.813 INFO:teuthology.orchestra.run.smithi077.stdout:(2/2): ceph-fuse-19.3.0-4879.g81fedcb3.el9.x86_ 717 kB/s | 884 kB 00:01 2024-09-15T12:17:34.814 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:17:34.814 INFO:teuthology.orchestra.run.smithi077.stdout:Total 767 kB/s | 964 kB 00:01 2024-09-15T12:17:34.828 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-15T12:17:34.854 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-15T12:17:34.854 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-15T12:17:34.895 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-15T12:17:34.939 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-15T12:17:34.939 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-15T12:17:34.959 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-15T12:17:35.123 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-15T12:17:35.275 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-15T12:17:35.345 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-15T12:17:35.597 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-15T12:17:35.598 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/2 2024-09-15T12:17:35.883 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-15T12:17:35.883 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:35.883 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-15T12:17:35.883 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-15T12:17:35.883 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:35.884 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-15T12:17:36.069 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2/2 2024-09-15T12:17:36.070 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/2 2024-09-15T12:17:36.193 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install ceph-volume 2024-09-15T12:17:36.341 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-15T12:17:36.341 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:36.341 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-15T12:17:36.341 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-15T12:17:36.341 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:36.341 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-15T12:17:36.662 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-volume 2024-09-15T12:17:36.770 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:03:00 ago on Sun 15 Sep 2024 12:14:36 PM UTC. 2024-09-15T12:17:36.905 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-15T12:17:36.906 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:17:36.906 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repository Size 2024-09-15T12:17:36.906 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:17:36.906 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-15T12:17:36.906 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-volume noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 285 k 2024-09-15T12:17:36.906 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:36.906 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-15T12:17:36.906 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:17:36.906 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-09-15T12:17:36.906 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:36.906 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 285 k 2024-09-15T12:17:36.907 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 1.3 M 2024-09-15T12:17:36.907 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-15T12:17:37.251 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:02:55 ago on Sun 15 Sep 2024 12:14:42 PM UTC. 2024-09-15T12:17:37.387 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-15T12:17:37.388 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:17:37.388 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-09-15T12:17:37.388 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:17:37.388 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-15T12:17:37.388 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-volume noarch 2:19.3.0-4879.g81fedcb3.el9 ceph-noarch 285 k 2024-09-15T12:17:37.388 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:37.388 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-15T12:17:37.388 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:17:37.389 INFO:teuthology.orchestra.run.smithi077.stdout:Install 1 Package 2024-09-15T12:17:37.389 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:37.389 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 285 k 2024-09-15T12:17:37.389 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 1.3 M 2024-09-15T12:17:37.389 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-15T12:17:37.667 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-volume-19.3.0-4879.g81fedcb3.el9.noarch.rp 375 kB/s | 285 kB 00:00 2024-09-15T12:17:37.667 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:17:37.668 INFO:teuthology.orchestra.run.smithi138.stdout:Total 374 kB/s | 285 kB 00:00 2024-09-15T12:17:37.668 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-15T12:17:37.677 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-15T12:17:37.677 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-15T12:17:37.708 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-15T12:17:37.708 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-15T12:17:37.925 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-15T12:17:38.002 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:17:38.020 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:17:38.020 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:17:38.020 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-15T12:17:38.020 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:38.451 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-volume-19.3.0-4879.g81fedcb3.el9.noarch.rp 268 kB/s | 285 kB 00:01 2024-09-15T12:17:38.451 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:17:38.452 INFO:teuthology.orchestra.run.smithi077.stdout:Total 268 kB/s | 285 kB 00:01 2024-09-15T12:17:38.452 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-15T12:17:38.460 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-15T12:17:38.460 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-15T12:17:38.492 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-15T12:17:38.492 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-15T12:17:38.708 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-15T12:17:38.770 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:17:38.786 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:17:38.786 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:17:38.786 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-15T12:17:38.786 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:39.093 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:17:39.093 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:39.093 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-15T12:17:39.094 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:17:39.094 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:39.094 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-15T12:17:39.382 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install librados-devel 2024-09-15T12:17:39.788 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 1/1 2024-09-15T12:17:39.789 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:39.789 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-15T12:17:39.789 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-volume-2:19.3.0-4879.g81fedcb3.el9.noarch 2024-09-15T12:17:39.789 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:39.789 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-15T12:17:39.959 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:03:03 ago on Sun 15 Sep 2024 12:14:36 PM UTC. 2024-09-15T12:17:40.103 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-15T12:17:40.104 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:17:40.104 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repo Size 2024-09-15T12:17:40.104 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:17:40.104 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-15T12:17:40.104 INFO:teuthology.orchestra.run.smithi138.stdout: librados-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 125 k 2024-09-15T12:17:40.104 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:40.104 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-15T12:17:40.105 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:17:40.105 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-09-15T12:17:40.105 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:40.105 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 125 k 2024-09-15T12:17:40.105 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 445 k 2024-09-15T12:17:40.105 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-15T12:17:40.106 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install librados-devel 2024-09-15T12:17:40.687 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:02:58 ago on Sun 15 Sep 2024 12:14:42 PM UTC. 2024-09-15T12:17:40.701 INFO:teuthology.orchestra.run.smithi138.stdout:librados-devel-19.3.0-4879.g81fedcb3.el9.x86_64 209 kB/s | 125 kB 00:00 2024-09-15T12:17:40.701 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:17:40.702 INFO:teuthology.orchestra.run.smithi138.stdout:Total 209 kB/s | 125 kB 00:00 2024-09-15T12:17:40.702 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-15T12:17:40.708 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-15T12:17:40.708 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-15T12:17:40.772 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-15T12:17:40.773 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-15T12:17:40.823 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-15T12:17:40.823 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:17:40.823 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repo Size 2024-09-15T12:17:40.823 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:17:40.823 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-15T12:17:40.823 INFO:teuthology.orchestra.run.smithi077.stdout: librados-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 125 k 2024-09-15T12:17:40.824 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:40.824 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-15T12:17:40.824 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:17:40.824 INFO:teuthology.orchestra.run.smithi077.stdout:Install 1 Package 2024-09-15T12:17:40.824 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:40.824 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 125 k 2024-09-15T12:17:40.824 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 445 k 2024-09-15T12:17:40.824 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-15T12:17:40.938 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-15T12:17:41.050 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:17:41.414 INFO:teuthology.orchestra.run.smithi077.stdout:librados-devel-19.3.0-4879.g81fedcb3.el9.x86_64 211 kB/s | 125 kB 00:00 2024-09-15T12:17:41.415 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:17:41.415 INFO:teuthology.orchestra.run.smithi077.stdout:Total 211 kB/s | 125 kB 00:00 2024-09-15T12:17:41.415 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-15T12:17:41.421 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-15T12:17:41.421 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-15T12:17:41.485 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-15T12:17:41.486 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-15T12:17:41.496 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:17:41.647 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-15T12:17:41.745 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:17:41.806 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:17:41.806 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:41.806 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-15T12:17:41.806 INFO:teuthology.orchestra.run.smithi138.stdout: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:17:41.806 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:41.806 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-15T12:17:42.065 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install libcephfs2 2024-09-15T12:17:42.179 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:17:42.438 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:17:42.438 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:42.438 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-15T12:17:42.438 INFO:teuthology.orchestra.run.smithi077.stdout: librados-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:17:42.438 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:42.439 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-15T12:17:42.644 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:03:06 ago on Sun 15 Sep 2024 12:14:36 PM UTC. 2024-09-15T12:17:42.680 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install libcephfs2 2024-09-15T12:17:42.736 INFO:teuthology.orchestra.run.smithi138.stdout:Package libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:17:42.781 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-15T12:17:42.782 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-09-15T12:17:42.783 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-15T12:17:42.856 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install libcephfs-devel 2024-09-15T12:17:43.259 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:03:01 ago on Sun 15 Sep 2024 12:14:42 PM UTC. 2024-09-15T12:17:43.354 INFO:teuthology.orchestra.run.smithi077.stdout:Package libcephfs2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:17:43.399 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-15T12:17:43.400 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-09-15T12:17:43.400 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-15T12:17:43.424 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:03:07 ago on Sun 15 Sep 2024 12:14:36 PM UTC. 2024-09-15T12:17:43.471 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install libcephfs-devel 2024-09-15T12:17:43.558 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-15T12:17:43.558 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:17:43.558 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repo Size 2024-09-15T12:17:43.559 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:17:43.559 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-15T12:17:43.559 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 32 k 2024-09-15T12:17:43.559 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:43.559 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-15T12:17:43.559 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:17:43.559 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-09-15T12:17:43.559 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:43.559 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 32 k 2024-09-15T12:17:43.559 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 142 k 2024-09-15T12:17:43.559 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-15T12:17:43.999 INFO:teuthology.orchestra.run.smithi138.stdout:libcephfs-devel-19.3.0-4879.g81fedcb3.el9.x86_6 72 kB/s | 32 kB 00:00 2024-09-15T12:17:43.999 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:17:43.999 INFO:teuthology.orchestra.run.smithi138.stdout:Total 72 kB/s | 32 kB 00:00 2024-09-15T12:17:44.000 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-15T12:17:44.003 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-15T12:17:44.003 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-15T12:17:44.028 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-15T12:17:44.028 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-15T12:17:44.030 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:03:02 ago on Sun 15 Sep 2024 12:14:42 PM UTC. 2024-09-15T12:17:44.113 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-15T12:17:44.163 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-15T12:17:44.163 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:17:44.163 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repo Size 2024-09-15T12:17:44.163 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:17:44.163 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-15T12:17:44.163 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs-devel x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 32 k 2024-09-15T12:17:44.164 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:44.164 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-15T12:17:44.164 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:17:44.164 INFO:teuthology.orchestra.run.smithi077.stdout:Install 1 Package 2024-09-15T12:17:44.164 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:44.164 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 32 k 2024-09-15T12:17:44.164 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 142 k 2024-09-15T12:17:44.164 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-15T12:17:44.229 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:17:44.601 INFO:teuthology.orchestra.run.smithi077.stdout:libcephfs-devel-19.3.0-4879.g81fedcb3.el9.x86_6 73 kB/s | 32 kB 00:00 2024-09-15T12:17:44.602 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:17:44.602 INFO:teuthology.orchestra.run.smithi077.stdout:Total 72 kB/s | 32 kB 00:00 2024-09-15T12:17:44.602 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-15T12:17:44.605 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-15T12:17:44.605 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-15T12:17:44.620 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:17:44.623 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-15T12:17:44.624 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-15T12:17:44.702 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-15T12:17:44.814 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:17:44.880 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:17:44.880 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:44.880 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-15T12:17:44.880 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:17:44.880 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:44.881 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-15T12:17:45.090 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install librados2 2024-09-15T12:17:45.203 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:17:45.428 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:17:45.428 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:45.428 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-15T12:17:45.428 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs-devel-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:17:45.428 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:45.429 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-15T12:17:45.613 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install librados2 2024-09-15T12:17:45.665 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:03:09 ago on Sun 15 Sep 2024 12:14:36 PM UTC. 2024-09-15T12:17:45.755 INFO:teuthology.orchestra.run.smithi138.stdout:Package librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:17:45.799 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-15T12:17:45.800 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-09-15T12:17:45.800 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-15T12:17:45.873 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install librbd1 2024-09-15T12:17:46.175 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:03:04 ago on Sun 15 Sep 2024 12:14:42 PM UTC. 2024-09-15T12:17:46.264 INFO:teuthology.orchestra.run.smithi077.stdout:Package librados2-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:17:46.307 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-15T12:17:46.308 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-09-15T12:17:46.308 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-15T12:17:46.386 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install librbd1 2024-09-15T12:17:46.435 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:03:10 ago on Sun 15 Sep 2024 12:14:36 PM UTC. 2024-09-15T12:17:46.524 INFO:teuthology.orchestra.run.smithi138.stdout:Package librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:17:46.567 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-15T12:17:46.568 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-09-15T12:17:46.568 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-15T12:17:46.648 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install python3-rados 2024-09-15T12:17:46.946 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:03:04 ago on Sun 15 Sep 2024 12:14:42 PM UTC. 2024-09-15T12:17:47.036 INFO:teuthology.orchestra.run.smithi077.stdout:Package librbd1-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:17:47.079 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-15T12:17:47.081 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-09-15T12:17:47.081 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-15T12:17:47.150 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install python3-rados 2024-09-15T12:17:47.215 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:03:11 ago on Sun 15 Sep 2024 12:14:36 PM UTC. 2024-09-15T12:17:47.304 INFO:teuthology.orchestra.run.smithi138.stdout:Package python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:17:47.347 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-15T12:17:47.348 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-09-15T12:17:47.348 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-15T12:17:47.410 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install python3-rgw 2024-09-15T12:17:47.712 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:03:05 ago on Sun 15 Sep 2024 12:14:42 PM UTC. 2024-09-15T12:17:47.801 INFO:teuthology.orchestra.run.smithi077.stdout:Package python3-rados-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:17:47.844 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-15T12:17:47.846 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-09-15T12:17:47.846 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-15T12:17:47.916 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install python3-rgw 2024-09-15T12:17:47.969 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:03:11 ago on Sun 15 Sep 2024 12:14:36 PM UTC. 2024-09-15T12:17:48.058 INFO:teuthology.orchestra.run.smithi138.stdout:Package python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:17:48.101 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-15T12:17:48.102 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-09-15T12:17:48.103 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-15T12:17:48.174 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install python3-cephfs 2024-09-15T12:17:48.474 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:03:06 ago on Sun 15 Sep 2024 12:14:42 PM UTC. 2024-09-15T12:17:48.565 INFO:teuthology.orchestra.run.smithi077.stdout:Package python3-rgw-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:17:48.609 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-15T12:17:48.610 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-09-15T12:17:48.610 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-15T12:17:48.682 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install python3-cephfs 2024-09-15T12:17:48.742 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:03:12 ago on Sun 15 Sep 2024 12:14:36 PM UTC. 2024-09-15T12:17:48.837 INFO:teuthology.orchestra.run.smithi138.stdout:Package python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:17:48.881 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-15T12:17:48.882 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-09-15T12:17:48.882 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-15T12:17:48.954 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install python3-rbd 2024-09-15T12:17:49.248 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:03:07 ago on Sun 15 Sep 2024 12:14:42 PM UTC. 2024-09-15T12:17:49.338 INFO:teuthology.orchestra.run.smithi077.stdout:Package python3-cephfs-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:17:49.381 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-15T12:17:49.382 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-09-15T12:17:49.382 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-15T12:17:49.449 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install python3-rbd 2024-09-15T12:17:49.530 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:03:13 ago on Sun 15 Sep 2024 12:14:36 PM UTC. 2024-09-15T12:17:49.620 INFO:teuthology.orchestra.run.smithi138.stdout:Package python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:17:49.663 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-15T12:17:49.664 INFO:teuthology.orchestra.run.smithi138.stdout:Nothing to do. 2024-09-15T12:17:49.665 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-15T12:17:49.737 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install rbd-fuse 2024-09-15T12:17:50.015 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:03:08 ago on Sun 15 Sep 2024 12:14:42 PM UTC. 2024-09-15T12:17:50.104 INFO:teuthology.orchestra.run.smithi077.stdout:Package python3-rbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 is already installed. 2024-09-15T12:17:50.147 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-15T12:17:50.148 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-09-15T12:17:50.148 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-15T12:17:50.218 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install rbd-fuse 2024-09-15T12:17:50.297 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:03:14 ago on Sun 15 Sep 2024 12:14:36 PM UTC. 2024-09-15T12:17:50.431 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-15T12:17:50.432 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:17:50.432 INFO:teuthology.orchestra.run.smithi138.stdout: Package Architecture Version Repository Size 2024-09-15T12:17:50.432 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:17:50.432 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-15T12:17:50.432 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 91 k 2024-09-15T12:17:50.432 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:50.432 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-15T12:17:50.432 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:17:50.432 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-09-15T12:17:50.432 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:50.432 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 91 k 2024-09-15T12:17:50.433 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 321 k 2024-09-15T12:17:50.433 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-15T12:17:50.781 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:03:08 ago on Sun 15 Sep 2024 12:14:42 PM UTC. 2024-09-15T12:17:50.914 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-15T12:17:50.915 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:17:50.915 INFO:teuthology.orchestra.run.smithi077.stdout: Package Architecture Version Repository Size 2024-09-15T12:17:50.915 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:17:50.915 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-15T12:17:50.915 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-fuse x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 91 k 2024-09-15T12:17:50.915 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:50.915 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-15T12:17:50.916 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:17:50.916 INFO:teuthology.orchestra.run.smithi077.stdout:Install 1 Package 2024-09-15T12:17:50.916 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:50.916 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 91 k 2024-09-15T12:17:50.916 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 321 k 2024-09-15T12:17:50.916 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-15T12:17:51.369 INFO:teuthology.orchestra.run.smithi138.stdout:rbd-fuse-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 97 kB/s | 91 kB 00:00 2024-09-15T12:17:51.369 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:17:51.370 INFO:teuthology.orchestra.run.smithi138.stdout:Total 97 kB/s | 91 kB 00:00 2024-09-15T12:17:51.370 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-15T12:17:51.380 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-15T12:17:51.380 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-15T12:17:51.429 INFO:teuthology.orchestra.run.smithi077.stdout:rbd-fuse-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 177 kB/s | 91 kB 00:00 2024-09-15T12:17:51.429 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:17:51.430 INFO:teuthology.orchestra.run.smithi077.stdout:Total 177 kB/s | 91 kB 00:00 2024-09-15T12:17:51.430 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-15T12:17:51.439 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-15T12:17:51.439 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-15T12:17:51.446 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-15T12:17:51.447 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-15T12:17:51.504 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-15T12:17:51.504 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-15T12:17:51.602 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-15T12:17:51.650 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-15T12:17:51.708 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:17:51.752 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:17:52.116 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:17:52.145 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:17:52.397 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:17:52.398 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:52.398 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-15T12:17:52.398 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:17:52.398 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:52.398 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-15T12:17:52.411 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:17:52.411 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:52.411 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-15T12:17:52.411 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-fuse-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:17:52.412 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:52.412 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-15T12:17:52.705 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install rbd-mirror 2024-09-15T12:17:52.710 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install rbd-mirror 2024-09-15T12:17:53.279 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:03:11 ago on Sun 15 Sep 2024 12:14:42 PM UTC. 2024-09-15T12:17:53.282 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:03:17 ago on Sun 15 Sep 2024 12:14:36 PM UTC. 2024-09-15T12:17:53.416 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-15T12:17:53.417 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:17:53.417 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repo Size 2024-09-15T12:17:53.417 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:17:53.418 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-15T12:17:53.418 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-mirror x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-15T12:17:53.418 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:53.418 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-15T12:17:53.418 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:17:53.418 INFO:teuthology.orchestra.run.smithi077.stdout:Install 1 Package 2024-09-15T12:17:53.418 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:53.418 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 3.5 M 2024-09-15T12:17:53.418 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 30 M 2024-09-15T12:17:53.418 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-15T12:17:53.422 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-15T12:17:53.422 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:17:53.423 INFO:teuthology.orchestra.run.smithi138.stdout: Package Arch Version Repo Size 2024-09-15T12:17:53.423 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:17:53.423 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-15T12:17:53.423 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-mirror x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 3.5 M 2024-09-15T12:17:53.423 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:53.423 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-15T12:17:53.423 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:17:53.423 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-09-15T12:17:53.423 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:53.424 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 3.5 M 2024-09-15T12:17:53.424 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 30 M 2024-09-15T12:17:53.424 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-15T12:17:55.907 INFO:teuthology.orchestra.run.smithi077.stdout:rbd-mirror-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 1.4 MB/s | 3.5 MB 00:02 2024-09-15T12:17:55.908 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:17:55.908 INFO:teuthology.orchestra.run.smithi077.stdout:Total 1.4 MB/s | 3.5 MB 00:02 2024-09-15T12:17:55.908 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-15T12:17:55.922 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-15T12:17:55.922 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-15T12:17:56.009 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-15T12:17:56.009 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-15T12:17:56.238 INFO:teuthology.orchestra.run.smithi138.stdout:rbd-mirror-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 1.2 MB/s | 3.5 MB 00:02 2024-09-15T12:17:56.239 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:17:56.239 INFO:teuthology.orchestra.run.smithi138.stdout:Total 1.2 MB/s | 3.5 MB 00:02 2024-09-15T12:17:56.240 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-15T12:17:56.253 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-15T12:17:56.253 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-15T12:17:56.340 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-15T12:17:56.341 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-15T12:17:56.604 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-15T12:17:56.666 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:17:56.691 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:17:56.691 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:17:56.691 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-15T12:17:56.691 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T12:17:56.691 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T12:17:56.691 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:56.936 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-15T12:17:56.997 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:17:57.022 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:17:57.022 INFO:teuthology.orchestra.run.smithi138.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T12:17:57.022 INFO:teuthology.orchestra.run.smithi138.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-15T12:17:57.022 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T12:17:57.023 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T12:17:57.023 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:57.994 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:17:57.994 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:57.994 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-15T12:17:57.994 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:17:57.994 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:57.994 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-15T12:17:58.262 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install rbd-nbd 2024-09-15T12:17:58.298 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:17:58.298 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:58.298 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-15T12:17:58.298 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-mirror-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:17:58.298 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:58.298 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-15T12:17:58.568 DEBUG:teuthology.orchestra.run.smithi138:> sudo yum -y install rbd-nbd 2024-09-15T12:17:58.864 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:03:16 ago on Sun 15 Sep 2024 12:14:42 PM UTC. 2024-09-15T12:17:59.005 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-15T12:17:59.006 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:17:59.006 INFO:teuthology.orchestra.run.smithi077.stdout: Package Architecture Version Repository Size 2024-09-15T12:17:59.006 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:17:59.006 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-15T12:17:59.007 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-nbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 177 k 2024-09-15T12:17:59.007 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:59.007 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-15T12:17:59.007 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T12:17:59.007 INFO:teuthology.orchestra.run.smithi077.stdout:Install 1 Package 2024-09-15T12:17:59.007 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:17:59.007 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 177 k 2024-09-15T12:17:59.007 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 685 k 2024-09-15T12:17:59.007 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-15T12:17:59.146 INFO:teuthology.orchestra.run.smithi138.stdout:Last metadata expiration check: 0:03:23 ago on Sun 15 Sep 2024 12:14:36 PM UTC. 2024-09-15T12:17:59.285 INFO:teuthology.orchestra.run.smithi138.stdout:Dependencies resolved. 2024-09-15T12:17:59.285 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:17:59.285 INFO:teuthology.orchestra.run.smithi138.stdout: Package Architecture Version Repository Size 2024-09-15T12:17:59.285 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:17:59.285 INFO:teuthology.orchestra.run.smithi138.stdout:Installing: 2024-09-15T12:17:59.285 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-nbd x86_64 2:19.3.0-4879.g81fedcb3.el9 ceph 177 k 2024-09-15T12:17:59.285 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:59.285 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction Summary 2024-09-15T12:17:59.285 INFO:teuthology.orchestra.run.smithi138.stdout:================================================================================ 2024-09-15T12:17:59.285 INFO:teuthology.orchestra.run.smithi138.stdout:Install 1 Package 2024-09-15T12:17:59.285 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:17:59.286 INFO:teuthology.orchestra.run.smithi138.stdout:Total download size: 177 k 2024-09-15T12:17:59.286 INFO:teuthology.orchestra.run.smithi138.stdout:Installed size: 685 k 2024-09-15T12:17:59.286 INFO:teuthology.orchestra.run.smithi138.stdout:Downloading Packages: 2024-09-15T12:17:59.669 INFO:teuthology.orchestra.run.smithi077.stdout:rbd-nbd-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 267 kB/s | 177 kB 00:00 2024-09-15T12:17:59.670 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:17:59.670 INFO:teuthology.orchestra.run.smithi077.stdout:Total 266 kB/s | 177 kB 00:00 2024-09-15T12:17:59.670 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-15T12:17:59.680 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-15T12:17:59.680 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-15T12:17:59.750 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-15T12:17:59.750 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-15T12:17:59.923 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-15T12:18:00.017 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:18:00.251 INFO:teuthology.orchestra.run.smithi138.stdout:rbd-nbd-19.3.0-4879.g81fedcb3.el9.x86_64.rpm 183 kB/s | 177 kB 00:00 2024-09-15T12:18:00.251 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------------------- 2024-09-15T12:18:00.252 INFO:teuthology.orchestra.run.smithi138.stdout:Total 183 kB/s | 177 kB 00:00 2024-09-15T12:18:00.252 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction check 2024-09-15T12:18:00.263 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction check succeeded. 2024-09-15T12:18:00.263 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction test 2024-09-15T12:18:00.339 INFO:teuthology.orchestra.run.smithi138.stdout:Transaction test succeeded. 2024-09-15T12:18:00.339 INFO:teuthology.orchestra.run.smithi138.stdout:Running transaction 2024-09-15T12:18:00.444 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:18:00.505 INFO:teuthology.orchestra.run.smithi138.stdout: Preparing : 1/1 2024-09-15T12:18:00.607 INFO:teuthology.orchestra.run.smithi138.stdout: Installing : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:18:00.696 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:18:00.696 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:00.697 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-15T12:18:00.697 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:18:00.697 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:00.697 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-15T12:18:00.947 DEBUG:teuthology.parallel:result is None 2024-09-15T12:18:01.040 INFO:teuthology.orchestra.run.smithi138.stdout: Running scriptlet: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:18:01.312 INFO:teuthology.orchestra.run.smithi138.stdout: Verifying : rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 1/1 2024-09-15T12:18:01.312 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:18:01.312 INFO:teuthology.orchestra.run.smithi138.stdout:Installed: 2024-09-15T12:18:01.312 INFO:teuthology.orchestra.run.smithi138.stdout: rbd-nbd-2:19.3.0-4879.g81fedcb3.el9.x86_64 2024-09-15T12:18:01.312 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:18:01.313 INFO:teuthology.orchestra.run.smithi138.stdout:Complete! 2024-09-15T12:18:01.601 DEBUG:teuthology.parallel:result is None 2024-09-15T12:18:01.602 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-15T12:18:01.755 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-15T12:18:01.777 INFO:teuthology.orchestra.run.smithi077.stdout:19.3.0-4879.g81fedcb3.el9 2024-09-15T12:18:01.777 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4879.g81fedcb3.el9 2024-09-15T12:18:01.778 INFO:teuthology.task.install:The correct ceph version 19.3.0-4879.g81fedcb3 is installed. 2024-09-15T12:18:01.779 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=81fedcb3b484c843d22ffbc8d179cb567b7083b5 2024-09-15T12:18:01.918 DEBUG:teuthology.orchestra.run.smithi138:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-15T12:18:01.940 INFO:teuthology.orchestra.run.smithi138.stdout:19.3.0-4879.g81fedcb3.el9 2024-09-15T12:18:01.940 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4879.g81fedcb3.el9 2024-09-15T12:18:01.940 INFO:teuthology.task.install:The correct ceph version 19.3.0-4879.g81fedcb3 is installed. 2024-09-15T12:18:01.942 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-15T12:18:01.942 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T12:18:01.942 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T12:18:01.969 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-15T12:18:01.969 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T12:18:02.006 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-15T12:18:02.006 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T12:18:02.006 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T12:18:02.034 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T12:18:02.098 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-15T12:18:02.098 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T12:18:02.125 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T12:18:02.191 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-15T12:18:02.191 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T12:18:02.191 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T12:18:02.216 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T12:18:02.281 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-15T12:18:02.281 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T12:18:02.306 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T12:18:02.379 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-15T12:18:02.379 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T12:18:02.379 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T12:18:02.403 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T12:18:02.467 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-15T12:18:02.467 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T12:18:02.492 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T12:18:02.557 INFO:teuthology.run_tasks:Running task ceph... 2024-09-15T12:18:02.629 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-15T12:18:02.630 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 777 /var/log/ceph 2024-09-15T12:18:02.632 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 777 /var/log/ceph 2024-09-15T12:18:02.656 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-15T12:18:02.656 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-15T12:18:02.696 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-15T12:18:02.721 INFO:tasks.ceph:Creating extra log directories... 2024-09-15T12:18:02.721 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-15T12:18:02.761 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-15T12:18:02.793 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-15T12:18:02.793 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-15T12:18:02.794 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905530', 'branch': 'wip-matanb-crimson-testing-59543', 'description': 'crimson-rados/thrash_simple/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/simple thrashosds-health workloads/radosbench}', 'email': None, 'first_in_suite': False, 'job_id': '7905530', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-matanb-crimson-testing-59543'}, 'ceph': {'conf': {'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779'}}, 'owner': 'scheduled_matan@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 1236, 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779', 'targets': {'smithi077.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHK7A5WIs9hfm6Stwawjo7HbwGP68oDmNZi+xkdNAUjvrI5ceu8TwkHm1aXyo5vURYiTeZb04Z2W1FeW4WEfEfw=', 'smithi138.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKVy1a+7A5bOqmjMczvhz2VpSSjDw/a6hgTgV4qO45huIVuEzljfUiHtDlKO6MFZoD6wyM+FC1Dw3Y7ooEE3nzA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5', 'cluster': 'ceph'}}, {'thrashosds': {'ceph_objectstore_tool': False, 'chance_down': 0, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 3, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400}}, {'full_sequential': [{'radosbench': {'clients': ['client.0'], 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'time': 90}}, {'radosbench': {'clients': ['client.0'], 'time': 90}}]}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-15_11:59:21', 'tube': 'smithi', 'user': 'matan', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-15T12:18:02.794 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-15T12:18:02.825 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-15T12:18:02.842 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -d -m0777 -- /var/run/ceph 2024-09-15T12:18:02.881 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m0777 -- /var/run/ceph 2024-09-15T12:18:02.907 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T12:18:02.907 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T12:18:02.959 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T12:18:02.959 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_1 2024-09-15T12:18:03.014 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T12:18:03.015 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T12:18:03.015 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-15T12:18:03.015 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T12:18:03.015 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T12:18:03.015 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-09-15 12:17:56.936633778 +0000 2024-09-15T12:18:03.015 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-09-15 12:13:50.642464693 +0000 2024-09-15T12:18:03.015 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-09-15 12:13:50.642464693 +0000 2024-09-15T12:18:03.015 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-09-15 12:13:50.642464693 +0000 2024-09-15T12:18:03.015 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T12:18:03.078 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-09-15T12:18:03.078 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-09-15T12:18:03.078 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000184414 s, 2.8 MB/s 2024-09-15T12:18:03.079 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T12:18:03.135 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_2 2024-09-15T12:18:03.190 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T12:18:03.190 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T12:18:03.190 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-15T12:18:03.190 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T12:18:03.190 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T12:18:03.190 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-09-15 12:17:56.936633778 +0000 2024-09-15T12:18:03.190 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-09-15 12:13:50.981457214 +0000 2024-09-15T12:18:03.190 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-09-15 12:13:50.981457214 +0000 2024-09-15T12:18:03.191 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-09-15 12:13:50.981457214 +0000 2024-09-15T12:18:03.191 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T12:18:03.253 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-09-15T12:18:03.253 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-09-15T12:18:03.253 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000213001 s, 2.4 MB/s 2024-09-15T12:18:03.254 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T12:18:03.311 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_3 2024-09-15T12:18:03.366 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T12:18:03.366 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T12:18:03.366 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-15T12:18:03.366 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T12:18:03.366 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T12:18:03.366 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-09-15 12:17:56.936633778 +0000 2024-09-15T12:18:03.366 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-09-15 12:13:51.320449736 +0000 2024-09-15T12:18:03.367 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-09-15 12:13:51.320449736 +0000 2024-09-15T12:18:03.367 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-09-15 12:13:51.320449736 +0000 2024-09-15T12:18:03.367 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T12:18:03.429 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-09-15T12:18:03.429 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-09-15T12:18:03.429 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.00020107 s, 2.5 MB/s 2024-09-15T12:18:03.430 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T12:18:03.486 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_4 2024-09-15T12:18:03.541 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T12:18:03.541 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T12:18:03.541 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-15T12:18:03.541 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T12:18:03.541 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T12:18:03.541 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-09-15 12:17:56.937633756 +0000 2024-09-15T12:18:03.541 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-09-15 12:13:51.648442499 +0000 2024-09-15T12:18:03.541 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-09-15 12:13:51.648442499 +0000 2024-09-15T12:18:03.542 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-09-15 12:13:51.648442499 +0000 2024-09-15T12:18:03.542 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T12:18:03.604 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-09-15T12:18:03.604 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-09-15T12:18:03.604 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000170724 s, 3.0 MB/s 2024-09-15T12:18:03.605 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T12:18:03.661 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-15T12:18:03.661 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-15T12:18:03.661 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T12:18:03.679 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T12:18:03.679 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_1 2024-09-15T12:18:03.736 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T12:18:03.736 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T12:18:03.736 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-15T12:18:03.737 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T12:18:03.737 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T12:18:03.737 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-09-15 12:17:57.279947501 +0000 2024-09-15T12:18:03.737 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-09-15 12:13:50.632792235 +0000 2024-09-15T12:18:03.737 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-09-15 12:13:50.632792235 +0000 2024-09-15T12:18:03.737 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-09-15 12:13:50.632792235 +0000 2024-09-15T12:18:03.737 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T12:18:03.802 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-09-15T12:18:03.802 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-09-15T12:18:03.802 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000215119 s, 2.4 MB/s 2024-09-15T12:18:03.803 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T12:18:03.860 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_2 2024-09-15T12:18:03.916 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T12:18:03.917 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T12:18:03.917 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-15T12:18:03.917 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T12:18:03.917 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T12:18:03.917 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-09-15 12:17:57.279947501 +0000 2024-09-15T12:18:03.917 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-09-15 12:13:50.970785050 +0000 2024-09-15T12:18:03.917 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-09-15 12:13:50.970785050 +0000 2024-09-15T12:18:03.917 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-09-15 12:13:50.970785050 +0000 2024-09-15T12:18:03.917 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T12:18:03.981 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-09-15T12:18:03.981 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-09-15T12:18:03.982 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000202167 s, 2.5 MB/s 2024-09-15T12:18:03.983 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T12:18:04.039 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_3 2024-09-15T12:18:04.095 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T12:18:04.095 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T12:18:04.095 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-15T12:18:04.095 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T12:18:04.095 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T12:18:04.095 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-09-15 12:17:57.279947501 +0000 2024-09-15T12:18:04.095 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-09-15 12:13:51.333777332 +0000 2024-09-15T12:18:04.095 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-09-15 12:13:51.333777332 +0000 2024-09-15T12:18:04.095 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-09-15 12:13:51.333777332 +0000 2024-09-15T12:18:04.095 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T12:18:04.158 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-09-15T12:18:04.158 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-09-15T12:18:04.158 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000243025 s, 2.1 MB/s 2024-09-15T12:18:04.160 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T12:18:04.216 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_4 2024-09-15T12:18:04.271 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T12:18:04.271 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T12:18:04.271 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-15T12:18:04.271 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T12:18:04.271 INFO:teuthology.orchestra.run.smithi138.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T12:18:04.271 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-09-15 12:17:57.279947501 +0000 2024-09-15T12:18:04.272 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-09-15 12:13:51.659770401 +0000 2024-09-15T12:18:04.272 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-09-15 12:13:51.659770401 +0000 2024-09-15T12:18:04.272 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2024-09-15 12:13:51.659770401 +0000 2024-09-15T12:18:04.272 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T12:18:04.334 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-09-15T12:18:04.334 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-09-15T12:18:04.334 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000219312 s, 2.3 MB/s 2024-09-15T12:18:04.336 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T12:18:04.392 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-15T12:18:04.392 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi077.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi138.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-15T12:18:04.392 INFO:tasks.ceph:Generating config... 2024-09-15T12:18:04.394 INFO:tasks.ceph:[osd] debug monc = 20 2024-09-15T12:18:04.394 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-15T12:18:04.394 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2024-09-15T12:18:04.394 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-15T12:18:04.394 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-15T12:18:04.394 INFO:tasks.ceph:[osd] bluestore rocksdb cf = False 2024-09-15T12:18:04.394 INFO:tasks.ceph:[osd] crimson alien thread cpu cores = 6-7 2024-09-15T12:18:04.394 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2024-09-15T12:18:04.394 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-15T12:18:04.395 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-15T12:18:04.395 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-15T12:18:04.395 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-15T12:18:04.395 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-15T12:18:04.395 INFO:tasks.ceph:[osd] err to stderr = True 2024-09-15T12:18:04.395 INFO:tasks.ceph:[osd] log flush on exit = True 2024-09-15T12:18:04.395 INFO:tasks.ceph:[osd] log to file = False 2024-09-15T12:18:04.395 INFO:tasks.ceph:[osd] log to stderr = True 2024-09-15T12:18:04.395 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-15T12:18:04.395 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-15T12:18:04.395 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-15T12:18:04.395 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-15T12:18:04.395 INFO:tasks.ceph:[osd] osd debug reject backfill probability = 0.3 2024-09-15T12:18:04.395 INFO:tasks.ceph:[osd] osd delete sleep = 1 2024-09-15T12:18:04.395 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-15T12:18:04.396 INFO:tasks.ceph:[osd] osd max backfills = 3 2024-09-15T12:18:04.396 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-15T12:18:04.396 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-15T12:18:04.396 INFO:tasks.ceph:[osd] osd scrub max interval = 120 2024-09-15T12:18:04.396 INFO:tasks.ceph:[osd] osd scrub min interval = 60 2024-09-15T12:18:04.396 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-15T12:18:04.396 INFO:tasks.ceph:[osd] osd snap trim sleep = 2 2024-09-15T12:18:04.396 INFO:tasks.ceph:[client.0] debug ms = 1 2024-09-15T12:18:04.396 INFO:tasks.ceph:[client.0] debug objecter = 20 2024-09-15T12:18:04.396 INFO:tasks.ceph:[client.0] debug rados = 20 2024-09-15T12:18:04.396 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2024-09-15T12:18:04.396 INFO:tasks.ceph:[global] ms client mode = crc 2024-09-15T12:18:04.396 INFO:tasks.ceph:[global] ms cluster mode = crc 2024-09-15T12:18:04.396 INFO:tasks.ceph:[global] ms mon client mode = crc 2024-09-15T12:18:04.396 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2024-09-15T12:18:04.397 INFO:tasks.ceph:[global] ms mon service mode = crc 2024-09-15T12:18:04.397 INFO:tasks.ceph:[global] ms service mode = crc 2024-09-15T12:18:04.397 INFO:tasks.ceph:[global] osd_pool_default_min_size = 2 2024-09-15T12:18:04.397 INFO:tasks.ceph:[global] osd_pool_default_size = 3 2024-09-15T12:18:04.397 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-15T12:18:04.397 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-15T12:18:04.397 INFO:tasks.ceph:[mgr] mgr stats period = 30 2024-09-15T12:18:04.397 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-15T12:18:04.397 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-15T12:18:04.397 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-15T12:18:04.397 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-09-15T12:18:04.397 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-09-15T12:18:04.397 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-09-15T12:18:04.397 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-09-15T12:18:04.397 INFO:tasks.ceph:[mon] osd pool default crimson = True 2024-09-15T12:18:04.398 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-09-15T12:18:04.398 INFO:tasks.ceph:[osd.0] crimson seastar cpu cores = 0-2 2024-09-15T12:18:04.398 INFO:tasks.ceph:[osd.1] crimson seastar cpu cores = 3-5 2024-09-15T12:18:04.398 INFO:tasks.ceph:[osd.2] crimson seastar cpu cores = 0-2 2024-09-15T12:18:04.398 INFO:tasks.ceph:[osd.3] crimson seastar cpu cores = 3-5 2024-09-15T12:18:04.398 INFO:tasks.ceph:Setting up mon.a... 2024-09-15T12:18:04.398 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-15T12:18:04.467 INFO:teuthology.orchestra.run.smithi077.stdout:creating /etc/ceph/ceph.keyring 2024-09-15T12:18:04.471 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-15T12:18:04.522 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T12:18:04.547 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.77')] 2024-09-15T12:18:04.547 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.77', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': 120, 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'mgr stats period': 30}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}} 2024-09-15T12:18:04.548 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T12:18:04.548 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-15T12:18:04.602 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.77 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-15T12:18:04.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:04.692+0000 7faadc309f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:04.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:04.692+0000 7faadc309f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:04.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:04.693+0000 7faadc309f00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:04.695 INFO:teuthology.orchestra.run.smithi077.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-15T12:18:04.695 INFO:teuthology.orchestra.run.smithi077.stdout:monmaptool: generated fsid 0010d80b-83bc-42b2-8185-928cfe1dc364 2024-09-15T12:18:04.695 INFO:teuthology.orchestra.run.smithi077.stdout:setting min_mon_release = quincy 2024-09-15T12:18:04.695 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 0 2024-09-15T12:18:04.695 INFO:teuthology.orchestra.run.smithi077.stdout:fsid 0010d80b-83bc-42b2-8185-928cfe1dc364 2024-09-15T12:18:04.695 INFO:teuthology.orchestra.run.smithi077.stdout:last_changed 2024-09-15T12:18:04.694131+0000 2024-09-15T12:18:04.695 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-09-15T12:18:04.694131+0000 2024-09-15T12:18:04.695 INFO:teuthology.orchestra.run.smithi077.stdout:min_mon_release 17 (quincy) 2024-09-15T12:18:04.695 INFO:teuthology.orchestra.run.smithi077.stdout:election_strategy: 1 2024-09-15T12:18:04.695 INFO:teuthology.orchestra.run.smithi077.stdout:0: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.a 2024-09-15T12:18:04.695 INFO:teuthology.orchestra.run.smithi077.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-15T12:18:04.697 DEBUG:teuthology.orchestra.run.smithi077:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-15T12:18:04.711 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0010d80b-83bc-42b2-8185-928cfe1dc364... 2024-09-15T12:18:04.712 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T12:18:04.754 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T12:18:04.794 INFO:teuthology.orchestra.run.smithi077.stdout:[global] 2024-09-15T12:18:04.794 INFO:teuthology.orchestra.run.smithi077.stdout: chdir = "" 2024-09-15T12:18:04.794 INFO:teuthology.orchestra.run.smithi077.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T12:18:04.794 INFO:teuthology.orchestra.run.smithi077.stdout: auth supported = cephx 2024-09-15T12:18:04.794 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:04.794 INFO:teuthology.orchestra.run.smithi077.stdout: filestore xattr use omap = true 2024-09-15T12:18:04.794 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:04.794 INFO:teuthology.orchestra.run.smithi077.stdout: mon clock drift allowed = 1.000 2024-09-15T12:18:04.794 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:04.794 INFO:teuthology.orchestra.run.smithi077.stdout: osd crush chooseleaf type = 0 2024-09-15T12:18:04.794 INFO:teuthology.orchestra.run.smithi077.stdout: auth debug = true 2024-09-15T12:18:04.794 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:04.795 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on old message = true 2024-09-15T12:18:04.795 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on bug = true 2024-09-15T12:18:04.795 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:04.795 INFO:teuthology.orchestra.run.smithi077.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T12:18:04.795 INFO:teuthology.orchestra.run.smithi077.stdout: mon pg warn max object skew = 0 2024-09-15T12:18:04.795 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:04.795 INFO:teuthology.orchestra.run.smithi077.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T12:18:04.795 INFO:teuthology.orchestra.run.smithi077.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T12:18:04.795 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:04.795 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default size = 2 2024-09-15T12:18:04.795 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:04.795 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow primary affinity = true 2024-09-15T12:18:04.795 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow pg remap = true 2024-09-15T12:18:04.795 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on legacy crush tunables = false 2024-09-15T12:18:04.795 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on crush straw calc version zero = false 2024-09-15T12:18:04.796 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on no sortbitwise = false 2024-09-15T12:18:04.796 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on osd down out interval zero = false 2024-09-15T12:18:04.796 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on too few osds = false 2024-09-15T12:18:04.796 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T12:18:04.796 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T12:18:04.796 INFO:teuthology.orchestra.run.smithi077.stdout: mon_allow_pool_size_one = true 2024-09-15T12:18:04.796 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:04.796 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T12:18:04.796 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:04.796 INFO:teuthology.orchestra.run.smithi077.stdout: osd default data pool replay window = 5 2024-09-15T12:18:04.796 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:04.796 INFO:teuthology.orchestra.run.smithi077.stdout: mon allow pool delete = true 2024-09-15T12:18:04.796 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:04.796 INFO:teuthology.orchestra.run.smithi077.stdout: mon cluster log file level = debug 2024-09-15T12:18:04.797 INFO:teuthology.orchestra.run.smithi077.stdout: debug asserts on shutdown = true 2024-09-15T12:18:04.797 INFO:teuthology.orchestra.run.smithi077.stdout: mon health detail to clog = false 2024-09-15T12:18:04.797 INFO:teuthology.orchestra.run.smithi077.stdout: mon host = 172.21.15.77 2024-09-15T12:18:04.797 INFO:teuthology.orchestra.run.smithi077.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-15T12:18:04.797 INFO:teuthology.orchestra.run.smithi077.stdout: ms client mode = crc 2024-09-15T12:18:04.797 INFO:teuthology.orchestra.run.smithi077.stdout: ms cluster mode = crc 2024-09-15T12:18:04.797 INFO:teuthology.orchestra.run.smithi077.stdout: ms mon client mode = crc 2024-09-15T12:18:04.797 INFO:teuthology.orchestra.run.smithi077.stdout: ms mon cluster mode = crc 2024-09-15T12:18:04.797 INFO:teuthology.orchestra.run.smithi077.stdout: ms mon service mode = crc 2024-09-15T12:18:04.797 INFO:teuthology.orchestra.run.smithi077.stdout: ms service mode = crc 2024-09-15T12:18:04.797 INFO:teuthology.orchestra.run.smithi077.stdout: osd_pool_default_min_size = 2 2024-09-15T12:18:04.797 INFO:teuthology.orchestra.run.smithi077.stdout: osd_pool_default_size = 3 2024-09-15T12:18:04.797 INFO:teuthology.orchestra.run.smithi077.stdout: fsid = 0010d80b-83bc-42b2-8185-928cfe1dc364 2024-09-15T12:18:04.797 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:04.798 INFO:teuthology.orchestra.run.smithi077.stdout:[osd] 2024-09-15T12:18:04.798 INFO:teuthology.orchestra.run.smithi077.stdout: osd journal size = 100 2024-09-15T12:18:04.798 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:04.798 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub load threshold = 5.0 2024-09-15T12:18:04.798 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub max interval = 120 2024-09-15T12:18:04.798 INFO:teuthology.orchestra.run.smithi077.stdout: osd mclock profile = high_recovery_ops 2024-09-15T12:18:04.798 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:04.798 INFO:teuthology.orchestra.run.smithi077.stdout: osd recover clone overlap = true 2024-09-15T12:18:04.798 INFO:teuthology.orchestra.run.smithi077.stdout: osd recovery max chunk = 1048576 2024-09-15T12:18:04.798 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:04.798 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug shutdown = true 2024-09-15T12:18:04.798 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug op order = true 2024-09-15T12:18:04.798 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug verify stray on activate = true 2024-09-15T12:18:04.798 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug trim objects = true 2024-09-15T12:18:04.799 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:04.799 INFO:teuthology.orchestra.run.smithi077.stdout: osd open classes on start = true 2024-09-15T12:18:04.799 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug pg log writeout = true 2024-09-15T12:18:04.799 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:04.799 INFO:teuthology.orchestra.run.smithi077.stdout: osd deep scrub update digest min age = 30 2024-09-15T12:18:04.799 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:04.799 INFO:teuthology.orchestra.run.smithi077.stdout: osd map max advance = 10 2024-09-15T12:18:04.799 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:04.799 INFO:teuthology.orchestra.run.smithi077.stdout: journal zero on create = true 2024-09-15T12:18:04.799 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:04.799 INFO:teuthology.orchestra.run.smithi077.stdout: filestore ondisk finisher threads = 3 2024-09-15T12:18:04.799 INFO:teuthology.orchestra.run.smithi077.stdout: filestore apply finisher threads = 3 2024-09-15T12:18:04.799 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:04.799 INFO:teuthology.orchestra.run.smithi077.stdout: bdev debug aio = true 2024-09-15T12:18:04.799 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug misdirected ops = true 2024-09-15T12:18:04.799 INFO:teuthology.orchestra.run.smithi077.stdout: debug monc = 20 2024-09-15T12:18:04.800 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore block size = 96636764160 2024-09-15T12:18:04.800 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore compression algorithm = snappy 2024-09-15T12:18:04.800 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore compression mode = aggressive 2024-09-15T12:18:04.800 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore fsck on mount = True 2024-09-15T12:18:04.800 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore rocksdb cf = False 2024-09-15T12:18:04.800 INFO:teuthology.orchestra.run.smithi077.stdout: crimson alien thread cpu cores = 6-7 2024-09-15T12:18:04.800 INFO:teuthology.orchestra.run.smithi077.stdout: crimson osd obc lru size = 10 2024-09-15T12:18:04.800 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluefs = 20 2024-09-15T12:18:04.800 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluestore = 20 2024-09-15T12:18:04.800 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-15T12:18:04.800 INFO:teuthology.orchestra.run.smithi077.stdout: debug osd = 20 2024-09-15T12:18:04.800 INFO:teuthology.orchestra.run.smithi077.stdout: debug rocksdb = 10 2024-09-15T12:18:04.800 INFO:teuthology.orchestra.run.smithi077.stdout: err to stderr = True 2024-09-15T12:18:04.800 INFO:teuthology.orchestra.run.smithi077.stdout: log flush on exit = True 2024-09-15T12:18:04.801 INFO:teuthology.orchestra.run.smithi077.stdout: log to file = False 2024-09-15T12:18:04.801 INFO:teuthology.orchestra.run.smithi077.stdout: log to stderr = True 2024-09-15T12:18:04.801 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T12:18:04.801 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd full ratio = 0.9 2024-09-15T12:18:04.801 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd nearfull ratio = 0.8 2024-09-15T12:18:04.801 INFO:teuthology.orchestra.run.smithi077.stdout: osd blocked scrub grace period = 3600 2024-09-15T12:18:04.801 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug reject backfill probability = 0.3 2024-09-15T12:18:04.801 INFO:teuthology.orchestra.run.smithi077.stdout: osd delete sleep = 1 2024-09-15T12:18:04.801 INFO:teuthology.orchestra.run.smithi077.stdout: osd failsafe full ratio = 0.95 2024-09-15T12:18:04.801 INFO:teuthology.orchestra.run.smithi077.stdout: osd max backfills = 3 2024-09-15T12:18:04.801 INFO:teuthology.orchestra.run.smithi077.stdout: osd max markdown count = 1000 2024-09-15T12:18:04.801 INFO:teuthology.orchestra.run.smithi077.stdout: osd objectstore = bluestore 2024-09-15T12:18:04.801 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub min interval = 60 2024-09-15T12:18:04.801 INFO:teuthology.orchestra.run.smithi077.stdout: osd shutdown pgref assert = True 2024-09-15T12:18:04.802 INFO:teuthology.orchestra.run.smithi077.stdout: osd snap trim sleep = 2 2024-09-15T12:18:04.802 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:04.802 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr] 2024-09-15T12:18:04.802 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-15T12:18:04.802 INFO:teuthology.orchestra.run.smithi077.stdout: debug mgr = 20 2024-09-15T12:18:04.802 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2024-09-15T12:18:04.802 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2024-09-15T12:18:04.802 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2024-09-15T12:18:04.802 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2024-09-15T12:18:04.802 INFO:teuthology.orchestra.run.smithi077.stdout: mgr/telemetry/nag = false 2024-09-15T12:18:04.802 INFO:teuthology.orchestra.run.smithi077.stdout: mgr stats period = 30 2024-09-15T12:18:04.802 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:04.802 INFO:teuthology.orchestra.run.smithi077.stdout:[mon] 2024-09-15T12:18:04.802 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-15T12:18:04.802 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2024-09-15T12:18:04.802 INFO:teuthology.orchestra.run.smithi077.stdout: debug paxos = 20 2024-09-15T12:18:04.803 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2024-09-15T12:18:04.803 INFO:teuthology.orchestra.run.smithi077.stdout: mon data avail warn = 5 2024-09-15T12:18:04.803 INFO:teuthology.orchestra.run.smithi077.stdout: mon mgr mkfs grace = 240 2024-09-15T12:18:04.803 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2024-09-15T12:18:04.803 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd reporter subtree level = osd 2024-09-15T12:18:04.803 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd prime pg temp = true 2024-09-15T12:18:04.803 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2024-09-15T12:18:04.803 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:04.803 INFO:teuthology.orchestra.run.smithi077.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T12:18:04.803 INFO:teuthology.orchestra.run.smithi077.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T12:18:04.803 INFO:teuthology.orchestra.run.smithi077.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T12:18:04.803 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:04.803 INFO:teuthology.orchestra.run.smithi077.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T12:18:04.803 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T12:18:04.803 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T12:18:04.803 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:04.804 INFO:teuthology.orchestra.run.smithi077.stdout: # 1m isn't quite enough 2024-09-15T12:18:04.804 INFO:teuthology.orchestra.run.smithi077.stdout: mon_down_mkfs_grace = 2m 2024-09-15T12:18:04.804 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:04.804 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_filestore_osds = false 2024-09-15T12:18:04.804 INFO:teuthology.orchestra.run.smithi077.stdout: mon min osdmap epochs = 50 2024-09-15T12:18:04.804 INFO:teuthology.orchestra.run.smithi077.stdout: mon osdmap full prune interval = 2 2024-09-15T12:18:04.804 INFO:teuthology.orchestra.run.smithi077.stdout: mon osdmap full prune min = 15 2024-09-15T12:18:04.804 INFO:teuthology.orchestra.run.smithi077.stdout: mon osdmap full prune txsize = 2 2024-09-15T12:18:04.804 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default crimson = True 2024-09-15T12:18:04.804 INFO:teuthology.orchestra.run.smithi077.stdout: paxos service trim min = 10 2024-09-15T12:18:04.804 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:04.804 INFO:teuthology.orchestra.run.smithi077.stdout:[client] 2024-09-15T12:18:04.804 INFO:teuthology.orchestra.run.smithi077.stdout: rgw cache enabled = true 2024-09-15T12:18:04.804 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable ops log = true 2024-09-15T12:18:04.804 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable usage log = true 2024-09-15T12:18:04.805 INFO:teuthology.orchestra.run.smithi077.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T12:18:04.805 INFO:teuthology.orchestra.run.smithi077.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T12:18:04.805 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.a] 2024-09-15T12:18:04.805 INFO:teuthology.orchestra.run.smithi077.stdout:[client.0] 2024-09-15T12:18:04.805 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-15T12:18:04.805 INFO:teuthology.orchestra.run.smithi077.stdout: debug objecter = 20 2024-09-15T12:18:04.805 INFO:teuthology.orchestra.run.smithi077.stdout: debug rados = 20 2024-09-15T12:18:04.805 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.0] 2024-09-15T12:18:04.805 INFO:teuthology.orchestra.run.smithi077.stdout: crimson seastar cpu cores = 0-2 2024-09-15T12:18:04.805 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.1] 2024-09-15T12:18:04.805 INFO:teuthology.orchestra.run.smithi077.stdout: crimson seastar cpu cores = 3-5 2024-09-15T12:18:04.805 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.2] 2024-09-15T12:18:04.805 INFO:teuthology.orchestra.run.smithi077.stdout: crimson seastar cpu cores = 0-2 2024-09-15T12:18:04.805 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.3] 2024-09-15T12:18:04.805 INFO:teuthology.orchestra.run.smithi077.stdout: crimson seastar cpu cores = 3-5 2024-09-15T12:18:04.806 INFO:teuthology.orchestra.run.smithi138.stdout:[global] 2024-09-15T12:18:04.806 INFO:teuthology.orchestra.run.smithi138.stdout: chdir = "" 2024-09-15T12:18:04.806 INFO:teuthology.orchestra.run.smithi138.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T12:18:04.806 INFO:teuthology.orchestra.run.smithi138.stdout: auth supported = cephx 2024-09-15T12:18:04.806 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:18:04.806 INFO:teuthology.orchestra.run.smithi138.stdout: filestore xattr use omap = true 2024-09-15T12:18:04.806 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:18:04.806 INFO:teuthology.orchestra.run.smithi138.stdout: mon clock drift allowed = 1.000 2024-09-15T12:18:04.806 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:18:04.806 INFO:teuthology.orchestra.run.smithi138.stdout: osd crush chooseleaf type = 0 2024-09-15T12:18:04.807 INFO:teuthology.orchestra.run.smithi138.stdout: auth debug = true 2024-09-15T12:18:04.807 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:18:04.807 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on old message = true 2024-09-15T12:18:04.807 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on bug = true 2024-09-15T12:18:04.807 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:18:04.807 INFO:teuthology.orchestra.run.smithi138.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T12:18:04.807 INFO:teuthology.orchestra.run.smithi138.stdout: mon pg warn max object skew = 0 2024-09-15T12:18:04.807 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:18:04.807 INFO:teuthology.orchestra.run.smithi138.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T12:18:04.807 INFO:teuthology.orchestra.run.smithi138.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T12:18:04.807 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:18:04.807 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default size = 2 2024-09-15T12:18:04.807 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:18:04.807 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow primary affinity = true 2024-09-15T12:18:04.807 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow pg remap = true 2024-09-15T12:18:04.808 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on legacy crush tunables = false 2024-09-15T12:18:04.808 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on crush straw calc version zero = false 2024-09-15T12:18:04.808 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on no sortbitwise = false 2024-09-15T12:18:04.808 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on osd down out interval zero = false 2024-09-15T12:18:04.808 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on too few osds = false 2024-09-15T12:18:04.808 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T12:18:04.808 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T12:18:04.808 INFO:teuthology.orchestra.run.smithi138.stdout: mon_allow_pool_size_one = true 2024-09-15T12:18:04.808 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:18:04.808 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T12:18:04.808 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:18:04.808 INFO:teuthology.orchestra.run.smithi138.stdout: osd default data pool replay window = 5 2024-09-15T12:18:04.808 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:18:04.808 INFO:teuthology.orchestra.run.smithi138.stdout: mon allow pool delete = true 2024-09-15T12:18:04.808 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:18:04.809 INFO:teuthology.orchestra.run.smithi138.stdout: mon cluster log file level = debug 2024-09-15T12:18:04.809 INFO:teuthology.orchestra.run.smithi138.stdout: debug asserts on shutdown = true 2024-09-15T12:18:04.809 INFO:teuthology.orchestra.run.smithi138.stdout: mon health detail to clog = false 2024-09-15T12:18:04.809 INFO:teuthology.orchestra.run.smithi138.stdout: mon host = 172.21.15.77 2024-09-15T12:18:04.809 INFO:teuthology.orchestra.run.smithi138.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-15T12:18:04.809 INFO:teuthology.orchestra.run.smithi138.stdout: ms client mode = crc 2024-09-15T12:18:04.809 INFO:teuthology.orchestra.run.smithi138.stdout: ms cluster mode = crc 2024-09-15T12:18:04.809 INFO:teuthology.orchestra.run.smithi138.stdout: ms mon client mode = crc 2024-09-15T12:18:04.809 INFO:teuthology.orchestra.run.smithi138.stdout: ms mon cluster mode = crc 2024-09-15T12:18:04.809 INFO:teuthology.orchestra.run.smithi138.stdout: ms mon service mode = crc 2024-09-15T12:18:04.809 INFO:teuthology.orchestra.run.smithi138.stdout: ms service mode = crc 2024-09-15T12:18:04.809 INFO:teuthology.orchestra.run.smithi138.stdout: osd_pool_default_min_size = 2 2024-09-15T12:18:04.809 INFO:teuthology.orchestra.run.smithi138.stdout: osd_pool_default_size = 3 2024-09-15T12:18:04.810 INFO:teuthology.orchestra.run.smithi138.stdout: fsid = 0010d80b-83bc-42b2-8185-928cfe1dc364 2024-09-15T12:18:04.810 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:18:04.810 INFO:teuthology.orchestra.run.smithi138.stdout:[osd] 2024-09-15T12:18:04.810 INFO:teuthology.orchestra.run.smithi138.stdout: osd journal size = 100 2024-09-15T12:18:04.810 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:18:04.810 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub load threshold = 5.0 2024-09-15T12:18:04.810 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub max interval = 120 2024-09-15T12:18:04.810 INFO:teuthology.orchestra.run.smithi138.stdout: osd mclock profile = high_recovery_ops 2024-09-15T12:18:04.810 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:18:04.810 INFO:teuthology.orchestra.run.smithi138.stdout: osd recover clone overlap = true 2024-09-15T12:18:04.810 INFO:teuthology.orchestra.run.smithi138.stdout: osd recovery max chunk = 1048576 2024-09-15T12:18:04.810 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:18:04.810 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug shutdown = true 2024-09-15T12:18:04.810 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug op order = true 2024-09-15T12:18:04.811 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug verify stray on activate = true 2024-09-15T12:18:04.811 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug trim objects = true 2024-09-15T12:18:04.811 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:18:04.811 INFO:teuthology.orchestra.run.smithi138.stdout: osd open classes on start = true 2024-09-15T12:18:04.811 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug pg log writeout = true 2024-09-15T12:18:04.811 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:18:04.811 INFO:teuthology.orchestra.run.smithi138.stdout: osd deep scrub update digest min age = 30 2024-09-15T12:18:04.811 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:18:04.811 INFO:teuthology.orchestra.run.smithi138.stdout: osd map max advance = 10 2024-09-15T12:18:04.811 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:18:04.811 INFO:teuthology.orchestra.run.smithi138.stdout: journal zero on create = true 2024-09-15T12:18:04.811 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:18:04.811 INFO:teuthology.orchestra.run.smithi138.stdout: filestore ondisk finisher threads = 3 2024-09-15T12:18:04.811 INFO:teuthology.orchestra.run.smithi138.stdout: filestore apply finisher threads = 3 2024-09-15T12:18:04.812 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:18:04.812 INFO:teuthology.orchestra.run.smithi138.stdout: bdev debug aio = true 2024-09-15T12:18:04.812 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug misdirected ops = true 2024-09-15T12:18:04.812 INFO:teuthology.orchestra.run.smithi138.stdout: debug monc = 20 2024-09-15T12:18:04.812 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore block size = 96636764160 2024-09-15T12:18:04.812 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore compression algorithm = snappy 2024-09-15T12:18:04.812 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore compression mode = aggressive 2024-09-15T12:18:04.812 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore fsck on mount = True 2024-09-15T12:18:04.812 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore rocksdb cf = False 2024-09-15T12:18:04.812 INFO:teuthology.orchestra.run.smithi138.stdout: crimson alien thread cpu cores = 6-7 2024-09-15T12:18:04.812 INFO:teuthology.orchestra.run.smithi138.stdout: crimson osd obc lru size = 10 2024-09-15T12:18:04.812 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluefs = 20 2024-09-15T12:18:04.812 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluestore = 20 2024-09-15T12:18:04.812 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-09-15T12:18:04.812 INFO:teuthology.orchestra.run.smithi138.stdout: debug osd = 20 2024-09-15T12:18:04.813 INFO:teuthology.orchestra.run.smithi138.stdout: debug rocksdb = 10 2024-09-15T12:18:04.813 INFO:teuthology.orchestra.run.smithi138.stdout: err to stderr = True 2024-09-15T12:18:04.813 INFO:teuthology.orchestra.run.smithi138.stdout: log flush on exit = True 2024-09-15T12:18:04.813 INFO:teuthology.orchestra.run.smithi138.stdout: log to file = False 2024-09-15T12:18:04.813 INFO:teuthology.orchestra.run.smithi138.stdout: log to stderr = True 2024-09-15T12:18:04.813 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T12:18:04.813 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd full ratio = 0.9 2024-09-15T12:18:04.813 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd nearfull ratio = 0.8 2024-09-15T12:18:04.813 INFO:teuthology.orchestra.run.smithi138.stdout: osd blocked scrub grace period = 3600 2024-09-15T12:18:04.813 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug reject backfill probability = 0.3 2024-09-15T12:18:04.813 INFO:teuthology.orchestra.run.smithi138.stdout: osd delete sleep = 1 2024-09-15T12:18:04.813 INFO:teuthology.orchestra.run.smithi138.stdout: osd failsafe full ratio = 0.95 2024-09-15T12:18:04.813 INFO:teuthology.orchestra.run.smithi138.stdout: osd max backfills = 3 2024-09-15T12:18:04.813 INFO:teuthology.orchestra.run.smithi138.stdout: osd max markdown count = 1000 2024-09-15T12:18:04.813 INFO:teuthology.orchestra.run.smithi138.stdout: osd objectstore = bluestore 2024-09-15T12:18:04.814 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub min interval = 60 2024-09-15T12:18:04.814 INFO:teuthology.orchestra.run.smithi138.stdout: osd shutdown pgref assert = True 2024-09-15T12:18:04.814 INFO:teuthology.orchestra.run.smithi138.stdout: osd snap trim sleep = 2 2024-09-15T12:18:04.814 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:18:04.814 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr] 2024-09-15T12:18:04.814 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-09-15T12:18:04.814 INFO:teuthology.orchestra.run.smithi138.stdout: debug mgr = 20 2024-09-15T12:18:04.814 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2024-09-15T12:18:04.814 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2024-09-15T12:18:04.814 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2024-09-15T12:18:04.814 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2024-09-15T12:18:04.814 INFO:teuthology.orchestra.run.smithi138.stdout: mgr/telemetry/nag = false 2024-09-15T12:18:04.814 INFO:teuthology.orchestra.run.smithi138.stdout: mgr stats period = 30 2024-09-15T12:18:04.814 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:18:04.814 INFO:teuthology.orchestra.run.smithi138.stdout:[mon] 2024-09-15T12:18:04.814 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-09-15T12:18:04.815 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2024-09-15T12:18:04.815 INFO:teuthology.orchestra.run.smithi138.stdout: debug paxos = 20 2024-09-15T12:18:04.815 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2024-09-15T12:18:04.815 INFO:teuthology.orchestra.run.smithi138.stdout: mon data avail warn = 5 2024-09-15T12:18:04.815 INFO:teuthology.orchestra.run.smithi138.stdout: mon mgr mkfs grace = 240 2024-09-15T12:18:04.815 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2024-09-15T12:18:04.815 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd reporter subtree level = osd 2024-09-15T12:18:04.815 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd prime pg temp = true 2024-09-15T12:18:04.815 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2024-09-15T12:18:04.815 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:18:04.815 INFO:teuthology.orchestra.run.smithi138.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T12:18:04.815 INFO:teuthology.orchestra.run.smithi138.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T12:18:04.815 INFO:teuthology.orchestra.run.smithi138.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T12:18:04.815 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:18:04.815 INFO:teuthology.orchestra.run.smithi138.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T12:18:04.815 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T12:18:04.816 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T12:18:04.816 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:18:04.816 INFO:teuthology.orchestra.run.smithi138.stdout: # 1m isn't quite enough 2024-09-15T12:18:04.816 INFO:teuthology.orchestra.run.smithi138.stdout: mon_down_mkfs_grace = 2m 2024-09-15T12:18:04.816 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:18:04.816 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_filestore_osds = false 2024-09-15T12:18:04.816 INFO:teuthology.orchestra.run.smithi138.stdout: mon min osdmap epochs = 50 2024-09-15T12:18:04.816 INFO:teuthology.orchestra.run.smithi138.stdout: mon osdmap full prune interval = 2 2024-09-15T12:18:04.816 INFO:teuthology.orchestra.run.smithi138.stdout: mon osdmap full prune min = 15 2024-09-15T12:18:04.816 INFO:teuthology.orchestra.run.smithi138.stdout: mon osdmap full prune txsize = 2 2024-09-15T12:18:04.816 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default crimson = True 2024-09-15T12:18:04.816 INFO:teuthology.orchestra.run.smithi138.stdout: paxos service trim min = 10 2024-09-15T12:18:04.816 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-15T12:18:04.816 INFO:teuthology.orchestra.run.smithi138.stdout:[client] 2024-09-15T12:18:04.816 INFO:teuthology.orchestra.run.smithi138.stdout: rgw cache enabled = true 2024-09-15T12:18:04.817 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable ops log = true 2024-09-15T12:18:04.817 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable usage log = true 2024-09-15T12:18:04.817 INFO:teuthology.orchestra.run.smithi138.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T12:18:04.817 INFO:teuthology.orchestra.run.smithi138.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T12:18:04.817 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.a] 2024-09-15T12:18:04.817 INFO:teuthology.orchestra.run.smithi138.stdout:[client.0] 2024-09-15T12:18:04.817 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-09-15T12:18:04.817 INFO:teuthology.orchestra.run.smithi138.stdout: debug objecter = 20 2024-09-15T12:18:04.817 INFO:teuthology.orchestra.run.smithi138.stdout: debug rados = 20 2024-09-15T12:18:04.817 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.0] 2024-09-15T12:18:04.817 INFO:teuthology.orchestra.run.smithi138.stdout: crimson seastar cpu cores = 0-2 2024-09-15T12:18:04.817 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.1] 2024-09-15T12:18:04.817 INFO:teuthology.orchestra.run.smithi138.stdout: crimson seastar cpu cores = 3-5 2024-09-15T12:18:04.817 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.2] 2024-09-15T12:18:04.817 INFO:teuthology.orchestra.run.smithi138.stdout: crimson seastar cpu cores = 0-2 2024-09-15T12:18:04.817 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.3] 2024-09-15T12:18:04.818 INFO:teuthology.orchestra.run.smithi138.stdout: crimson seastar cpu cores = 3-5 2024-09-15T12:18:04.819 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-15T12:18:04.819 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-15T12:18:04.923 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-15T12:18:04.923 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T12:18:04.924 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-15T12:18:04.939 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T12:18:04.939 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-15T12:18:04.994 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi077.front.sepia.ceph.com 2024-09-15T12:18:04.994 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T12:18:04.994 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-15T12:18:04.994 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T12:18:05.068 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T12:18:05.068 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-15T12:18:05.123 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi138.front.sepia.ceph.com 2024-09-15T12:18:05.123 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-15T12:18:05.123 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-15T12:18:05.123 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T12:18:05.159 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-15T12:18:05.159 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-15T12:18:05.215 INFO:tasks.ceph:Setting up mon nodes... 2024-09-15T12:18:05.215 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-15T12:18:05.215 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-15T12:18:05.326 INFO:teuthology.orchestra.run.smithi138.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-15T12:18:05.329 INFO:tasks.ceph:Setting up mds nodes... 2024-09-15T12:18:05.329 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-15T12:18:05.329 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-15T12:18:05.379 INFO:teuthology.orchestra.run.smithi077.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-15T12:18:05.392 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-15T12:18:05.442 INFO:teuthology.orchestra.run.smithi138.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-15T12:18:05.455 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-15T12:18:05.456 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi077.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi138.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-15T12:18:05.456 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-15T12:18:05.480 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-15T12:18:05.480 INFO:tasks.ceph:role: osd.0 2024-09-15T12:18:05.480 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-15T12:18:05.480 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-15T12:18:05.552 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T12:18:05.552 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T12:18:05.552 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T12:18:05.552 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T12:18:05.552 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T12:18:05.552 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2024-09-15T12:18:05.552 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T12:18:05.552 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T12:18:05.552 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T12:18:05.552 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T12:18:06.080 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2024-09-15T12:18:06.082 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2024-09-15T12:18:06.083 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-15T12:18:06.211 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-15T12:18:06.244 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-15T12:18:06.310 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-15T12:18:06.310 INFO:tasks.ceph:role: osd.1 2024-09-15T12:18:06.310 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-15T12:18:06.310 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-15T12:18:06.382 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T12:18:06.382 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T12:18:06.382 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T12:18:06.382 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T12:18:06.382 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T12:18:06.382 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2024-09-15T12:18:06.382 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T12:18:06.383 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T12:18:06.383 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T12:18:06.383 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T12:18:06.846 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2024-09-15T12:18:06.848 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2024-09-15T12:18:06.848 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-15T12:18:06.943 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-15T12:18:06.972 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T12:18:07.280 INFO:teuthology.orchestra.run.smithi077.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-15T12:18:07.281 INFO:teuthology.orchestra.run.smithi077.stderr:INFO 2024-09-15 12:18:07,281 seastar - Reactor backend: linux-aio 2024-09-15T12:18:07.292 INFO:teuthology.orchestra.run.smithi077.stderr:==28209==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-15T12:18:07.414 INFO:teuthology.orchestra.run.smithi077.stderr:INFO 2024-09-15 12:18:07,414 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-15T12:18:07.414 INFO:teuthology.orchestra.run.smithi077.stderr:INFO 2024-09-15 12:18:07,414 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-15T12:18:07.415 INFO:teuthology.orchestra.run.smithi077.stderr:DEBUG 2024-09-15 12:18:07,415 [shard 0:main] seastar - reactor::drain 2024-09-15T12:18:07.931 INFO:teuthology.orchestra.run.smithi077.stderr:----------------------------------------------------- 2024-09-15T12:18:07.931 INFO:teuthology.orchestra.run.smithi077.stderr:Suppressions used: 2024-09-15T12:18:07.931 INFO:teuthology.orchestra.run.smithi077.stderr: count bytes template 2024-09-15T12:18:07.931 INFO:teuthology.orchestra.run.smithi077.stderr: 1 8 MallocExtension::Register 2024-09-15T12:18:07.931 INFO:teuthology.orchestra.run.smithi077.stderr:----------------------------------------------------- 2024-09-15T12:18:07.931 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-09-15T12:18:07.993 INFO:teuthology.orchestra.run.smithi077.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-15T12:18:07.997 INFO:teuthology.orchestra.run.smithi077.stderr:INFO 2024-09-15 12:18:07,996 seastar - Reactor backend: linux-aio 2024-09-15T12:18:08.006 INFO:teuthology.orchestra.run.smithi077.stderr:==28207==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-15T12:18:12.687 INFO:teuthology.orchestra.run.smithi077.stderr:----------------------------------------------------- 2024-09-15T12:18:12.687 INFO:teuthology.orchestra.run.smithi077.stderr:Suppressions used: 2024-09-15T12:18:12.687 INFO:teuthology.orchestra.run.smithi077.stderr: count bytes template 2024-09-15T12:18:12.687 INFO:teuthology.orchestra.run.smithi077.stderr: 1 8 MallocExtension::Register 2024-09-15T12:18:12.687 INFO:teuthology.orchestra.run.smithi077.stderr:----------------------------------------------------- 2024-09-15T12:18:12.687 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-09-15T12:18:12.709 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-15T12:18:12.734 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T12:18:13.009 INFO:teuthology.orchestra.run.smithi077.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-15T12:18:13.010 INFO:teuthology.orchestra.run.smithi077.stderr:INFO 2024-09-15 12:18:13,010 seastar - Reactor backend: linux-aio 2024-09-15T12:18:13.015 INFO:teuthology.orchestra.run.smithi077.stderr:==28395==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-15T12:18:13.121 INFO:teuthology.orchestra.run.smithi077.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x42198 0x3ef7b 0xfd531 0x361b453 0x361b65c 0x362a2bb 0x382b1d8 0x416dc9b 0x5fb8ce4 0x5fb8ee0 0x5fb946c 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3962bc0 0x396439a 0x3804c28 0x2958f 0x2963f 0x35ec9b4 2024-09-15T12:18:13.121 INFO:teuthology.orchestra.run.smithi077.stderr:kernel callstack: 0xffffffffffffff80 0xffffffff9808c7a4 0xffffffff98cd1d62 0xffffffff98e00bb2 2024-09-15T12:18:13.138 INFO:teuthology.orchestra.run.smithi077.stderr:INFO 2024-09-15 12:18:13,137 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-15T12:18:13.138 INFO:teuthology.orchestra.run.smithi077.stderr:INFO 2024-09-15 12:18:13,137 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-15T12:18:13.139 INFO:teuthology.orchestra.run.smithi077.stderr:DEBUG 2024-09-15 12:18:13,138 [shard 0:main] seastar - reactor::drain 2024-09-15T12:18:13.641 INFO:teuthology.orchestra.run.smithi077.stderr:----------------------------------------------------- 2024-09-15T12:18:13.641 INFO:teuthology.orchestra.run.smithi077.stderr:Suppressions used: 2024-09-15T12:18:13.641 INFO:teuthology.orchestra.run.smithi077.stderr: count bytes template 2024-09-15T12:18:13.641 INFO:teuthology.orchestra.run.smithi077.stderr: 1 8 MallocExtension::Register 2024-09-15T12:18:13.642 INFO:teuthology.orchestra.run.smithi077.stderr:----------------------------------------------------- 2024-09-15T12:18:13.642 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-09-15T12:18:13.697 INFO:teuthology.orchestra.run.smithi077.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-15T12:18:13.701 INFO:teuthology.orchestra.run.smithi077.stderr:INFO 2024-09-15 12:18:13,700 seastar - Reactor backend: linux-aio 2024-09-15T12:18:13.719 INFO:teuthology.orchestra.run.smithi077.stderr:==28393==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-15T12:18:18.654 INFO:teuthology.orchestra.run.smithi077.stderr:----------------------------------------------------- 2024-09-15T12:18:18.654 INFO:teuthology.orchestra.run.smithi077.stderr:Suppressions used: 2024-09-15T12:18:18.655 INFO:teuthology.orchestra.run.smithi077.stderr: count bytes template 2024-09-15T12:18:18.655 INFO:teuthology.orchestra.run.smithi077.stderr: 1 8 MallocExtension::Register 2024-09-15T12:18:18.655 INFO:teuthology.orchestra.run.smithi077.stderr:----------------------------------------------------- 2024-09-15T12:18:18.655 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-09-15T12:18:18.677 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-15T12:18:18.701 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-15T12:18:18.731 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-15T12:18:18.731 INFO:tasks.ceph:role: osd.2 2024-09-15T12:18:18.731 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-15T12:18:18.731 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-15T12:18:18.807 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T12:18:18.807 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T12:18:18.807 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T12:18:18.807 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T12:18:18.807 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T12:18:18.807 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-09-15T12:18:18.807 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T12:18:18.807 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T12:18:18.807 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T12:18:18.807 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T12:18:19.316 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-09-15T12:18:19.318 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-09-15T12:18:19.318 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-15T12:18:19.446 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-15T12:18:19.476 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-15T12:18:19.543 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-15T12:18:19.543 INFO:tasks.ceph:role: osd.3 2024-09-15T12:18:19.543 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-15T12:18:19.543 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-15T12:18:19.616 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T12:18:19.617 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T12:18:19.617 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T12:18:19.617 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-15T12:18:19.617 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T12:18:19.617 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-09-15T12:18:19.617 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T12:18:19.617 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-15T12:18:19.617 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T12:18:19.617 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T12:18:20.072 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-09-15T12:18:20.074 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-09-15T12:18:20.074 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2024-09-15T12:18:20.163 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-15T12:18:20.191 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T12:18:20.515 INFO:teuthology.orchestra.run.smithi138.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-15T12:18:20.516 INFO:teuthology.orchestra.run.smithi138.stderr:INFO 2024-09-15 12:18:20,516 seastar - Reactor backend: linux-aio 2024-09-15T12:18:20.535 INFO:teuthology.orchestra.run.smithi138.stderr:==27615==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-15T12:18:20.674 INFO:teuthology.orchestra.run.smithi138.stderr:INFO 2024-09-15 12:18:20,674 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-15T12:18:20.674 INFO:teuthology.orchestra.run.smithi138.stderr:INFO 2024-09-15 12:18:20,674 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-15T12:18:20.675 INFO:teuthology.orchestra.run.smithi138.stderr:DEBUG 2024-09-15 12:18:20,675 [shard 0:main] seastar - reactor::drain 2024-09-15T12:18:21.191 INFO:teuthology.orchestra.run.smithi138.stderr:----------------------------------------------------- 2024-09-15T12:18:21.191 INFO:teuthology.orchestra.run.smithi138.stderr:Suppressions used: 2024-09-15T12:18:21.192 INFO:teuthology.orchestra.run.smithi138.stderr: count bytes template 2024-09-15T12:18:21.192 INFO:teuthology.orchestra.run.smithi138.stderr: 1 8 MallocExtension::Register 2024-09-15T12:18:21.192 INFO:teuthology.orchestra.run.smithi138.stderr:----------------------------------------------------- 2024-09-15T12:18:21.192 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-15T12:18:21.250 INFO:teuthology.orchestra.run.smithi138.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-15T12:18:21.254 INFO:teuthology.orchestra.run.smithi138.stderr:INFO 2024-09-15 12:18:21,253 seastar - Reactor backend: linux-aio 2024-09-15T12:18:21.263 INFO:teuthology.orchestra.run.smithi138.stderr:==27613==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-15T12:18:21.328 INFO:teuthology.orchestra.run.smithi138.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x10797d 0xdd305 0x4b14c 0x362c8f6 0x362ca9c 0x5fb0d8b 0x5fd278c 0x5fd2a26 0x5fb964c 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3805438 0x2958f 0x2963f 0x35ec9b4 2024-09-15T12:18:21.328 INFO:teuthology.orchestra.run.smithi138.stderr:kernel callstack: 2024-09-15T12:18:25.965 INFO:teuthology.orchestra.run.smithi138.stderr:----------------------------------------------------- 2024-09-15T12:18:25.965 INFO:teuthology.orchestra.run.smithi138.stderr:Suppressions used: 2024-09-15T12:18:25.965 INFO:teuthology.orchestra.run.smithi138.stderr: count bytes template 2024-09-15T12:18:25.965 INFO:teuthology.orchestra.run.smithi138.stderr: 1 8 MallocExtension::Register 2024-09-15T12:18:25.965 INFO:teuthology.orchestra.run.smithi138.stderr:----------------------------------------------------- 2024-09-15T12:18:25.965 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-15T12:18:25.987 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-15T12:18:26.012 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T12:18:26.289 INFO:teuthology.orchestra.run.smithi138.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-15T12:18:26.290 INFO:teuthology.orchestra.run.smithi138.stderr:INFO 2024-09-15 12:18:26,289 seastar - Reactor backend: linux-aio 2024-09-15T12:18:26.295 INFO:teuthology.orchestra.run.smithi138.stderr:==27802==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-15T12:18:26.403 INFO:teuthology.orchestra.run.smithi138.stderr:Reactor stalled for 65 ms on shard 0, in scheduling group main. Backtrace: 0x82dff 0xbca834f 0xbb80cd9 0xbb82244 0xbb8245a 0xbb825b0 0xbb82a79 0x3e6ef 0x458561b 0x4621f13 0x5fdbff1 0x5fdc222 0x5fb92bb 0x5e00fef 0x5e19231 0x71579d2 0x71691a5 0x716a642 0x716a6c7 0x716a7c9 0x716a8c1 0x716aace 0x716acb4 0x716b003 0x716b3a7 0x716b5d7 0x716b841 0x716bb0e 0x716bd2c 0x716bde4 0x716beaa 0x716bf8b 0x5c63e30 0x5c63f3a 0x5c63ff6 0x5c640b2 0x5c6416e 0x5c642bb 0x5c64446 0x5c64807 0x5c7e60a 0xbb95287 0xbbad105 0xbc5a9af 0xbc5bffd 0xb92a8cd 0xb92b105 0x3962bc0 0x396439a 0x3804c28 0x2958f 0x2963f 0x35ec9b4 2024-09-15T12:18:26.403 INFO:teuthology.orchestra.run.smithi138.stderr:kernel callstack: 2024-09-15T12:18:26.419 INFO:teuthology.orchestra.run.smithi138.stderr:INFO 2024-09-15 12:18:26,419 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-15T12:18:26.419 INFO:teuthology.orchestra.run.smithi138.stderr:INFO 2024-09-15 12:18:26,419 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-15T12:18:26.420 INFO:teuthology.orchestra.run.smithi138.stderr:DEBUG 2024-09-15 12:18:26,420 [shard 0:main] seastar - reactor::drain 2024-09-15T12:18:26.924 INFO:teuthology.orchestra.run.smithi138.stderr:----------------------------------------------------- 2024-09-15T12:18:26.924 INFO:teuthology.orchestra.run.smithi138.stderr:Suppressions used: 2024-09-15T12:18:26.924 INFO:teuthology.orchestra.run.smithi138.stderr: count bytes template 2024-09-15T12:18:26.924 INFO:teuthology.orchestra.run.smithi138.stderr: 1 8 MallocExtension::Register 2024-09-15T12:18:26.924 INFO:teuthology.orchestra.run.smithi138.stderr:----------------------------------------------------- 2024-09-15T12:18:26.924 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-15T12:18:26.987 INFO:teuthology.orchestra.run.smithi138.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-15T12:18:26.991 INFO:teuthology.orchestra.run.smithi138.stderr:INFO 2024-09-15 12:18:26,990 seastar - Reactor backend: linux-aio 2024-09-15T12:18:27.007 INFO:teuthology.orchestra.run.smithi138.stderr:==27800==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-15T12:18:31.963 INFO:teuthology.orchestra.run.smithi138.stderr:----------------------------------------------------- 2024-09-15T12:18:31.964 INFO:teuthology.orchestra.run.smithi138.stderr:Suppressions used: 2024-09-15T12:18:31.964 INFO:teuthology.orchestra.run.smithi138.stderr: count bytes template 2024-09-15T12:18:31.964 INFO:teuthology.orchestra.run.smithi138.stderr: 1 8 MallocExtension::Register 2024-09-15T12:18:31.964 INFO:teuthology.orchestra.run.smithi138.stderr:----------------------------------------------------- 2024-09-15T12:18:31.964 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-15T12:18:31.985 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-15T12:18:32.009 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-15T12:18:32.010 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T12:18:32.010 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-15T12:18:32.040 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T12:18:32.040 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-15T12:18:32.108 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-15T12:18:32.108 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-15T12:18:32.133 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-15T12:18:32.133 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-15T12:18:32.197 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-15T12:18:32.197 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-15T12:18:32.262 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T12:18:32.262 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-15T12:18:32.279 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-15T12:18:32.279 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-15T12:18:32.317 INFO:tasks.ceph:Adding keys to all mons... 2024-09-15T12:18:32.318 DEBUG:teuthology.orchestra.run.smithi077:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-15T12:18:32.345 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.0] 2024-09-15T12:18:32.345 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQCA0OZmHLAcCRAA2qYH7RRC9YlESR96a+df0A== 2024-09-15T12:18:32.345 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.1] 2024-09-15T12:18:32.345 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQCF0OZmezONMxAACKOpprG/I82vUGAXaQ6VpA== 2024-09-15T12:18:32.345 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr.x] 2024-09-15T12:18:32.345 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQB90OZmY7luExAAZG+lSk0WqIvSLnKrxKE9tw== 2024-09-15T12:18:32.345 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.2] 2024-09-15T12:18:32.345 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQCN0OZmME94GBAA6gE3RzEnbTgGSApAldb52w== 2024-09-15T12:18:32.345 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.3] 2024-09-15T12:18:32.345 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQCT0OZmHikVCRAAe4NC6eYgIyPu4r3lHphBFA== 2024-09-15T12:18:32.345 INFO:teuthology.orchestra.run.smithi077.stdout:[client.0] 2024-09-15T12:18:32.345 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQB90OZmTryVFhAAB1KgQqhsQcN/BQhCwenBEg== 2024-09-15T12:18:32.345 INFO:teuthology.orchestra.run.smithi077.stdout:[client.1] 2024-09-15T12:18:32.346 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQB90OZmOQ9bGhAAOXeyItlqEFBV25eD9JFyTQ== 2024-09-15T12:18:32.346 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T12:18:32.453 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T12:18:32.516 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T12:18:32.577 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T12:18:32.638 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T12:18:32.700 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T12:18:32.764 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T12:18:32.829 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-15T12:18:32.829 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-15T12:18:32.853 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-15T12:18:32.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:32.959+0000 7f5bc18d0c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:32.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:32.959+0000 7f5bc18d0c00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:32.974 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-15T12:18:32.999 DEBUG:teuthology.orchestra.run.smithi077:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-15T12:18:33.054 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-15T12:18:33.054 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-15T12:18:33.054 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-15T12:18:33.097 INFO:tasks.ceph.mon.a:Started 2024-09-15T12:18:33.097 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-15T12:18:33.097 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-15T12:18:33.097 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-15T12:18:33.100 INFO:tasks.ceph.mgr.x:Started 2024-09-15T12:18:33.101 DEBUG:tasks.ceph:set 0 configs 2024-09-15T12:18:33.101 INFO:tasks.ceph:Setting crush tunables to default 2024-09-15T12:18:33.101 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd crush tunables default 2024-09-15T12:18:33.178 INFO:tasks.ceph.mon.a.smithi077.stderr:2024-09-15T12:18:33.177+0000 7f5defe2dc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:33.178 INFO:tasks.ceph.mon.a.smithi077.stderr:2024-09-15T12:18:33.177+0000 7f5defe2dc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:33.178 INFO:tasks.ceph.mon.a.smithi077.stderr:2024-09-15T12:18:33.177+0000 7f5defe2dc00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:33.207 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-09-15T12:18:33.205+0000 7f2e5efce000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:33.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:33.203+0000 7fb212eac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:33.213 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-09-15T12:18:33.212+0000 7f2e5efce000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:33.213 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-09-15T12:18:33.212+0000 7f2e5efce000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:33.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:33.213+0000 7fb212eac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:33.284 INFO:teuthology.orchestra.run.smithi077.stderr:adjusted tunables profile to default 2024-09-15T12:18:33.296 INFO:tasks.ceph:check_enable_crimson: True 2024-09-15T12:18:33.296 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2024-09-15T12:18:33.297 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2024-09-15T12:18:33.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:33.395+0000 7fa78a86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:33.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:33.404+0000 7fa78a86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:33.483 INFO:tasks.ceph.mon.a.smithi077.stderr:2024-09-15T12:18:33.482+0000 7f5de7df4640 -1 WARNING: experimental feature 'crimson' is enabled 2024-09-15T12:18:33.483 INFO:tasks.ceph.mon.a.smithi077.stderr:Please be aware that this feature is experimental, untested, 2024-09-15T12:18:33.483 INFO:tasks.ceph.mon.a.smithi077.stderr:unsupported, and may result in data corruption, data loss, 2024-09-15T12:18:33.483 INFO:tasks.ceph.mon.a.smithi077.stderr:and/or irreparable damage to your cluster. Do not use 2024-09-15T12:18:33.483 INFO:tasks.ceph.mon.a.smithi077.stderr:feature with important data. 2024-09-15T12:18:33.483 INFO:tasks.ceph.mon.a.smithi077.stderr: 2024-09-15T12:18:34.299 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-15T12:18:34.299 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T12:18:34.299 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-15T12:18:34.326 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T12:18:34.326 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-15T12:18:34.393 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-15T12:18:34.393 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-15T12:18:34.418 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-15T12:18:34.418 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-15T12:18:34.483 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new c5c8d66b-d3a4-47b4-ba1f-789441932c0e 0 2024-09-15T12:18:34.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-15T12:18:34.624+0000 7faeeed91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:34.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-15T12:18:34.633+0000 7faeeed91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:34.713 INFO:teuthology.orchestra.run.smithi138.stdout:0 2024-09-15T12:18:34.725 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new 349261f9-8426-4182-9f6d-19d1d4d00cfa 1 2024-09-15T12:18:34.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-15T12:18:34.825+0000 7fa008463640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:34.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-15T12:18:34.835+0000 7fa008463640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:34.912 INFO:teuthology.orchestra.run.smithi138.stdout:1 2024-09-15T12:18:34.924 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new 83bafe3c-2087-47d8-a2a1-1d5a1ec34144 2 2024-09-15T12:18:35.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-15T12:18:35.025+0000 7fe7a6511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:35.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-15T12:18:35.034+0000 7fe7a6511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:35.117 INFO:teuthology.orchestra.run.smithi138.stdout:2 2024-09-15T12:18:35.129 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new 3ec80261-3fac-47d0-a7e5-b49f4289dee8 3 2024-09-15T12:18:35.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-15T12:18:35.228+0000 7ff137991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:35.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-15T12:18:35.238+0000 7ff137991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:35.319 INFO:teuthology.orchestra.run.smithi138.stdout:3 2024-09-15T12:18:35.330 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2024-09-15T12:18:35.365 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-15T12:18:35.366 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-15T12:18:35.409 INFO:tasks.ceph.osd.0:Started 2024-09-15T12:18:35.409 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2024-09-15T12:18:35.441 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-15T12:18:35.441 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-09-15T12:18:35.484 INFO:tasks.ceph.osd.1:Started 2024-09-15T12:18:35.484 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2024-09-15T12:18:35.513 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-15T12:18:35.513 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-09-15T12:18:35.555 INFO:tasks.ceph.osd.2:Started 2024-09-15T12:18:35.556 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2024-09-15T12:18:35.584 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-15T12:18:35.584 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2024-09-15T12:18:35.627 INFO:tasks.ceph.osd.3:Started 2024-09-15T12:18:35.627 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T12:18:35.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:35.736+0000 7fdfc9391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:35.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:35.744+0000 7fdfc9391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:35.814 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:35.814 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":7,"fsid":"0010d80b-83bc-42b2-8185-928cfe1dc364","created":"2024-09-15T12:18:33.201019+0000","modified":"2024-09-15T12:18:35.315168+0000","last_up_change":"0.000000","last_in_change":"2024-09-15T12:18:35.315168+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"c5c8d66b-d3a4-47b4-ba1f-789441932c0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"349261f9-8426-4182-9f6d-19d1d4d00cfa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"83bafe3c-2087-47d8-a2a1-1d5a1ec34144","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3ec80261-3fac-47d0-a7e5-b49f4289dee8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T12:18:35.826 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-15T12:18:35.826 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-15T12:18:36.228 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T12:18:36.335 INFO:teuthology.misc.health.smithi077.stderr:2024-09-15T12:18:36.329+0000 7ff22e688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:36.339 INFO:teuthology.misc.health.smithi077.stderr:2024-09-15T12:18:36.337+0000 7ff22e688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:36.406 INFO:teuthology.misc.health.smithi077.stdout: 2024-09-15T12:18:36.406 INFO:teuthology.misc.health.smithi077.stdout:{"epoch":7,"fsid":"0010d80b-83bc-42b2-8185-928cfe1dc364","created":"2024-09-15T12:18:33.201019+0000","modified":"2024-09-15T12:18:35.315168+0000","last_up_change":"0.000000","last_in_change":"2024-09-15T12:18:35.315168+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"c5c8d66b-d3a4-47b4-ba1f-789441932c0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"349261f9-8426-4182-9f6d-19d1d4d00cfa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"83bafe3c-2087-47d8-a2a1-1d5a1ec34144","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3ec80261-3fac-47d0-a7e5-b49f4289dee8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T12:18:36.417 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-15T12:18:38.706 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-09-15T12:18:38.705+0000 7f2dfc268640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-15T12:18:42.821 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T12:18:42.926 INFO:teuthology.misc.health.smithi077.stderr:2024-09-15T12:18:42.920+0000 7f9db6846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:42.930 INFO:teuthology.misc.health.smithi077.stderr:2024-09-15T12:18:42.929+0000 7f9db6846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:43.185 INFO:teuthology.misc.health.smithi077.stdout: 2024-09-15T12:18:43.185 INFO:teuthology.misc.health.smithi077.stdout:{"epoch":11,"fsid":"0010d80b-83bc-42b2-8185-928cfe1dc364","created":"2024-09-15T12:18:33.201019+0000","modified":"2024-09-15T12:18:42.724999+0000","last_up_change":"2024-09-15T12:18:41.719581+0000","last_in_change":"2024-09-15T12:18:35.315168+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T12:18:41.719481+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5c8d66b-d3a4-47b4-ba1f-789441932c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2693145533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6801","nonce":2693145533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2693145533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6805","nonce":2693145533}]},"public_addr":"172.21.15.77:6800/2693145533","cluster_addr":"172.21.15.77:6801/2693145533","heartbeat_back_addr":"172.21.15.77:6802/2693145533","heartbeat_front_addr":"172.21.15.77:6805/2693145533","state":["exists","up"]},{"osd":1,"uuid":"349261f9-8426-4182-9f6d-19d1d4d00cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2237638298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6803","nonce":2237638298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2237638298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6807","nonce":2237638298}]},"public_addr":"172.21.15.77:6804/2237638298","cluster_addr":"172.21.15.77:6803/2237638298","heartbeat_back_addr":"172.21.15.77:6806/2237638298","heartbeat_front_addr":"172.21.15.77:6807/2237638298","state":["exists","up"]},{"osd":2,"uuid":"83bafe3c-2087-47d8-a2a1-1d5a1ec34144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":2379501345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":2379501345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6805","nonce":2379501345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":2379501345}]},"public_addr":"172.21.15.138:6804/2379501345","cluster_addr":"172.21.15.138:6803/2379501345","heartbeat_back_addr":"172.21.15.138:6805/2379501345","heartbeat_front_addr":"172.21.15.138:6802/2379501345","state":["exists","up"]},{"osd":3,"uuid":"3ec80261-3fac-47d0-a7e5-b49f4289dee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":364329868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":364329868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":364329868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":364329868}]},"public_addr":"172.21.15.138:6810/364329868","cluster_addr":"172.21.15.138:6811/364329868","heartbeat_back_addr":"172.21.15.138:6813/364329868","heartbeat_front_addr":"172.21.15.138:6814/364329868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T12:18:43.197 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-15T12:18:43.197 INFO:tasks.ceph:Creating RBD pool 2024-09-15T12:18:43.197 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-15T12:18:43.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:43.300+0000 7f1b9bb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:43.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:43.312+0000 7f1b9bb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:43.733 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'rbd' created 2024-09-15T12:18:43.754 DEBUG:teuthology.orchestra.run.smithi077:> rbd --cluster ceph pool init rbd 2024-09-15T12:18:43.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:43.856+0000 7f2bde083ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:43.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:43.857+0000 7f2bde083ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:43.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:43.861+0000 7f2bde083ac0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:46.789 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-15T12:18:46.790 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-15T12:18:46.790 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-15T12:18:46.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:46.894+0000 7fc7a5088640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:46.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:46.903+0000 7fc7a5088640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:47.091 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:47.104 INFO:teuthology.orchestra.run.smithi077.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2024-09-15T12:18:47.105 INFO:tasks.ceph_manager:config epoch is 1 2024-09-15T12:18:47.105 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-15T12:18:47.105 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-15T12:18:47.105 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-15T12:18:47.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:47.209+0000 7fb4e9d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:47.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:47.216+0000 7fb4e9d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:47.450 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:47.463 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":500183731},{"type":"v1","addr":"172.21.15.138:6801","nonce":500183731}]},"active_addr":"172.21.15.138:6801/500183731","active_change":"2024-09-15T12:18:37.695612+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":3484682992}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":3093564670}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":1732880726}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":976751505}]}]} 2024-09-15T12:18:47.465 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-15T12:18:47.465 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-15T12:18:47.465 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T12:18:47.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:47.568+0000 7fcb53d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:47.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:47.575+0000 7fcb53d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:47.763 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:47.763 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":15,"fsid":"0010d80b-83bc-42b2-8185-928cfe1dc364","created":"2024-09-15T12:18:33.201019+0000","modified":"2024-09-15T12:18:46.746932+0000","last_up_change":"2024-09-15T12:18:41.719581+0000","last_in_change":"2024-09-15T12:18:35.315168+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T12:18:41.719481+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-15T12:18:43.510888+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5c8d66b-d3a4-47b4-ba1f-789441932c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2693145533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6801","nonce":2693145533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2693145533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6805","nonce":2693145533}]},"public_addr":"172.21.15.77:6800/2693145533","cluster_addr":"172.21.15.77:6801/2693145533","heartbeat_back_addr":"172.21.15.77:6802/2693145533","heartbeat_front_addr":"172.21.15.77:6805/2693145533","state":["exists","up"]},{"osd":1,"uuid":"349261f9-8426-4182-9f6d-19d1d4d00cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2237638298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6803","nonce":2237638298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2237638298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6807","nonce":2237638298}]},"public_addr":"172.21.15.77:6804/2237638298","cluster_addr":"172.21.15.77:6803/2237638298","heartbeat_back_addr":"172.21.15.77:6806/2237638298","heartbeat_front_addr":"172.21.15.77:6807/2237638298","state":["exists","up"]},{"osd":2,"uuid":"83bafe3c-2087-47d8-a2a1-1d5a1ec34144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":2379501345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":2379501345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6805","nonce":2379501345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":2379501345}]},"public_addr":"172.21.15.138:6804/2379501345","cluster_addr":"172.21.15.138:6803/2379501345","heartbeat_back_addr":"172.21.15.138:6805/2379501345","heartbeat_front_addr":"172.21.15.138:6802/2379501345","state":["exists","up"]},{"osd":3,"uuid":"3ec80261-3fac-47d0-a7e5-b49f4289dee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":364329868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":364329868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":364329868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":364329868}]},"public_addr":"172.21.15.138:6810/364329868","cluster_addr":"172.21.15.138:6811/364329868","heartbeat_back_addr":"172.21.15.138:6813/364329868","heartbeat_front_addr":"172.21.15.138:6814/364329868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T12:18:47.776 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-15T12:18:47.776 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T12:18:47.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:47.878+0000 7f2139351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:47.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:47.886+0000 7f2139351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:48.073 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:48.073 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":15,"fsid":"0010d80b-83bc-42b2-8185-928cfe1dc364","created":"2024-09-15T12:18:33.201019+0000","modified":"2024-09-15T12:18:46.746932+0000","last_up_change":"2024-09-15T12:18:41.719581+0000","last_in_change":"2024-09-15T12:18:35.315168+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T12:18:41.719481+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-15T12:18:43.510888+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5c8d66b-d3a4-47b4-ba1f-789441932c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2693145533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6801","nonce":2693145533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2693145533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6805","nonce":2693145533}]},"public_addr":"172.21.15.77:6800/2693145533","cluster_addr":"172.21.15.77:6801/2693145533","heartbeat_back_addr":"172.21.15.77:6802/2693145533","heartbeat_front_addr":"172.21.15.77:6805/2693145533","state":["exists","up"]},{"osd":1,"uuid":"349261f9-8426-4182-9f6d-19d1d4d00cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2237638298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6803","nonce":2237638298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2237638298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6807","nonce":2237638298}]},"public_addr":"172.21.15.77:6804/2237638298","cluster_addr":"172.21.15.77:6803/2237638298","heartbeat_back_addr":"172.21.15.77:6806/2237638298","heartbeat_front_addr":"172.21.15.77:6807/2237638298","state":["exists","up"]},{"osd":2,"uuid":"83bafe3c-2087-47d8-a2a1-1d5a1ec34144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":2379501345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":2379501345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6805","nonce":2379501345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":2379501345}]},"public_addr":"172.21.15.138:6804/2379501345","cluster_addr":"172.21.15.138:6803/2379501345","heartbeat_back_addr":"172.21.15.138:6805/2379501345","heartbeat_front_addr":"172.21.15.138:6802/2379501345","state":["exists","up"]},{"osd":3,"uuid":"3ec80261-3fac-47d0-a7e5-b49f4289dee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":364329868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":364329868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":364329868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":364329868}]},"public_addr":"172.21.15.138:6810/364329868","cluster_addr":"172.21.15.138:6811/364329868","heartbeat_back_addr":"172.21.15.138:6813/364329868","heartbeat_front_addr":"172.21.15.138:6814/364329868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T12:18:48.086 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-15T12:18:48.087 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-15T12:18:48.087 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-15T12:18:48.087 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-15T12:18:48.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:48.199+0000 7fbf52ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:48.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:48.199+0000 7f47b0748640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:48.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:48.199+0000 7f3884d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:48.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:48.199+0000 7f11aaad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:48.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:48.209+0000 7f47b0748640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:48.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:48.209+0000 7f3884d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:48.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:48.209+0000 7fbf52ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:48.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:48.209+0000 7f11aaad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:48.244 INFO:teuthology.orchestra.run.smithi077.stdout:38654705671 2024-09-15T12:18:48.244 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-15T12:18:48.245 INFO:teuthology.orchestra.run.smithi077.stdout:38654705671 2024-09-15T12:18:48.245 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-15T12:18:48.246 INFO:teuthology.orchestra.run.smithi077.stdout:42949672966 2024-09-15T12:18:48.247 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-15T12:18:48.247 INFO:teuthology.orchestra.run.smithi077.stdout:38654705671 2024-09-15T12:18:48.248 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-15T12:18:48.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:48.356+0000 7f8284708640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:48.371 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:48.370+0000 7f8284708640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:48.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:48.398+0000 7fab19751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:48.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:48.400+0000 7f7348991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:48.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:48.401+0000 7f53438bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:48.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:48.410+0000 7f7348991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:48.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:48.410+0000 7fab19751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:48.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:48.411+0000 7f53438bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:48.578 INFO:teuthology.orchestra.run.smithi077.stdout:38654705671 2024-09-15T12:18:48.591 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.0 2024-09-15T12:18:48.592 DEBUG:teuthology.parallel:result is None 2024-09-15T12:18:48.623 INFO:teuthology.orchestra.run.smithi077.stdout:38654705671 2024-09-15T12:18:48.626 INFO:teuthology.orchestra.run.smithi077.stdout:38654705671 2024-09-15T12:18:48.631 INFO:teuthology.orchestra.run.smithi077.stdout:42949672966 2024-09-15T12:18:48.637 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.2 2024-09-15T12:18:48.638 DEBUG:teuthology.parallel:result is None 2024-09-15T12:18:48.640 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.1 2024-09-15T12:18:48.640 DEBUG:teuthology.parallel:result is None 2024-09-15T12:18:48.645 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.3 2024-09-15T12:18:48.645 DEBUG:teuthology.parallel:result is None 2024-09-15T12:18:48.646 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T12:18:48.646 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:18:48.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:48.791+0000 7fa32d8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:48.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:48.798+0000 7fa32d8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:48.987 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:48.988 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:18:49.000 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-15T12:18:48.231112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108048,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379312,"statfs":{"total":386547056640,"available":386436415488,"internally_reserved":0,"allocated":704512,"data_stored":1907549,"data_compressed":90096,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.765151+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:18:46.765151+0000","last_peered":"2024-09-15T12:18:46.765151+0000","last_clean":"2024-09-15T12:18:46.765151+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:18:46.765151+0000","last_undegraded":"2024-09-15T12:18:46.765151+0000","last_fullsized":"2024-09-15T12:18:46.765151+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.764197+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:18:46.764197+0000","last_peered":"2024-09-15T12:18:46.764197+0000","last_clean":"2024-09-15T12:18:46.764197+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:18:46.764197+0000","last_undegraded":"2024-09-15T12:18:46.764197+0000","last_fullsized":"2024-09-15T12:18:46.764197+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.768342+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:18:46.768342+0000","last_peered":"2024-09-15T12:18:46.768342+0000","last_clean":"2024-09-15T12:18:46.768342+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:18:46.768342+0000","last_undegraded":"2024-09-15T12:18:46.768342+0000","last_fullsized":"2024-09-15T12:18:46.768342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.764185+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:18:46.764185+0000","last_peered":"2024-09-15T12:18:46.764185+0000","last_clean":"2024-09-15T12:18:46.764185+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:18:46.764185+0000","last_undegraded":"2024-09-15T12:18:46.764185+0000","last_fullsized":"2024-09-15T12:18:46.764185+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.765125+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:18:46.765125+0000","last_peered":"2024-09-15T12:18:46.765125+0000","last_clean":"2024-09-15T12:18:46.765125+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:18:46.765125+0000","last_undegraded":"2024-09-15T12:18:46.765125+0000","last_fullsized":"2024-09-15T12:18:46.765125+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.761050+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:18:46.761050+0000","last_peered":"2024-09-15T12:18:46.761050+0000","last_clean":"2024-09-15T12:18:46.761050+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:18:46.761050+0000","last_undegraded":"2024-09-15T12:18:46.761050+0000","last_fullsized":"2024-09-15T12:18:46.761050+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.767335+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:18:46.767335+0000","last_peered":"2024-09-15T12:18:46.767335+0000","last_clean":"2024-09-15T12:18:46.767335+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:18:46.767335+0000","last_undegraded":"2024-09-15T12:18:46.767335+0000","last_fullsized":"2024-09-15T12:18:46.767335+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.767072+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:18:46.767072+0000","last_peered":"2024-09-15T12:18:46.767072+0000","last_clean":"2024-09-15T12:18:46.767072+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:18:46.767072+0000","last_undegraded":"2024-09-15T12:18:46.767072+0000","last_fullsized":"2024-09-15T12:18:46.767072+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":88,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.764571+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:18:46.764571+0000","last_peered":"2024-09-15T12:18:46.764571+0000","last_clean":"2024-09-15T12:18:46.764571+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:18:46.764571+0000","last_undegraded":"2024-09-15T12:18:46.764571+0000","last_fullsized":"2024-09-15T12:18:46.764571+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27016,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344824,"statfs":{"total":96636764160,"available":96609099776,"internally_reserved":0,"allocated":188416,"data_stored":624465,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":624484,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26960,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344880,"statfs":{"total":96636764160,"available":96609157120,"internally_reserved":0,"allocated":131072,"data_stored":34116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":624484,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:18:49.001 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:18:49.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:49.104+0000 7feb710fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:49.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:49.111+0000 7feb710fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:49.296 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:49.296 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:18:49.309 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-15T12:18:48.231112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108048,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379312,"statfs":{"total":386547056640,"available":386436415488,"internally_reserved":0,"allocated":704512,"data_stored":1907549,"data_compressed":90096,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.765151+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:18:46.765151+0000","last_peered":"2024-09-15T12:18:46.765151+0000","last_clean":"2024-09-15T12:18:46.765151+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:18:46.765151+0000","last_undegraded":"2024-09-15T12:18:46.765151+0000","last_fullsized":"2024-09-15T12:18:46.765151+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.764197+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:18:46.764197+0000","last_peered":"2024-09-15T12:18:46.764197+0000","last_clean":"2024-09-15T12:18:46.764197+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:18:46.764197+0000","last_undegraded":"2024-09-15T12:18:46.764197+0000","last_fullsized":"2024-09-15T12:18:46.764197+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.768342+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:18:46.768342+0000","last_peered":"2024-09-15T12:18:46.768342+0000","last_clean":"2024-09-15T12:18:46.768342+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:18:46.768342+0000","last_undegraded":"2024-09-15T12:18:46.768342+0000","last_fullsized":"2024-09-15T12:18:46.768342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.764185+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:18:46.764185+0000","last_peered":"2024-09-15T12:18:46.764185+0000","last_clean":"2024-09-15T12:18:46.764185+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:18:46.764185+0000","last_undegraded":"2024-09-15T12:18:46.764185+0000","last_fullsized":"2024-09-15T12:18:46.764185+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.765125+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:18:46.765125+0000","last_peered":"2024-09-15T12:18:46.765125+0000","last_clean":"2024-09-15T12:18:46.765125+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:18:46.765125+0000","last_undegraded":"2024-09-15T12:18:46.765125+0000","last_fullsized":"2024-09-15T12:18:46.765125+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.761050+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:18:46.761050+0000","last_peered":"2024-09-15T12:18:46.761050+0000","last_clean":"2024-09-15T12:18:46.761050+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:18:46.761050+0000","last_undegraded":"2024-09-15T12:18:46.761050+0000","last_fullsized":"2024-09-15T12:18:46.761050+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.767335+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:18:46.767335+0000","last_peered":"2024-09-15T12:18:46.767335+0000","last_clean":"2024-09-15T12:18:46.767335+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:18:46.767335+0000","last_undegraded":"2024-09-15T12:18:46.767335+0000","last_fullsized":"2024-09-15T12:18:46.767335+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.767072+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:18:46.767072+0000","last_peered":"2024-09-15T12:18:46.767072+0000","last_clean":"2024-09-15T12:18:46.767072+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:18:46.767072+0000","last_undegraded":"2024-09-15T12:18:46.767072+0000","last_fullsized":"2024-09-15T12:18:46.767072+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":88,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.764571+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:18:46.764571+0000","last_peered":"2024-09-15T12:18:46.764571+0000","last_clean":"2024-09-15T12:18:46.764571+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:18:46.764571+0000","last_undegraded":"2024-09-15T12:18:46.764571+0000","last_fullsized":"2024-09-15T12:18:46.764571+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27016,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344824,"statfs":{"total":96636764160,"available":96609099776,"internally_reserved":0,"allocated":188416,"data_stored":624465,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":624484,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26960,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344880,"statfs":{"total":96636764160,"available":96609157120,"internally_reserved":0,"allocated":131072,"data_stored":34116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":624484,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:18:49.310 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T12:18:49.310 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-15T12:18:49.310 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-15T12:18:49.310 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-15T12:18:49.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:49.414+0000 7f5eff951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:49.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:49.420+0000 7f5eff951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:49.643 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:49.643 INFO:teuthology.orchestra.run.smithi077.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-15T12:18:49.656 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-15T12:18:49.656 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-15T12:18:49.666 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_down': 0, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 3, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-15T12:18:49.667 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-matanb-crimson-testing-59543'}, 'ceph': {'conf': {'client.0': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr stats period': 30}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '81fedcb3b484c843d22ffbc8d179cb567b7083b5'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'main', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779'}} 2024-09-15T12:18:49.667 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_down': 0, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 4, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-15T12:18:49.667 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-15T12:18:49.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:49.771+0000 7f36d0191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:49.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:49.782+0000 7f36d0191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:49.986 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-15T12:18:49.986 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T12:18:49.987 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:18:50.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:50.089+0000 7f2c59391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:50.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:50.097+0000 7f2c59391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:50.285 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:50.285 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:18:50.298 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2024-09-15T12:18:49.703389+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108048,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379312,"statfs":{"total":386547056640,"available":386436415488,"internally_reserved":0,"allocated":704512,"data_stored":1907549,"data_compressed":90096,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.472276"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.765151+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:18:46.765151+0000","last_peered":"2024-09-15T12:18:46.765151+0000","last_clean":"2024-09-15T12:18:46.765151+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:18:46.765151+0000","last_undegraded":"2024-09-15T12:18:46.765151+0000","last_fullsized":"2024-09-15T12:18:46.765151+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.764197+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:18:46.764197+0000","last_peered":"2024-09-15T12:18:46.764197+0000","last_clean":"2024-09-15T12:18:46.764197+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:18:46.764197+0000","last_undegraded":"2024-09-15T12:18:46.764197+0000","last_fullsized":"2024-09-15T12:18:46.764197+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.768342+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:18:46.768342+0000","last_peered":"2024-09-15T12:18:46.768342+0000","last_clean":"2024-09-15T12:18:46.768342+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:18:46.768342+0000","last_undegraded":"2024-09-15T12:18:46.768342+0000","last_fullsized":"2024-09-15T12:18:46.768342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.764185+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:18:46.764185+0000","last_peered":"2024-09-15T12:18:46.764185+0000","last_clean":"2024-09-15T12:18:46.764185+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:18:46.764185+0000","last_undegraded":"2024-09-15T12:18:46.764185+0000","last_fullsized":"2024-09-15T12:18:46.764185+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.765125+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:18:46.765125+0000","last_peered":"2024-09-15T12:18:46.765125+0000","last_clean":"2024-09-15T12:18:46.765125+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:18:46.765125+0000","last_undegraded":"2024-09-15T12:18:46.765125+0000","last_fullsized":"2024-09-15T12:18:46.765125+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.761050+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:18:46.761050+0000","last_peered":"2024-09-15T12:18:46.761050+0000","last_clean":"2024-09-15T12:18:46.761050+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:18:46.761050+0000","last_undegraded":"2024-09-15T12:18:46.761050+0000","last_fullsized":"2024-09-15T12:18:46.761050+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.767335+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:18:46.767335+0000","last_peered":"2024-09-15T12:18:46.767335+0000","last_clean":"2024-09-15T12:18:46.767335+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:18:46.767335+0000","last_undegraded":"2024-09-15T12:18:46.767335+0000","last_fullsized":"2024-09-15T12:18:46.767335+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.767072+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:18:46.767072+0000","last_peered":"2024-09-15T12:18:46.767072+0000","last_clean":"2024-09-15T12:18:46.767072+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:18:46.767072+0000","last_undegraded":"2024-09-15T12:18:46.767072+0000","last_fullsized":"2024-09-15T12:18:46.767072+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":88,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.764571+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:18:46.764571+0000","last_peered":"2024-09-15T12:18:46.764571+0000","last_clean":"2024-09-15T12:18:46.764571+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:18:46.764571+0000","last_undegraded":"2024-09-15T12:18:46.764571+0000","last_fullsized":"2024-09-15T12:18:46.764571+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27016,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344824,"statfs":{"total":96636764160,"available":96609099776,"internally_reserved":0,"allocated":188416,"data_stored":624465,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":624484,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26960,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344880,"statfs":{"total":96636764160,"available":96609157120,"internally_reserved":0,"allocated":131072,"data_stored":34116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":624484,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:18:50.299 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:18:50.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:50.401+0000 7fc973f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:50.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:50.409+0000 7fc973f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:50.593 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:18:50.594 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:18:50.606 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2024-09-15T12:18:49.703389+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108048,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379312,"statfs":{"total":386547056640,"available":386436415488,"internally_reserved":0,"allocated":704512,"data_stored":1907549,"data_compressed":90096,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.472276"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.765151+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:18:46.765151+0000","last_peered":"2024-09-15T12:18:46.765151+0000","last_clean":"2024-09-15T12:18:46.765151+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:18:46.765151+0000","last_undegraded":"2024-09-15T12:18:46.765151+0000","last_fullsized":"2024-09-15T12:18:46.765151+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.764197+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:18:46.764197+0000","last_peered":"2024-09-15T12:18:46.764197+0000","last_clean":"2024-09-15T12:18:46.764197+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:18:46.764197+0000","last_undegraded":"2024-09-15T12:18:46.764197+0000","last_fullsized":"2024-09-15T12:18:46.764197+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.768342+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:18:46.768342+0000","last_peered":"2024-09-15T12:18:46.768342+0000","last_clean":"2024-09-15T12:18:46.768342+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:18:46.768342+0000","last_undegraded":"2024-09-15T12:18:46.768342+0000","last_fullsized":"2024-09-15T12:18:46.768342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.764185+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:18:46.764185+0000","last_peered":"2024-09-15T12:18:46.764185+0000","last_clean":"2024-09-15T12:18:46.764185+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:18:46.764185+0000","last_undegraded":"2024-09-15T12:18:46.764185+0000","last_fullsized":"2024-09-15T12:18:46.764185+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.765125+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:18:46.765125+0000","last_peered":"2024-09-15T12:18:46.765125+0000","last_clean":"2024-09-15T12:18:46.765125+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:18:46.765125+0000","last_undegraded":"2024-09-15T12:18:46.765125+0000","last_fullsized":"2024-09-15T12:18:46.765125+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.761050+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:18:46.761050+0000","last_peered":"2024-09-15T12:18:46.761050+0000","last_clean":"2024-09-15T12:18:46.761050+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:18:46.761050+0000","last_undegraded":"2024-09-15T12:18:46.761050+0000","last_fullsized":"2024-09-15T12:18:46.761050+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.767335+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:18:46.767335+0000","last_peered":"2024-09-15T12:18:46.767335+0000","last_clean":"2024-09-15T12:18:46.767335+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:18:46.767335+0000","last_undegraded":"2024-09-15T12:18:46.767335+0000","last_fullsized":"2024-09-15T12:18:46.767335+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.767072+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:18:46.767072+0000","last_peered":"2024-09-15T12:18:46.767072+0000","last_clean":"2024-09-15T12:18:46.767072+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:18:46.767072+0000","last_undegraded":"2024-09-15T12:18:46.767072+0000","last_fullsized":"2024-09-15T12:18:46.767072+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":88,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.764571+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:18:46.764571+0000","last_peered":"2024-09-15T12:18:46.764571+0000","last_clean":"2024-09-15T12:18:46.764571+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:18:46.764571+0000","last_undegraded":"2024-09-15T12:18:46.764571+0000","last_fullsized":"2024-09-15T12:18:46.764571+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27016,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344824,"statfs":{"total":96636764160,"available":96609099776,"internally_reserved":0,"allocated":188416,"data_stored":624465,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":624484,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26960,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344880,"statfs":{"total":96636764160,"available":96609157120,"internally_reserved":0,"allocated":131072,"data_stored":34116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":624484,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:18:50.606 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T12:18:50.607 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-15T12:18:50.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:50.709+0000 7fd5ef391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:50.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:50.716+0000 7fd5ef391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:50.904 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 15 2024-09-15T12:18:50.905 INFO:teuthology.orchestra.run.smithi077.stdout:fsid 0010d80b-83bc-42b2-8185-928cfe1dc364 2024-09-15T12:18:50.905 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-09-15T12:18:33.201019+0000 2024-09-15T12:18:50.905 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-09-15T12:18:46.746932+0000 2024-09-15T12:18:50.905 INFO:teuthology.orchestra.run.smithi077.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-15T12:18:50.905 INFO:teuthology.orchestra.run.smithi077.stdout:crush_version 4 2024-09-15T12:18:50.905 INFO:teuthology.orchestra.run.smithi077.stdout:full_ratio 0.95 2024-09-15T12:18:50.905 INFO:teuthology.orchestra.run.smithi077.stdout:backfillfull_ratio 0.9 2024-09-15T12:18:50.905 INFO:teuthology.orchestra.run.smithi077.stdout:nearfull_ratio 0.85 2024-09-15T12:18:50.905 INFO:teuthology.orchestra.run.smithi077.stdout:require_min_compat_client luminous 2024-09-15T12:18:50.905 INFO:teuthology.orchestra.run.smithi077.stdout:min_compat_client jewel 2024-09-15T12:18:50.905 INFO:teuthology.orchestra.run.smithi077.stdout:require_osd_release squid 2024-09-15T12:18:50.905 INFO:teuthology.orchestra.run.smithi077.stdout:stretch_mode_enabled false 2024-09-15T12:18:50.906 INFO:teuthology.orchestra.run.smithi077.stdout:allow_crimson=true 2024-09-15T12:18:50.906 INFO:teuthology.orchestra.run.smithi077.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 12 flags hashpspool,nopgchange,crimson stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 4.00 2024-09-15T12:18:50.906 INFO:teuthology.orchestra.run.smithi077.stdout:pool 2 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 15 flags hashpspool,nopgchange,selfmanaged_snaps,crimson stripe_width 0 application rbd read_balance_score 1.50 2024-09-15T12:18:50.906 INFO:teuthology.orchestra.run.smithi077.stdout: removed_snaps_queue [2~1] 2024-09-15T12:18:50.906 INFO:teuthology.orchestra.run.smithi077.stdout:max_osd 4 2024-09-15T12:18:50.906 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 up in weight 1 up_from 9 up_thru 12 down_at 0 last_clean_interval [0,0) v2:172.21.15.77:6800/2693145533 v2:172.21.15.77:6801/2693145533 exists,up c5c8d66b-d3a4-47b4-ba1f-789441932c0e 2024-09-15T12:18:50.906 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 up in weight 1 up_from 9 up_thru 12 down_at 0 last_clean_interval [0,0) v2:172.21.15.77:6804/2237638298 v2:172.21.15.77:6803/2237638298 exists,up 349261f9-8426-4182-9f6d-19d1d4d00cfa 2024-09-15T12:18:50.906 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 up in weight 1 up_from 9 up_thru 12 down_at 0 last_clean_interval [0,0) v2:172.21.15.138:6804/2379501345 v2:172.21.15.138:6803/2379501345 exists,up 83bafe3c-2087-47d8-a2a1-1d5a1ec34144 2024-09-15T12:18:50.906 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 up in weight 1 up_from 10 up_thru 12 down_at 0 last_clean_interval [0,0) v2:172.21.15.138:6810/364329868 v2:172.21.15.138:6811/364329868 exists,up 3ec80261-3fac-47d0-a7e5-b49f4289dee8 2024-09-15T12:18:50.918 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 9 up_thru 12 down_at 0 last_clean_interval [0,0) v2:172.21.15.77:6800/2693145533 v2:172.21.15.77:6801/2693145533 exists,up c5c8d66b-d3a4-47b4-ba1f-789441932c0e', 'osd.1 up in weight 1 up_from 9 up_thru 12 down_at 0 last_clean_interval [0,0) v2:172.21.15.77:6804/2237638298 v2:172.21.15.77:6803/2237638298 exists,up 349261f9-8426-4182-9f6d-19d1d4d00cfa', 'osd.2 up in weight 1 up_from 9 up_thru 12 down_at 0 last_clean_interval [0,0) v2:172.21.15.138:6804/2379501345 v2:172.21.15.138:6803/2379501345 exists,up 83bafe3c-2087-47d8-a2a1-1d5a1ec34144', 'osd.3 up in weight 1 up_from 10 up_thru 12 down_at 0 last_clean_interval [0,0) v2:172.21.15.138:6810/364329868 v2:172.21.15.138:6811/364329868 exists,up 3ec80261-3fac-47d0-a7e5-b49f4289dee8'] 2024-09-15T12:18:50.918 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-15T12:18:51.023 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T12:18:51.024 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "mon.a", 2024-09-15T12:18:51.024 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster": "ceph", 2024-09-15T12:18:51.024 INFO:teuthology.orchestra.run.smithi077.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-15T12:18:51.024 INFO:teuthology.orchestra.run.smithi077.stdout: "admin_socket_mode": "", 2024-09-15T12:18:51.024 INFO:teuthology.orchestra.run.smithi077.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-15T12:18:51.024 INFO:teuthology.orchestra.run.smithi077.stdout: "auth_client_required": "cephx, none", 2024-09-15T12:18:51.024 INFO:teuthology.orchestra.run.smithi077.stdout: "auth_cluster_required": "cephx", 2024-09-15T12:18:51.024 INFO:teuthology.orchestra.run.smithi077.stdout: "auth_debug": "true", 2024-09-15T12:18:51.024 INFO:teuthology.orchestra.run.smithi077.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-15T12:18:51.024 INFO:teuthology.orchestra.run.smithi077.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-15T12:18:51.024 INFO:teuthology.orchestra.run.smithi077.stdout: "auth_service_required": "cephx", 2024-09-15T12:18:51.024 INFO:teuthology.orchestra.run.smithi077.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-15T12:18:51.025 INFO:teuthology.orchestra.run.smithi077.stdout: "auth_supported": "cephx", 2024-09-15T12:18:51.025 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_aio": "true", 2024-09-15T12:18:51.025 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-15T12:18:51.025 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_aio_poll_ms": "250", 2024-09-15T12:18:51.025 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_aio_reap_max": "16", 2024-09-15T12:18:51.025 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_async_discard_threads": "0", 2024-09-15T12:18:51.025 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_block_size": "4096", 2024-09-15T12:18:51.025 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_debug_aio": "false", 2024-09-15T12:18:51.025 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-15T12:18:51.025 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-15T12:18:51.025 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_debug_inflight_ios": "false", 2024-09-15T12:18:51.025 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_enable_discard": "false", 2024-09-15T12:18:51.025 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_flock_retry": "3", 2024-09-15T12:18:51.025 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-15T12:18:51.025 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_inject_crash": "0", 2024-09-15T12:18:51.026 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-15T12:18:51.026 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_ioring": "false", 2024-09-15T12:18:51.026 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_ioring_hipri": "false", 2024-09-15T12:18:51.026 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-15T12:18:51.026 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-15T12:18:51.026 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-15T12:18:51.026 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-15T12:18:51.026 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-15T12:18:51.026 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-15T12:18:51.026 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_type": "", 2024-09-15T12:18:51.026 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_alloc_size": "1048576", 2024-09-15T12:18:51.026 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_allocator": "hybrid", 2024-09-15T12:18:51.026 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_buffered_io": "true", 2024-09-15T12:18:51.026 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_check_for_zeros": "false", 2024-09-15T12:18:51.026 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-15T12:18:51.027 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-15T12:18:51.027 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_compact_log_sync": "false", 2024-09-15T12:18:51.027 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-15T12:18:51.027 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-15T12:18:51.027 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-15T12:18:51.027 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-15T12:18:51.027 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_max_log_runway": "4194304", 2024-09-15T12:18:51.027 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_max_prefetch": "1048576", 2024-09-15T12:18:51.027 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_min_flush_size": "524288", 2024-09-15T12:18:51.027 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_min_log_runway": "1048576", 2024-09-15T12:18:51.027 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_replay_recovery": "false", 2024-09-15T12:18:51.027 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-15T12:18:51.027 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-15T12:18:51.027 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_sync_write": "false", 2024-09-15T12:18:51.027 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-15T12:18:51.028 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-15T12:18:51.028 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-15T12:18:51.028 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_allocation_from_file": "true", 2024-09-15T12:18:51.028 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_allocator": "hybrid", 2024-09-15T12:18:51.028 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_async_db_compaction": "true", 2024-09-15T12:18:51.028 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-15T12:18:51.028 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-15T12:18:51.028 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-15T12:18:51.028 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-15T12:18:51.028 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_bdev_label_multi": "true", 2024-09-15T12:18:51.028 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-15T12:18:51.028 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-15T12:18:51.028 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-15T12:18:51.028 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-15T12:18:51.028 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-15T12:18:51.029 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_block_create": "true", 2024-09-15T12:18:51.029 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_block_db_create": "false", 2024-09-15T12:18:51.029 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_block_db_path": "", 2024-09-15T12:18:51.029 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_block_db_size": "0", 2024-09-15T12:18:51.029 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_block_path": "", 2024-09-15T12:18:51.029 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_block_preallocate_file": "false", 2024-09-15T12:18:51.029 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_block_size": "107374182400", 2024-09-15T12:18:51.029 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_block_wal_create": "false", 2024-09-15T12:18:51.029 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_block_wal_path": "", 2024-09-15T12:18:51.029 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_block_wal_size": "100663296", 2024-09-15T12:18:51.029 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_bluefs": "true", 2024-09-15T12:18:51.029 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-15T12:18:51.029 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-15T12:18:51.029 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-15T12:18:51.029 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2024-09-15T12:18:51.030 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-15T12:18:51.030 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-15T12:18:51.030 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-15T12:18:51.030 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-15T12:18:51.030 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-15T12:18:51.030 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_autotune": "true", 2024-09-15T12:18:51.030 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-15T12:18:51.030 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-15T12:18:51.030 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-15T12:18:51.030 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-15T12:18:51.030 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_size": "0", 2024-09-15T12:18:51.030 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-15T12:18:51.030 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-15T12:18:51.030 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-15T12:18:51.031 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-15T12:18:51.031 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_type": "2q", 2024-09-15T12:18:51.031 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-15T12:18:51.031 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_clone_cow": "true", 2024-09-15T12:18:51.031 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-15T12:18:51.031 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-15T12:18:51.031 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-15T12:18:51.031 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-15T12:18:51.031 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-15T12:18:51.031 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-15T12:18:51.031 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-15T12:18:51.031 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_compression_mode": "none", 2024-09-15T12:18:51.031 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-15T12:18:51.031 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_csum_type": "crc32c", 2024-09-15T12:18:51.032 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-09-15T12:18:51.032 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-15T12:18:51.032 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_debug_freelist": "false", 2024-09-15T12:18:51.032 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-15T12:18:51.032 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-15T12:18:51.032 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-15T12:18:51.032 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-15T12:18:51.032 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-15T12:18:51.032 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-15T12:18:51.032 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-15T12:18:51.032 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-15T12:18:51.032 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-15T12:18:51.032 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-15T12:18:51.033 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-15T12:18:51.033 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-15T12:18:51.033 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_debug_small_allocations": "0", 2024-09-15T12:18:51.033 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-15T12:18:51.033 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_default_buffered_read": "true", 2024-09-15T12:18:51.033 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_default_buffered_write": "false", 2024-09-15T12:18:51.033 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-15T12:18:51.033 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-15T12:18:51.033 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-15T12:18:51.033 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-15T12:18:51.033 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-15T12:18:51.033 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-15T12:18:51.033 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-15T12:18:51.033 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-15T12:18:51.034 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-15T12:18:51.034 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fail_eio": "false", 2024-09-15T12:18:51.034 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-15T12:18:51.034 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-15T12:18:51.034 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-15T12:18:51.034 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-15T12:18:51.034 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-15T12:18:51.034 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-15T12:18:51.034 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_on_mount": "false", 2024-09-15T12:18:51.034 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-15T12:18:51.034 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_on_umount": "false", 2024-09-15T12:18:51.034 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-15T12:18:51.034 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-15T12:18:51.034 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-15T12:18:51.035 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-15T12:18:51.035 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-15T12:18:51.035 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-15T12:18:51.035 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-15T12:18:51.035 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-15T12:18:51.035 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_ignore_data_csum": "false", 2024-09-15T12:18:51.035 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-15T12:18:51.035 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-15T12:18:51.035 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-15T12:18:51.035 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-15T12:18:51.035 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_log_op_age": "5.000000", 2024-09-15T12:18:51.035 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_max_alloc_size": "0", 2024-09-15T12:18:51.035 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_max_blob_size": "0", 2024-09-15T12:18:51.035 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-15T12:18:51.035 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-15T12:18:51.036 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-15T12:18:51.036 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_max_deferred_txc": "32", 2024-09-15T12:18:51.036 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_min_alloc_size": "0", 2024-09-15T12:18:51.036 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-15T12:18:51.036 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-15T12:18:51.036 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_nid_prealloc": "1024", 2024-09-15T12:18:51.036 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-15T12:18:51.036 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-15T12:18:51.036 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-15T12:18:51.036 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-15T12:18:51.036 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_retry_disk_reads": "3", 2024-09-15T12:18:51.036 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_rocksdb_cf": "true", 2024-09-15T12:18:51.036 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-15T12:18:51.036 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-15T12:18:51.037 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-15T12:18:51.037 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-15T12:18:51.037 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-15T12:18:51.037 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-15T12:18:51.037 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-15T12:18:51.037 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-15T12:18:51.037 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_spdk_mem": "512", 2024-09-15T12:18:51.037 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-15T12:18:51.037 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-15T12:18:51.037 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-15T12:18:51.037 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-15T12:18:51.037 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-15T12:18:51.037 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-15T12:18:51.038 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-15T12:18:51.038 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_tracing": "false", 2024-09-15T12:18:51.038 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-15T12:18:51.038 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-15T12:18:51.038 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-15T12:18:51.038 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-15T12:18:51.038 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-15T12:18:51.038 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-15T12:18:51.038 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-15T12:18:51.038 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-15T12:18:51.038 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-15T12:18:51.038 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_write_v2": "false", 2024-09-15T12:18:51.038 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_write_v2_random": "false", 2024-09-15T12:18:51.038 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_zero_block_detection": "false", 2024-09-15T12:18:51.039 INFO:teuthology.orchestra.run.smithi077.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-15T12:18:51.039 INFO:teuthology.orchestra.run.smithi077.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-15T12:18:51.039 INFO:teuthology.orchestra.run.smithi077.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-15T12:18:51.039 INFO:teuthology.orchestra.run.smithi077.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-15T12:18:51.039 INFO:teuthology.orchestra.run.smithi077.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-15T12:18:51.039 INFO:teuthology.orchestra.run.smithi077.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-15T12:18:51.039 INFO:teuthology.orchestra.run.smithi077.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-15T12:18:51.039 INFO:teuthology.orchestra.run.smithi077.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-15T12:18:51.039 INFO:teuthology.orchestra.run.smithi077.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-15T12:18:51.039 INFO:teuthology.orchestra.run.smithi077.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-15T12:18:51.039 INFO:teuthology.orchestra.run.smithi077.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-15T12:18:51.039 INFO:teuthology.orchestra.run.smithi077.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-15T12:18:51.039 INFO:teuthology.orchestra.run.smithi077.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-15T12:18:51.039 INFO:teuthology.orchestra.run.smithi077.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-15T12:18:51.039 INFO:teuthology.orchestra.run.smithi077.stdout: "cephx_cluster_require_signatures": "false", 2024-09-15T12:18:51.040 INFO:teuthology.orchestra.run.smithi077.stdout: "cephx_cluster_require_version": "2", 2024-09-15T12:18:51.040 INFO:teuthology.orchestra.run.smithi077.stdout: "cephx_require_signatures": "false", 2024-09-15T12:18:51.040 INFO:teuthology.orchestra.run.smithi077.stdout: "cephx_require_version": "2", 2024-09-15T12:18:51.040 INFO:teuthology.orchestra.run.smithi077.stdout: "cephx_service_require_signatures": "false", 2024-09-15T12:18:51.040 INFO:teuthology.orchestra.run.smithi077.stdout: "cephx_service_require_version": "2", 2024-09-15T12:18:51.040 INFO:teuthology.orchestra.run.smithi077.stdout: "cephx_sign_messages": "true", 2024-09-15T12:18:51.040 INFO:teuthology.orchestra.run.smithi077.stdout: "chdir": "", 2024-09-15T12:18:51.040 INFO:teuthology.orchestra.run.smithi077.stdout: "client_acl_type": "", 2024-09-15T12:18:51.040 INFO:teuthology.orchestra.run.smithi077.stdout: "client_asio_thread_count": "2", 2024-09-15T12:18:51.040 INFO:teuthology.orchestra.run.smithi077.stdout: "client_cache_mid": "0.750000", 2024-09-15T12:18:51.040 INFO:teuthology.orchestra.run.smithi077.stdout: "client_cache_size": "16384", 2024-09-15T12:18:51.040 INFO:teuthology.orchestra.run.smithi077.stdout: "client_caps_release_delay": "5", 2024-09-15T12:18:51.040 INFO:teuthology.orchestra.run.smithi077.stdout: "client_check_pool_perm": "true", 2024-09-15T12:18:51.040 INFO:teuthology.orchestra.run.smithi077.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-15T12:18:51.041 INFO:teuthology.orchestra.run.smithi077.stdout: "client_debug_force_sync_read": "false", 2024-09-15T12:18:51.041 INFO:teuthology.orchestra.run.smithi077.stdout: "client_debug_getattr_caps": "false", 2024-09-15T12:18:51.041 INFO:teuthology.orchestra.run.smithi077.stdout: "client_debug_inject_features": "", 2024-09-15T12:18:51.041 INFO:teuthology.orchestra.run.smithi077.stdout: "client_debug_inject_tick_delay": "0", 2024-09-15T12:18:51.041 INFO:teuthology.orchestra.run.smithi077.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-15T12:18:51.041 INFO:teuthology.orchestra.run.smithi077.stdout: "client_die_on_failed_remount": "false", 2024-09-15T12:18:51.041 INFO:teuthology.orchestra.run.smithi077.stdout: "client_dirsize_rbytes": "true", 2024-09-15T12:18:51.041 INFO:teuthology.orchestra.run.smithi077.stdout: "client_force_lazyio": "false", 2024-09-15T12:18:51.041 INFO:teuthology.orchestra.run.smithi077.stdout: "client_fs": "", 2024-09-15T12:18:51.041 INFO:teuthology.orchestra.run.smithi077.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-15T12:18:51.041 INFO:teuthology.orchestra.run.smithi077.stdout: "client_inject_release_failure": "false", 2024-09-15T12:18:51.041 INFO:teuthology.orchestra.run.smithi077.stdout: "client_max_inline_size": "4096", 2024-09-15T12:18:51.041 INFO:teuthology.orchestra.run.smithi077.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-15T12:18:51.042 INFO:teuthology.orchestra.run.smithi077.stdout: "client_mds_namespace": "", 2024-09-15T12:18:51.042 INFO:teuthology.orchestra.run.smithi077.stdout: "client_metadata": "", 2024-09-15T12:18:51.042 INFO:teuthology.orchestra.run.smithi077.stdout: "client_mount_gid": "-1", 2024-09-15T12:18:51.042 INFO:teuthology.orchestra.run.smithi077.stdout: "client_mount_timeout": "300", 2024-09-15T12:18:51.042 INFO:teuthology.orchestra.run.smithi077.stdout: "client_mount_uid": "-1", 2024-09-15T12:18:51.042 INFO:teuthology.orchestra.run.smithi077.stdout: "client_mountpoint": "/", 2024-09-15T12:18:51.042 INFO:teuthology.orchestra.run.smithi077.stdout: "client_notify_timeout": "10", 2024-09-15T12:18:51.042 INFO:teuthology.orchestra.run.smithi077.stdout: "client_oc": "true", 2024-09-15T12:18:51.042 INFO:teuthology.orchestra.run.smithi077.stdout: "client_oc_max_dirty": "104857600", 2024-09-15T12:18:51.042 INFO:teuthology.orchestra.run.smithi077.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-15T12:18:51.042 INFO:teuthology.orchestra.run.smithi077.stdout: "client_oc_max_objects": "1000", 2024-09-15T12:18:51.042 INFO:teuthology.orchestra.run.smithi077.stdout: "client_oc_size": "209715200", 2024-09-15T12:18:51.042 INFO:teuthology.orchestra.run.smithi077.stdout: "client_oc_target_dirty": "8388608", 2024-09-15T12:18:51.042 INFO:teuthology.orchestra.run.smithi077.stdout: "client_permissions": "true", 2024-09-15T12:18:51.043 INFO:teuthology.orchestra.run.smithi077.stdout: "client_quota": "true", 2024-09-15T12:18:51.043 INFO:teuthology.orchestra.run.smithi077.stdout: "client_quota_df": "true", 2024-09-15T12:18:51.043 INFO:teuthology.orchestra.run.smithi077.stdout: "client_readahead_max_bytes": "0", 2024-09-15T12:18:51.043 INFO:teuthology.orchestra.run.smithi077.stdout: "client_readahead_max_periods": "4", 2024-09-15T12:18:51.043 INFO:teuthology.orchestra.run.smithi077.stdout: "client_readahead_min": "131072", 2024-09-15T12:18:51.043 INFO:teuthology.orchestra.run.smithi077.stdout: "client_reconnect_stale": "false", 2024-09-15T12:18:51.043 INFO:teuthology.orchestra.run.smithi077.stdout: "client_shutdown_timeout": "30", 2024-09-15T12:18:51.043 INFO:teuthology.orchestra.run.smithi077.stdout: "client_snapdir": ".snap", 2024-09-15T12:18:51.043 INFO:teuthology.orchestra.run.smithi077.stdout: "client_tick_interval": "1", 2024-09-15T12:18:51.043 INFO:teuthology.orchestra.run.smithi077.stdout: "client_trace": "", 2024-09-15T12:18:51.043 INFO:teuthology.orchestra.run.smithi077.stdout: "client_try_dentry_invalidate": "false", 2024-09-15T12:18:51.043 INFO:teuthology.orchestra.run.smithi077.stdout: "client_use_faked_inos": "false", 2024-09-15T12:18:51.043 INFO:teuthology.orchestra.run.smithi077.stdout: "client_use_random_mds": "false", 2024-09-15T12:18:51.043 INFO:teuthology.orchestra.run.smithi077.stdout: "clog_to_graylog": "false", 2024-09-15T12:18:51.044 INFO:teuthology.orchestra.run.smithi077.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-15T12:18:51.044 INFO:teuthology.orchestra.run.smithi077.stdout: "clog_to_graylog_port": "12201", 2024-09-15T12:18:51.044 INFO:teuthology.orchestra.run.smithi077.stdout: "clog_to_monitors": "default=true", 2024-09-15T12:18:51.044 INFO:teuthology.orchestra.run.smithi077.stdout: "clog_to_syslog": "false", 2024-09-15T12:18:51.044 INFO:teuthology.orchestra.run.smithi077.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-15T12:18:51.044 INFO:teuthology.orchestra.run.smithi077.stdout: "clog_to_syslog_level": "info", 2024-09-15T12:18:51.044 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "-", 2024-09-15T12:18:51.044 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_network": "", 2024-09-15T12:18:51.044 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_network_interface": "", 2024-09-15T12:18:51.044 INFO:teuthology.orchestra.run.smithi077.stdout: "compressor_zlib_isal": "false", 2024-09-15T12:18:51.044 INFO:teuthology.orchestra.run.smithi077.stdout: "compressor_zlib_level": "5", 2024-09-15T12:18:51.044 INFO:teuthology.orchestra.run.smithi077.stdout: "compressor_zlib_winsize": "-15", 2024-09-15T12:18:51.044 INFO:teuthology.orchestra.run.smithi077.stdout: "compressor_zstd_level": "1", 2024-09-15T12:18:51.044 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-15T12:18:51.044 INFO:teuthology.orchestra.run.smithi077.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-15T12:18:51.045 INFO:teuthology.orchestra.run.smithi077.stdout: "crimson_alien_op_num_threads": "6", 2024-09-15T12:18:51.045 INFO:teuthology.orchestra.run.smithi077.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-15T12:18:51.045 INFO:teuthology.orchestra.run.smithi077.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-15T12:18:51.045 INFO:teuthology.orchestra.run.smithi077.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-15T12:18:51.045 INFO:teuthology.orchestra.run.smithi077.stdout: "crimson_osd_stat_interval": "0", 2024-09-15T12:18:51.045 INFO:teuthology.orchestra.run.smithi077.stdout: "crimson_seastar_cpu_cores": "", 2024-09-15T12:18:51.045 INFO:teuthology.orchestra.run.smithi077.stdout: "crimson_seastar_num_threads": "0", 2024-09-15T12:18:51.045 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_location": "", 2024-09-15T12:18:51.045 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_location_hook": "", 2024-09-15T12:18:51.045 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_location_hook_timeout": "10", 2024-09-15T12:18:51.045 INFO:teuthology.orchestra.run.smithi077.stdout: "daemonize": "false", 2024-09-15T12:18:51.045 INFO:teuthology.orchestra.run.smithi077.stdout: "daos_pool": "tank", 2024-09-15T12:18:51.045 INFO:teuthology.orchestra.run.smithi077.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-15T12:18:51.045 INFO:teuthology.orchestra.run.smithi077.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-15T12:18:51.045 INFO:teuthology.orchestra.run.smithi077.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-15T12:18:51.046 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_alienstore": "0/5", 2024-09-15T12:18:51.046 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_allow_any_pool_priority": "false", 2024-09-15T12:18:51.046 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_asok": "1/5", 2024-09-15T12:18:51.046 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_asok_assert_abort": "false", 2024-09-15T12:18:51.046 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_asserts_on_shutdown": "true", 2024-09-15T12:18:51.046 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_auth": "20/20", 2024-09-15T12:18:51.046 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_bdev": "1/3", 2024-09-15T12:18:51.046 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_bluefs": "1/5", 2024-09-15T12:18:51.046 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_bluestore": "1/5", 2024-09-15T12:18:51.046 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_buffer": "0/1", 2024-09-15T12:18:51.046 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_ceph_dedup": "0/5", 2024-09-15T12:18:51.046 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_ceph_exporter": "1/5", 2024-09-15T12:18:51.046 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_cephfs_mirror": "0/5", 2024-09-15T12:18:51.046 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_cephsqlite": "0/5", 2024-09-15T12:18:51.046 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_client": "0/5", 2024-09-15T12:18:51.046 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_compressor": "1/5", 2024-09-15T12:18:51.047 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_context": "0/1", 2024-09-15T12:18:51.047 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_crimson_interrupt": "0/5", 2024-09-15T12:18:51.047 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_crush": "1/1", 2024-09-15T12:18:51.047 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_crypto": "1/5", 2024-09-15T12:18:51.047 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_cyanstore": "0/5", 2024-09-15T12:18:51.047 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_deliberately_leak_memory": "false", 2024-09-15T12:18:51.047 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_disable_randomized_ping": "false", 2024-09-15T12:18:51.047 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_dpdk": "1/5", 2024-09-15T12:18:51.047 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_eventtrace": "1/5", 2024-09-15T12:18:51.047 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_filer": "0/1", 2024-09-15T12:18:51.047 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_filestore": "1/3", 2024-09-15T12:18:51.047 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_finisher": "1/1", 2024-09-15T12:18:51.047 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_fuse": "1/5", 2024-09-15T12:18:51.047 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_heartbeat_testing_span": "0", 2024-09-15T12:18:51.047 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_heartbeatmap": "1/5", 2024-09-15T12:18:51.047 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-15T12:18:51.048 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_javaclient": "1/5", 2024-09-15T12:18:51.048 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_journal": "1/3", 2024-09-15T12:18:51.048 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_journaler": "0/5", 2024-09-15T12:18:51.048 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_kstore": "1/5", 2024-09-15T12:18:51.048 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_lockdep": "0/1", 2024-09-15T12:18:51.048 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_mclock": "1/5", 2024-09-15T12:18:51.048 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_mds": "1/5", 2024-09-15T12:18:51.048 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_mds_balancer": "1/5", 2024-09-15T12:18:51.048 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_mds_locker": "1/5", 2024-09-15T12:18:51.048 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_mds_log": "1/5", 2024-09-15T12:18:51.048 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_mds_log_expire": "1/5", 2024-09-15T12:18:51.048 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_mds_migrator": "1/5", 2024-09-15T12:18:51.048 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_mds_quiesce": "3/5", 2024-09-15T12:18:51.048 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_memstore": "1/5", 2024-09-15T12:18:51.049 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_mgr": "2/5", 2024-09-15T12:18:51.049 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_mgrc": "1/5", 2024-09-15T12:18:51.049 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_mon": "20/20", 2024-09-15T12:18:51.049 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_monc": "0/10", 2024-09-15T12:18:51.049 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_ms": "1/1", 2024-09-15T12:18:51.049 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_none": "0/5", 2024-09-15T12:18:51.049 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_objclass": "0/5", 2024-09-15T12:18:51.049 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_objectcacher": "0/5", 2024-09-15T12:18:51.049 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_objecter": "0/1", 2024-09-15T12:18:51.049 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_optracker": "0/5", 2024-09-15T12:18:51.049 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_osd": "1/5", 2024-09-15T12:18:51.049 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_paxos": "20/20", 2024-09-15T12:18:51.049 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_perfcounter": "1/5", 2024-09-15T12:18:51.049 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_prioritycache": "1/5", 2024-09-15T12:18:51.049 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_rados": "0/5", 2024-09-15T12:18:51.050 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_rbd": "0/5", 2024-09-15T12:18:51.050 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_rbd_mirror": "0/5", 2024-09-15T12:18:51.050 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_rbd_pwl": "0/5", 2024-09-15T12:18:51.050 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_rbd_replay": "0/5", 2024-09-15T12:18:51.050 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_refs": "0/0", 2024-09-15T12:18:51.050 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_reserver": "1/1", 2024-09-15T12:18:51.050 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_rgw": "1/5", 2024-09-15T12:18:51.050 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_rgw_access": "1/5", 2024-09-15T12:18:51.050 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_rgw_datacache": "1/5", 2024-09-15T12:18:51.050 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_rgw_dbstore": "1/5", 2024-09-15T12:18:51.050 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_rgw_flight": "1/5", 2024-09-15T12:18:51.050 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-15T12:18:51.050 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_rgw_notification": "1/5", 2024-09-15T12:18:51.050 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_rgw_sync": "1/5", 2024-09-15T12:18:51.051 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_rocksdb": "4/5", 2024-09-15T12:18:51.051 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_seastore": "0/5", 2024-09-15T12:18:51.051 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_seastore_backref": "0/5", 2024-09-15T12:18:51.052 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_seastore_cache": "0/5", 2024-09-15T12:18:51.052 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_seastore_cleaner": "0/5", 2024-09-15T12:18:51.052 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_seastore_device": "0/5", 2024-09-15T12:18:51.052 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_seastore_epm": "0/5", 2024-09-15T12:18:51.052 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-15T12:18:51.052 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_seastore_journal": "0/5", 2024-09-15T12:18:51.052 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_seastore_lba": "0/5", 2024-09-15T12:18:51.052 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_seastore_odata": "0/5", 2024-09-15T12:18:51.052 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_seastore_omap": "0/5", 2024-09-15T12:18:51.052 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_seastore_onode": "0/5", 2024-09-15T12:18:51.052 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_seastore_t": "0/5", 2024-09-15T12:18:51.052 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_seastore_tm": "0/5", 2024-09-15T12:18:51.052 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_striper": "0/1", 2024-09-15T12:18:51.052 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_test": "0/5", 2024-09-15T12:18:51.053 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_throttle": "1/1", 2024-09-15T12:18:51.053 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_timer": "0/1", 2024-09-15T12:18:51.053 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_tp": "0/5", 2024-09-15T12:18:51.053 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_trace": "1/5", 2024-09-15T12:18:51.053 INFO:teuthology.orchestra.run.smithi077.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-15T12:18:51.053 INFO:teuthology.orchestra.run.smithi077.stdout: "device_failure_prediction_mode": "none", 2024-09-15T12:18:51.053 INFO:teuthology.orchestra.run.smithi077.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "crimson", 2024-09-15T12:18:51.053 INFO:teuthology.orchestra.run.smithi077.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-09-15T12:18:51.053 INFO:teuthology.orchestra.run.smithi077.stdout: "err_to_graylog": "false", 2024-09-15T12:18:51.053 INFO:teuthology.orchestra.run.smithi077.stdout: "err_to_journald": "false", 2024-09-15T12:18:51.053 INFO:teuthology.orchestra.run.smithi077.stdout: "err_to_stderr": "true", 2024-09-15T12:18:51.053 INFO:teuthology.orchestra.run.smithi077.stdout: "err_to_syslog": "false", 2024-09-15T12:18:51.053 INFO:teuthology.orchestra.run.smithi077.stdout: "event_tracing": "false", 2024-09-15T12:18:51.053 INFO:teuthology.orchestra.run.smithi077.stdout: "exporter_addr": "0.0.0.0", 2024-09-15T12:18:51.054 INFO:teuthology.orchestra.run.smithi077.stdout: "exporter_cert_file": "", 2024-09-15T12:18:51.054 INFO:teuthology.orchestra.run.smithi077.stdout: "exporter_http_port": "9926", 2024-09-15T12:18:51.054 INFO:teuthology.orchestra.run.smithi077.stdout: "exporter_key_file": "", 2024-09-15T12:18:51.054 INFO:teuthology.orchestra.run.smithi077.stdout: "exporter_prio_limit": "5", 2024-09-15T12:18:51.054 INFO:teuthology.orchestra.run.smithi077.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-15T12:18:51.054 INFO:teuthology.orchestra.run.smithi077.stdout: "exporter_sort_metrics": "true", 2024-09-15T12:18:51.054 INFO:teuthology.orchestra.run.smithi077.stdout: "exporter_stats_period": "5", 2024-09-15T12:18:51.054 INFO:teuthology.orchestra.run.smithi077.stdout: "fake_statfs_for_testing": "0", 2024-09-15T12:18:51.054 INFO:teuthology.orchestra.run.smithi077.stdout: "fatal_signal_handlers": "true", 2024-09-15T12:18:51.054 INFO:teuthology.orchestra.run.smithi077.stdout: "filer_max_purge_ops": "10", 2024-09-15T12:18:51.054 INFO:teuthology.orchestra.run.smithi077.stdout: "filer_max_truncate_ops": "128", 2024-09-15T12:18:51.054 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_apply_finisher_threads": "1", 2024-09-15T12:18:51.054 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_blackhole": "false", 2024-09-15T12:18:51.054 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_btrfs_clone_range": "true", 2024-09-15T12:18:51.054 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_btrfs_snap": "true", 2024-09-15T12:18:51.055 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_caller_concurrency": "10", 2024-09-15T12:18:51.055 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_collect_device_partition_information": "true", 2024-09-15T12:18:51.055 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_commit_timeout": "600.000000", 2024-09-15T12:18:51.055 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_debug_inject_read_err": "false", 2024-09-15T12:18:51.055 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_debug_omap_check": "false", 2024-09-15T12:18:51.055 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_debug_verify_split": "false", 2024-09-15T12:18:51.055 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_dump_file": "", 2024-09-15T12:18:51.055 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-15T12:18:51.055 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-15T12:18:51.055 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_fadvise": "true", 2024-09-15T12:18:51.055 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_fail_eio": "true", 2024-09-15T12:18:51.055 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_fd_cache_shards": "16", 2024-09-15T12:18:51.055 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_fd_cache_size": "128", 2024-09-15T12:18:51.056 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_fiemap": "false", 2024-09-15T12:18:51.056 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_fiemap_threshold": "4096", 2024-09-15T12:18:51.056 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-15T12:18:51.056 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-15T12:18:51.056 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_inject_stall": "0", 2024-09-15T12:18:51.056 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_journal_parallel": "false", 2024-09-15T12:18:51.056 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_journal_trailing": "false", 2024-09-15T12:18:51.056 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_journal_writeahead": "false", 2024-09-15T12:18:51.056 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_kill_at": "0", 2024-09-15T12:18:51.056 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-15T12:18:51.056 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-15T12:18:51.056 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-15T12:18:51.056 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-15T12:18:51.056 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-15T12:18:51.057 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_max_inline_xattrs": "0", 2024-09-15T12:18:51.057 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-15T12:18:51.057 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-15T12:18:51.057 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-15T12:18:51.057 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-15T12:18:51.057 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_max_xattr_value_size": "0", 2024-09-15T12:18:51.057 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-15T12:18:51.057 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-15T12:18:51.057 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-15T12:18:51.057 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_merge_threshold": "-10", 2024-09-15T12:18:51.057 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-15T12:18:51.057 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_odsync_write": "false", 2024-09-15T12:18:51.057 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_omap_backend": "rocksdb", 2024-09-15T12:18:51.058 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_omap_backend_path": "", 2024-09-15T12:18:51.058 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-15T12:18:51.058 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-15T12:18:51.058 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-15T12:18:51.058 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_op_thread_timeout": "60", 2024-09-15T12:18:51.058 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_op_threads": "2", 2024-09-15T12:18:51.058 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_punch_hole": "false", 2024-09-15T12:18:51.058 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-15T12:18:51.058 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-15T12:18:51.058 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-15T12:18:51.058 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-15T12:18:51.058 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-15T12:18:51.058 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-15T12:18:51.058 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-15T12:18:51.058 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-15T12:18:51.059 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-15T12:18:51.059 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_queue_max_ops": "50", 2024-09-15T12:18:51.059 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-15T12:18:51.059 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_seek_data_hole": "false", 2024-09-15T12:18:51.059 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_sloppy_crc": "false", 2024-09-15T12:18:51.059 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-15T12:18:51.059 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_splice": "false", 2024-09-15T12:18:51.059 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_split_multiple": "2", 2024-09-15T12:18:51.059 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_split_rand_factor": "20", 2024-09-15T12:18:51.059 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_update_to": "1000", 2024-09-15T12:18:51.059 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-15T12:18:51.059 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-15T12:18:51.059 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-15T12:18:51.059 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-15T12:18:51.059 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-15T12:18:51.060 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-15T12:18:51.060 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_wbthrottle_enable": "true", 2024-09-15T12:18:51.060 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-15T12:18:51.060 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-15T12:18:51.060 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-15T12:18:51.060 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-15T12:18:51.060 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-15T12:18:51.060 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-15T12:18:51.060 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_xfs_extsize": "false", 2024-09-15T12:18:51.060 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_zfs_snap": "false", 2024-09-15T12:18:51.060 INFO:teuthology.orchestra.run.smithi077.stdout: "fio_dir": "/tmp/fio", 2024-09-15T12:18:51.060 INFO:teuthology.orchestra.run.smithi077.stdout: "fsid": "0010d80b-83bc-42b2-8185-928cfe1dc364", 2024-09-15T12:18:51.060 INFO:teuthology.orchestra.run.smithi077.stdout: "fuse_allow_other": "true", 2024-09-15T12:18:51.060 INFO:teuthology.orchestra.run.smithi077.stdout: "fuse_atomic_o_trunc": "true", 2024-09-15T12:18:51.061 INFO:teuthology.orchestra.run.smithi077.stdout: "fuse_big_writes": "true", 2024-09-15T12:18:51.061 INFO:teuthology.orchestra.run.smithi077.stdout: "fuse_debug": "false", 2024-09-15T12:18:51.061 INFO:teuthology.orchestra.run.smithi077.stdout: "fuse_default_permissions": "false", 2024-09-15T12:18:51.061 INFO:teuthology.orchestra.run.smithi077.stdout: "fuse_disable_pagecache": "false", 2024-09-15T12:18:51.061 INFO:teuthology.orchestra.run.smithi077.stdout: "fuse_max_write": "0", 2024-09-15T12:18:51.061 INFO:teuthology.orchestra.run.smithi077.stdout: "fuse_multithreaded": "true", 2024-09-15T12:18:51.061 INFO:teuthology.orchestra.run.smithi077.stdout: "fuse_require_active_mds": "true", 2024-09-15T12:18:51.061 INFO:teuthology.orchestra.run.smithi077.stdout: "fuse_set_user_groups": "true", 2024-09-15T12:18:51.061 INFO:teuthology.orchestra.run.smithi077.stdout: "fuse_splice_move": "true", 2024-09-15T12:18:51.061 INFO:teuthology.orchestra.run.smithi077.stdout: "fuse_splice_read": "true", 2024-09-15T12:18:51.061 INFO:teuthology.orchestra.run.smithi077.stdout: "fuse_splice_write": "true", 2024-09-15T12:18:51.061 INFO:teuthology.orchestra.run.smithi077.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-15T12:18:51.061 INFO:teuthology.orchestra.run.smithi077.stdout: "fuse_use_invalidate_cb": "true", 2024-09-15T12:18:51.061 INFO:teuthology.orchestra.run.smithi077.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-15T12:18:51.061 INFO:teuthology.orchestra.run.smithi077.stdout: "gss_target_name": "ceph", 2024-09-15T12:18:51.062 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_file": "", 2024-09-15T12:18:51.062 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_inject_failure": "0", 2024-09-15T12:18:51.062 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_interval": "5", 2024-09-15T12:18:51.062 INFO:teuthology.orchestra.run.smithi077.stdout: "host": "smithi077", 2024-09-15T12:18:51.062 INFO:teuthology.orchestra.run.smithi077.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-15T12:18:51.062 INFO:teuthology.orchestra.run.smithi077.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-15T12:18:51.062 INFO:teuthology.orchestra.run.smithi077.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-15T12:18:51.062 INFO:teuthology.orchestra.run.smithi077.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-15T12:18:51.062 INFO:teuthology.orchestra.run.smithi077.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-15T12:18:51.062 INFO:teuthology.orchestra.run.smithi077.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-15T12:18:51.062 INFO:teuthology.orchestra.run.smithi077.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-15T12:18:51.062 INFO:teuthology.orchestra.run.smithi077.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-15T12:18:51.062 INFO:teuthology.orchestra.run.smithi077.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-15T12:18:51.063 INFO:teuthology.orchestra.run.smithi077.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-15T12:18:51.063 INFO:teuthology.orchestra.run.smithi077.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-15T12:18:51.063 INFO:teuthology.orchestra.run.smithi077.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-15T12:18:51.063 INFO:teuthology.orchestra.run.smithi077.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-15T12:18:51.063 INFO:teuthology.orchestra.run.smithi077.stdout: "inject_early_sigterm": "false", 2024-09-15T12:18:51.063 INFO:teuthology.orchestra.run.smithi077.stdout: "jaeger_agent_port": "6799", 2024-09-15T12:18:51.063 INFO:teuthology.orchestra.run.smithi077.stdout: "jaeger_tracing_enable": "false", 2024-09-15T12:18:51.063 INFO:teuthology.orchestra.run.smithi077.stdout: "journal_aio": "true", 2024-09-15T12:18:51.063 INFO:teuthology.orchestra.run.smithi077.stdout: "journal_align_min_size": "65536", 2024-09-15T12:18:51.063 INFO:teuthology.orchestra.run.smithi077.stdout: "journal_block_align": "true", 2024-09-15T12:18:51.063 INFO:teuthology.orchestra.run.smithi077.stdout: "journal_block_size": "4096", 2024-09-15T12:18:51.063 INFO:teuthology.orchestra.run.smithi077.stdout: "journal_dio": "true", 2024-09-15T12:18:51.063 INFO:teuthology.orchestra.run.smithi077.stdout: "journal_discard": "false", 2024-09-15T12:18:51.063 INFO:teuthology.orchestra.run.smithi077.stdout: "journal_force_aio": "false", 2024-09-15T12:18:51.063 INFO:teuthology.orchestra.run.smithi077.stdout: "journal_ignore_corruption": "false", 2024-09-15T12:18:51.064 INFO:teuthology.orchestra.run.smithi077.stdout: "journal_max_write_bytes": "10485760", 2024-09-15T12:18:51.064 INFO:teuthology.orchestra.run.smithi077.stdout: "journal_max_write_entries": "100", 2024-09-15T12:18:51.064 INFO:teuthology.orchestra.run.smithi077.stdout: "journal_replay_from": "0", 2024-09-15T12:18:51.064 INFO:teuthology.orchestra.run.smithi077.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-15T12:18:51.064 INFO:teuthology.orchestra.run.smithi077.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-15T12:18:51.064 INFO:teuthology.orchestra.run.smithi077.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-15T12:18:51.064 INFO:teuthology.orchestra.run.smithi077.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-15T12:18:51.064 INFO:teuthology.orchestra.run.smithi077.stdout: "journal_write_header_frequency": "0", 2024-09-15T12:18:51.064 INFO:teuthology.orchestra.run.smithi077.stdout: "journal_zero_on_create": "false", 2024-09-15T12:18:51.064 INFO:teuthology.orchestra.run.smithi077.stdout: "journaler_prefetch_periods": "10", 2024-09-15T12:18:51.064 INFO:teuthology.orchestra.run.smithi077.stdout: "journaler_prezero_periods": "5", 2024-09-15T12:18:51.064 INFO:teuthology.orchestra.run.smithi077.stdout: "journaler_write_head_interval": "15", 2024-09-15T12:18:51.064 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "", 2024-09-15T12:18:51.064 INFO:teuthology.orchestra.run.smithi077.stdout: "keyfile": "", 2024-09-15T12:18:51.064 INFO:teuthology.orchestra.run.smithi077.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-15T12:18:51.065 INFO:teuthology.orchestra.run.smithi077.stdout: "kstore_backend": "rocksdb", 2024-09-15T12:18:51.065 INFO:teuthology.orchestra.run.smithi077.stdout: "kstore_default_stripe_size": "65536", 2024-09-15T12:18:51.065 INFO:teuthology.orchestra.run.smithi077.stdout: "kstore_fsck_on_mount": "false", 2024-09-15T12:18:51.065 INFO:teuthology.orchestra.run.smithi077.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-15T12:18:51.065 INFO:teuthology.orchestra.run.smithi077.stdout: "kstore_max_bytes": "67108864", 2024-09-15T12:18:51.065 INFO:teuthology.orchestra.run.smithi077.stdout: "kstore_max_ops": "512", 2024-09-15T12:18:51.065 INFO:teuthology.orchestra.run.smithi077.stdout: "kstore_nid_prealloc": "1024", 2024-09-15T12:18:51.065 INFO:teuthology.orchestra.run.smithi077.stdout: "kstore_onode_map_size": "1024", 2024-09-15T12:18:51.065 INFO:teuthology.orchestra.run.smithi077.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-15T12:18:51.065 INFO:teuthology.orchestra.run.smithi077.stdout: "kstore_sync_submit_transaction": "false", 2024-09-15T12:18:51.065 INFO:teuthology.orchestra.run.smithi077.stdout: "kstore_sync_transaction": "false", 2024-09-15T12:18:51.065 INFO:teuthology.orchestra.run.smithi077.stdout: "librados_thread_count": "2", 2024-09-15T12:18:51.065 INFO:teuthology.orchestra.run.smithi077.stdout: "lockdep": "false", 2024-09-15T12:18:51.065 INFO:teuthology.orchestra.run.smithi077.stdout: "lockdep_force_backtrace": "false", 2024-09-15T12:18:51.066 INFO:teuthology.orchestra.run.smithi077.stdout: "log_coarse_timestamps": "true", 2024-09-15T12:18:51.066 INFO:teuthology.orchestra.run.smithi077.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-15T12:18:51.066 INFO:teuthology.orchestra.run.smithi077.stdout: "log_flush_on_exit": "false", 2024-09-15T12:18:51.066 INFO:teuthology.orchestra.run.smithi077.stdout: "log_graylog_host": "127.0.0.1", 2024-09-15T12:18:51.066 INFO:teuthology.orchestra.run.smithi077.stdout: "log_graylog_port": "12201", 2024-09-15T12:18:51.066 INFO:teuthology.orchestra.run.smithi077.stdout: "log_max_new": "1000", 2024-09-15T12:18:51.066 INFO:teuthology.orchestra.run.smithi077.stdout: "log_max_recent": "10000", 2024-09-15T12:18:51.066 INFO:teuthology.orchestra.run.smithi077.stdout: "log_stderr_prefix": "", 2024-09-15T12:18:51.066 INFO:teuthology.orchestra.run.smithi077.stdout: "log_stop_at_utilization": "0.970000", 2024-09-15T12:18:51.066 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": "true", 2024-09-15T12:18:51.066 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_graylog": "false", 2024-09-15T12:18:51.066 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_journald": "false", 2024-09-15T12:18:51.066 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_stderr": "false", 2024-09-15T12:18:51.066 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_syslog": "false", 2024-09-15T12:18:51.066 INFO:teuthology.orchestra.run.smithi077.stdout: "max_rotating_auth_attempts": "10", 2024-09-15T12:18:51.067 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-15T12:18:51.067 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_action_on_write_error": "1", 2024-09-15T12:18:51.067 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_alternate_name_max": "8192", 2024-09-15T12:18:51.067 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_asio_thread_count": "2", 2024-09-15T12:18:51.067 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_export_pin": "true", 2024-09-15T12:18:51.067 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_fragment_dirs": "true", 2024-09-15T12:18:51.067 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-15T12:18:51.067 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_fragment_interval": "5", 2024-09-15T12:18:51.067 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-15T12:18:51.067 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-15T12:18:51.067 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_interval": "10", 2024-09-15T12:18:51.067 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_max": "-1", 2024-09-15T12:18:51.067 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_max_until": "-1", 2024-09-15T12:18:51.067 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_merge_size": "50", 2024-09-15T12:18:51.068 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_midchunk": "0.300000", 2024-09-15T12:18:51.068 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-15T12:18:51.068 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_min_start": "0.200000", 2024-09-15T12:18:51.068 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_minchunk": "0.001000", 2024-09-15T12:18:51.068 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_mode": "0", 2024-09-15T12:18:51.068 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_need_max": "1.200000", 2024-09-15T12:18:51.068 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_need_min": "0.800000", 2024-09-15T12:18:51.068 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_overload_epochs": "2", 2024-09-15T12:18:51.068 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-15T12:18:51.068 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-15T12:18:51.068 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_split_bits": "3", 2024-09-15T12:18:51.068 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-15T12:18:51.068 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_split_size": "10000", 2024-09-15T12:18:51.068 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-15T12:18:51.069 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_target_decay": "10.000000", 2024-09-15T12:18:51.069 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-15T12:18:51.069 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_beacon_grace": "15.000000", 2024-09-15T12:18:51.069 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_beacon_interval": "4.000000", 2024-09-15T12:18:51.069 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-15T12:18:51.069 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-15T12:18:51.069 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cache_mid": "0.700000", 2024-09-15T12:18:51.069 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-15T12:18:51.069 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cache_quiesce_delay": "0", 2024-09-15T12:18:51.069 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-15T12:18:51.069 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-15T12:18:51.069 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-15T12:18:51.069 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cache_release_free_interval": "10", 2024-09-15T12:18:51.069 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cache_reservation": "0.050000", 2024-09-15T12:18:51.070 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-15T12:18:51.070 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cache_trim_interval": "1", 2024-09-15T12:18:51.070 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cache_trim_threshold": "262144", 2024-09-15T12:18:51.070 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-15T12:18:51.070 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-15T12:18:51.070 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-15T12:18:51.070 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_client_prealloc_inos": "1000", 2024-09-15T12:18:51.070 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-15T12:18:51.070 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_connect_bootstrapping": "false", 2024-09-15T12:18:51.070 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_damage_table_max_entries": "10000", 2024-09-15T12:18:51.070 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-15T12:18:51.070 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_debug_auth_pins": "false", 2024-09-15T12:18:51.070 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_debug_frag": "false", 2024-09-15T12:18:51.070 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_debug_scatterstat": "false", 2024-09-15T12:18:51.070 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_debug_subtrees": "false", 2024-09-15T12:18:51.071 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_decay_halflife": "5.000000", 2024-09-15T12:18:51.071 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_default_dir_hash": "2", 2024-09-15T12:18:51.071 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_defer_session_stale": "true", 2024-09-15T12:18:51.071 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_deny_all_reconnect": "false", 2024-09-15T12:18:51.071 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_dir_keys_per_op": "16384", 2024-09-15T12:18:51.071 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_dir_max_commit_size": "10", 2024-09-15T12:18:51.071 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_dir_max_entries": "0", 2024-09-15T12:18:51.071 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_dir_prefetch": "true", 2024-09-15T12:18:51.071 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-15T12:18:51.071 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-15T12:18:51.071 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_dump_cache_on_map": "false", 2024-09-15T12:18:51.071 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-15T12:18:51.071 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-15T12:18:51.072 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_early_reply": "true", 2024-09-15T12:18:51.072 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_enable_op_tracker": "true", 2024-09-15T12:18:51.072 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_enforce_unique_name": "true", 2024-09-15T12:18:51.072 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-15T12:18:51.072 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-15T12:18:51.072 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_export_ephemeral_random": "true", 2024-09-15T12:18:51.072 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-15T12:18:51.072 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-15T12:18:51.072 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-15T12:18:51.072 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-15T12:18:51.072 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-15T12:18:51.072 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-15T12:18:51.072 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-15T12:18:51.073 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-15T12:18:51.073 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_health_summarize_threshold": "10", 2024-09-15T12:18:51.073 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-15T12:18:51.073 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-15T12:18:51.073 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_inject_health_dummy": "false", 2024-09-15T12:18:51.073 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-15T12:18:51.073 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_inject_migrator_session_race": "false", 2024-09-15T12:18:51.073 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-15T12:18:51.073 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-15T12:18:51.073 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-15T12:18:51.073 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_join_fs": "", 2024-09-15T12:18:51.073 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_journal_format": "1", 2024-09-15T12:18:51.073 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-15T12:18:51.073 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_kill_create_at": "0", 2024-09-15T12:18:51.074 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_kill_dirfrag_at": "0", 2024-09-15T12:18:51.074 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_kill_export_at": "0", 2024-09-15T12:18:51.074 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_kill_import_at": "0", 2024-09-15T12:18:51.074 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_kill_journal_at": "0", 2024-09-15T12:18:51.074 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_kill_journal_expire_at": "0", 2024-09-15T12:18:51.074 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_kill_journal_replay_at": "0", 2024-09-15T12:18:51.074 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_kill_link_at": "0", 2024-09-15T12:18:51.074 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_kill_mdstable_at": "0", 2024-09-15T12:18:51.074 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_kill_openc_at": "0", 2024-09-15T12:18:51.074 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_kill_rename_at": "0", 2024-09-15T12:18:51.074 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_kill_shutdown_at": "0", 2024-09-15T12:18:51.074 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_log_event_large_threshold": "524288", 2024-09-15T12:18:51.074 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_log_events_per_segment": "1024", 2024-09-15T12:18:51.074 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-15T12:18:51.075 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_log_max_events": "-1", 2024-09-15T12:18:51.075 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_log_max_segments": "128", 2024-09-15T12:18:51.075 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_log_pause": "false", 2024-09-15T12:18:51.075 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_log_segment_size": "0", 2024-09-15T12:18:51.075 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-15T12:18:51.075 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-15T12:18:51.075 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-15T12:18:51.075 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_log_trim_threshold": "128", 2024-09-15T12:18:51.075 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-15T12:18:51.075 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_log_warn_factor": "2.000000", 2024-09-15T12:18:51.075 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_max_caps_per_client": "1048576", 2024-09-15T12:18:51.075 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_max_completed_flushes": "100000", 2024-09-15T12:18:51.075 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_max_completed_requests": "100000", 2024-09-15T12:18:51.075 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_max_export_size": "20971520", 2024-09-15T12:18:51.075 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_max_file_recover": "32", 2024-09-15T12:18:51.076 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_max_purge_files": "64", 2024-09-15T12:18:51.076 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_max_purge_ops": "8192", 2024-09-15T12:18:51.076 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-15T12:18:51.076 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-15T12:18:51.076 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_max_snaps_per_dir": "100", 2024-09-15T12:18:51.076 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_metrics_update_interval": "2", 2024-09-15T12:18:51.076 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_min_caps_per_client": "100", 2024-09-15T12:18:51.076 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_min_caps_working_set": "10000", 2024-09-15T12:18:51.076 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-15T12:18:51.076 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_numa_node": "-1", 2024-09-15T12:18:51.076 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-15T12:18:51.076 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_op_complaint_time": "30.000000", 2024-09-15T12:18:51.076 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_op_history_duration": "600", 2024-09-15T12:18:51.076 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_op_history_size": "20", 2024-09-15T12:18:51.076 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_op_history_slow_op_size": "20", 2024-09-15T12:18:51.077 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-15T12:18:51.077 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_op_log_threshold": "5", 2024-09-15T12:18:51.077 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_ping_grace": "15", 2024-09-15T12:18:51.077 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_ping_interval": "5", 2024-09-15T12:18:51.077 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-15T12:18:51.077 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-15T12:18:51.077 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_recall_max_caps": "30000", 2024-09-15T12:18:51.077 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-15T12:18:51.077 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-15T12:18:51.077 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-15T12:18:51.077 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_recall_warning_threshold": "262144", 2024-09-15T12:18:51.077 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-15T12:18:51.077 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_replay_interval": "1.000000", 2024-09-15T12:18:51.077 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-15T12:18:51.077 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-15T12:18:51.078 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_root_ino_gid": "0", 2024-09-15T12:18:51.078 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_root_ino_uid": "0", 2024-09-15T12:18:51.078 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-15T12:18:51.078 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_scrub_stats_review_period": "1", 2024-09-15T12:18:51.078 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_server_dispatch_client_request_delay": "0", 2024-09-15T12:18:51.078 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2024-09-15T12:18:51.078 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-15T12:18:51.078 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-15T12:18:51.078 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-15T12:18:51.078 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-15T12:18:51.078 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-15T12:18:51.078 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-15T12:18:51.078 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-15T12:18:51.079 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-15T12:18:51.079 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-15T12:18:51.079 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_shutdown_check": "0", 2024-09-15T12:18:51.079 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_skip_ino": "0", 2024-09-15T12:18:51.079 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-15T12:18:51.079 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_snap_max_uid": "4294967294", 2024-09-15T12:18:51.079 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_snap_min_uid": "0", 2024-09-15T12:18:51.079 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_snap_rstat": "false", 2024-09-15T12:18:51.079 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_standby_replay_damaged": "false", 2024-09-15T12:18:51.079 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_symlink_recovery": "true", 2024-09-15T12:18:51.079 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-15T12:18:51.079 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_thrash_exports": "0", 2024-09-15T12:18:51.079 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_thrash_fragments": "0", 2024-09-15T12:18:51.079 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_tick_interval": "5.000000", 2024-09-15T12:18:51.080 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_valgrind_exit": "false", 2024-09-15T12:18:51.080 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_verify_backtrace": "1", 2024-09-15T12:18:51.080 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_verify_scatter": "false", 2024-09-15T12:18:51.080 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-15T12:18:51.080 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_wipe_sessions": "false", 2024-09-15T12:18:51.080 INFO:teuthology.orchestra.run.smithi077.stdout: "mempool_debug": "false", 2024-09-15T12:18:51.080 INFO:teuthology.orchestra.run.smithi077.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-15T12:18:51.080 INFO:teuthology.orchestra.run.smithi077.stdout: "memstore_device_bytes": "1073741824", 2024-09-15T12:18:51.080 INFO:teuthology.orchestra.run.smithi077.stdout: "memstore_page_set": "false", 2024-09-15T12:18:51.080 INFO:teuthology.orchestra.run.smithi077.stdout: "memstore_page_size": "65536", 2024-09-15T12:18:51.080 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_client_bytes": "134217728", 2024-09-15T12:18:51.080 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_client_messages": "512", 2024-09-15T12:18:51.080 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-15T12:18:51.080 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-15T12:18:51.080 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-15T12:18:51.081 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-15T12:18:51.081 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_disabled_modules": "", 2024-09-15T12:18:51.081 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_enable_op_tracker": "true", 2024-09-15T12:18:51.081 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-15T12:18:51.081 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_max_pg_creating": "1024", 2024-09-15T12:18:51.081 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_max_pg_num_change": "128", 2024-09-15T12:18:51.081 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_mds_bytes": "134217728", 2024-09-15T12:18:51.081 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_mds_messages": "128", 2024-09-15T12:18:51.081 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-15T12:18:51.081 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_mon_bytes": "134217728", 2024-09-15T12:18:51.081 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_mon_messages": "128", 2024-09-15T12:18:51.081 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-15T12:18:51.081 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-15T12:18:51.081 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_op_history_duration": "600", 2024-09-15T12:18:51.081 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_op_history_size": "20", 2024-09-15T12:18:51.082 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-15T12:18:51.082 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-15T12:18:51.082 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_op_log_threshold": "5", 2024-09-15T12:18:51.082 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_osd_bytes": "536870912", 2024-09-15T12:18:51.082 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_osd_messages": "8192", 2024-09-15T12:18:51.082 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_pool": "true", 2024-09-15T12:18:51.082 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-15T12:18:51.082 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_standby_modules": "true", 2024-09-15T12:18:51.082 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_stats_period": "5", 2024-09-15T12:18:51.082 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_stats_threshold": "5", 2024-09-15T12:18:51.082 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_tick_period": "2", 2024-09-15T12:18:51.082 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-15T12:18:51.082 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-15T12:18:51.082 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_allow_pool_delete": "true", 2024-09-15T12:18:51.083 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_allow_pool_size_one": "true", 2024-09-15T12:18:51.083 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_auth_validate_all_caps": "true", 2024-09-15T12:18:51.083 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-15T12:18:51.083 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-15T12:18:51.083 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_client_bytes": "104857600", 2024-09-15T12:18:51.083 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_client_directed_command_retry": "2", 2024-09-15T12:18:51.083 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-15T12:18:51.083 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-15T12:18:51.083 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-15T12:18:51.083 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-15T12:18:51.083 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_client_hunt_parallel": "3", 2024-09-15T12:18:51.083 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_client_log_interval": "1.000000", 2024-09-15T12:18:51.084 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-15T12:18:51.084 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_client_ping_interval": "10.000000", 2024-09-15T12:18:51.084 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-15T12:18:51.084 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_client_target_rank": "-1", 2024-09-15T12:18:51.084 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-15T12:18:51.084 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-15T12:18:51.084 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-15T12:18:51.084 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_cluster_log_level": "debug", 2024-09-15T12:18:51.084 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_cluster_log_to_file": "true", 2024-09-15T12:18:51.084 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-15T12:18:51.084 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-15T12:18:51.084 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-15T12:18:51.084 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_cluster_log_to_journald": "false", 2024-09-15T12:18:51.085 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-15T12:18:51.085 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-15T12:18:51.085 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-15T12:18:51.085 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_compact_on_bootstrap": "false", 2024-09-15T12:18:51.085 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_compact_on_start": "false", 2024-09-15T12:18:51.085 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_compact_on_trim": "true", 2024-09-15T12:18:51.085 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-15T12:18:51.085 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-15T12:18:51.085 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-15T12:18:51.085 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_cpu_threads": "4", 2024-09-15T12:18:51.085 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_crush_min_required_version": "hammer", 2024-09-15T12:18:51.085 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_daemon_bytes": "419430400", 2024-09-15T12:18:51.085 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-15T12:18:51.085 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_data_avail_crit": "5", 2024-09-15T12:18:51.086 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_data_avail_warn": "5", 2024-09-15T12:18:51.086 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_data_size_warn": "16106127360", 2024-09-15T12:18:51.086 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-15T12:18:51.086 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-15T12:18:51.086 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_debug_dump_json": "false", 2024-09-15T12:18:51.086 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-15T12:18:51.086 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_debug_dump_transactions": "false", 2024-09-15T12:18:51.086 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_debug_extra_checks": "false", 2024-09-15T12:18:51.086 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-15T12:18:51.086 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-15T12:18:51.086 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_debug_no_require_reef": "false", 2024-09-15T12:18:51.086 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_debug_no_require_squid": "false", 2024-09-15T12:18:51.086 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-15T12:18:51.086 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-15T12:18:51.086 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-15T12:18:51.087 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_down_mkfs_grace": "120", 2024-09-15T12:18:51.087 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_down_uptime_grace": "60", 2024-09-15T12:18:51.087 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_election_default_strategy": "1", 2024-09-15T12:18:51.087 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_election_timeout": "5.000000", 2024-09-15T12:18:51.087 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-15T12:18:51.087 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_elector_ping_divisor": "2", 2024-09-15T12:18:51.087 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-15T12:18:51.087 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_enable_op_tracker": "true", 2024-09-15T12:18:51.087 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_fake_pool_delete": "false", 2024-09-15T12:18:51.087 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_force_quorum_join": "false", 2024-09-15T12:18:51.087 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-15T12:18:51.087 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_globalid_prealloc": "10000", 2024-09-15T12:18:51.087 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_health_detail_to_clog": "false", 2024-09-15T12:18:51.087 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_health_log_update_period": "5", 2024-09-15T12:18:51.087 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_health_max_detail": "50", 2024-09-15T12:18:51.088 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_health_to_clog": "true", 2024-09-15T12:18:51.088 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_health_to_clog_interval": "600", 2024-09-15T12:18:51.088 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-15T12:18:51.088 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_host": "172.21.15.77", 2024-09-15T12:18:51.088 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_host_override": "", 2024-09-15T12:18:51.088 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_initial_members": "", 2024-09-15T12:18:51.088 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-15T12:18:51.088 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-15T12:18:51.088 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-15T12:18:51.088 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-15T12:18:51.088 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-15T12:18:51.088 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_lease": "5.000000", 2024-09-15T12:18:51.088 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-15T12:18:51.088 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-15T12:18:51.088 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_log_full_interval": "50", 2024-09-15T12:18:51.089 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_log_max": "10000", 2024-09-15T12:18:51.089 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_log_max_summary": "50", 2024-09-15T12:18:51.089 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-15T12:18:51.089 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_max_log_epochs": "500", 2024-09-15T12:18:51.089 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-15T12:18:51.089 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-15T12:18:51.089 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_max_nvmeof_epochs": "500", 2024-09-15T12:18:51.089 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_max_osd": "10000", 2024-09-15T12:18:51.089 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_max_pg_per_osd": "10000", 2024-09-15T12:18:51.089 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_max_pool_pg_num": "65536", 2024-09-15T12:18:51.089 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-15T12:18:51.089 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-15T12:18:51.089 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_mds_force_trim_to": "0", 2024-09-15T12:18:51.089 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_mds_skip_sanity": "false", 2024-09-15T12:18:51.090 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_memory_autotune": "true", 2024-09-15T12:18:51.090 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_memory_target": "2147483648", 2024-09-15T12:18:51.090 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_mgr_beacon_grace": "30", 2024-09-15T12:18:51.090 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-15T12:18:51.090 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_mgr_digest_period": "5", 2024-09-15T12:18:51.090 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_mgr_inactive_grace": "60", 2024-09-15T12:18:51.090 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-15T12:18:51.090 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-15T12:18:51.090 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_min_osdmap_epochs": "50", 2024-09-15T12:18:51.090 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_nvmeofgw_beacon_grace": "10", 2024-09-15T12:18:51.090 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2024-09-15T12:18:51.090 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_op_complaint_time": "30", 2024-09-15T12:18:51.090 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_op_history_duration": "600", 2024-09-15T12:18:51.090 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_op_history_size": "20", 2024-09-15T12:18:51.090 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_op_history_slow_op_size": "20", 2024-09-15T12:18:51.091 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-15T12:18:51.091 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_op_log_threshold": "5", 2024-09-15T12:18:51.091 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-15T12:18:51.091 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-15T12:18:51.091 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-15T12:18:51.091 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_auto_mark_in": "false", 2024-09-15T12:18:51.091 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-15T12:18:51.091 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-15T12:18:51.091 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-15T12:18:51.091 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_cache_size": "500", 2024-09-15T12:18:51.091 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-15T12:18:51.091 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-15T12:18:51.091 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-15T12:18:51.091 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_down_out_interval": "600", 2024-09-15T12:18:51.091 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-15T12:18:51.092 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-15T12:18:51.092 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_force_trim_to": "0", 2024-09-15T12:18:51.092 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-15T12:18:51.092 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-15T12:18:51.092 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-15T12:18:51.092 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-15T12:18:51.092 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-15T12:18:51.092 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-15T12:18:51.092 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-15T12:18:51.092 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_min_down_reporters": "2", 2024-09-15T12:18:51.092 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-15T12:18:51.092 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-15T12:18:51.092 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-15T12:18:51.092 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-15T12:18:51.093 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-15T12:18:51.093 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-15T12:18:51.093 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_report_timeout": "900", 2024-09-15T12:18:51.093 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-15T12:18:51.093 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-15T12:18:51.093 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-15T12:18:51.093 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-15T12:18:51.093 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-15T12:18:51.093 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osdmap_full_prune_interval": "2", 2024-09-15T12:18:51.093 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osdmap_full_prune_min": "15", 2024-09-15T12:18:51.093 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osdmap_full_prune_txsize": "2", 2024-09-15T12:18:51.093 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-15T12:18:51.093 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_pg_stuck_threshold": "60", 2024-09-15T12:18:51.094 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-15T12:18:51.094 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-15T12:18:51.094 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-15T12:18:51.094 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-15T12:18:51.094 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-15T12:18:51.094 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-15T12:18:51.094 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_probe_timeout": "2.000000", 2024-09-15T12:18:51.094 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_reweight_max_change": "0.050000", 2024-09-15T12:18:51.094 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_reweight_max_osds": "4", 2024-09-15T12:18:51.094 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-15T12:18:51.094 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-15T12:18:51.094 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-15T12:18:51.094 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-15T12:18:51.094 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-15T12:18:51.094 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_scrub_interval": "86400", 2024-09-15T12:18:51.095 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_scrub_max_keys": "100", 2024-09-15T12:18:51.095 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_scrub_timeout": "300", 2024-09-15T12:18:51.095 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_session_timeout": "300", 2024-09-15T12:18:51.095 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_smart_report_timeout": "5", 2024-09-15T12:18:51.095 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_stat_smooth_intervals": "6", 2024-09-15T12:18:51.095 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-15T12:18:51.095 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_stretch_pool_min_size": "2", 2024-09-15T12:18:51.095 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_stretch_pool_size": "4", 2024-09-15T12:18:51.095 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-15T12:18:51.095 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-15T12:18:51.095 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_sync_debug": "false", 2024-09-15T12:18:51.095 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-15T12:18:51.095 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-15T12:18:51.095 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_sync_provider_kill_at": "0", 2024-09-15T12:18:51.095 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_sync_requester_kill_at": "0", 2024-09-15T12:18:51.096 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_sync_timeout": "60.000000", 2024-09-15T12:18:51.096 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_target_pg_per_osd": "100", 2024-09-15T12:18:51.096 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_tick_interval": "5", 2024-09-15T12:18:51.096 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_timecheck_interval": "300.000000", 2024-09-15T12:18:51.096 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-15T12:18:51.096 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_use_min_delay_socket": "false", 2024-09-15T12:18:51.096 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_older_version_delay": "604800", 2024-09-15T12:18:51.096 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-15T12:18:51.096 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-15T12:18:51.096 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-15T12:18:51.096 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-15T12:18:51.096 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-15T12:18:51.096 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-15T12:18:51.096 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-15T12:18:51.096 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_on_misplaced": "false", 2024-09-15T12:18:51.097 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-15T12:18:51.097 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_on_older_version": "true", 2024-09-15T12:18:51.097 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-15T12:18:51.097 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_on_pool_no_app": "true", 2024-09-15T12:18:51.097 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-15T12:18:51.097 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-15T12:18:51.097 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-15T12:18:51.097 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-15T12:18:51.097 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-15T12:18:51.097 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-15T12:18:51.097 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-15T12:18:51.097 INFO:teuthology.orchestra.run.smithi077.stdout: "monmap": "", 2024-09-15T12:18:51.097 INFO:teuthology.orchestra.run.smithi077.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-15T12:18:51.097 INFO:teuthology.orchestra.run.smithi077.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-15T12:18:51.097 INFO:teuthology.orchestra.run.smithi077.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-15T12:18:51.098 INFO:teuthology.orchestra.run.smithi077.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-15T12:18:51.098 INFO:teuthology.orchestra.run.smithi077.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-15T12:18:51.098 INFO:teuthology.orchestra.run.smithi077.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-15T12:18:51.098 INFO:teuthology.orchestra.run.smithi077.stdout: "motr_tracing_enabled": "false", 2024-09-15T12:18:51.098 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_op_threads": "3", 2024-09-15T12:18:51.098 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-15T12:18:51.098 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_rdma_cm": "false", 2024-09-15T12:18:51.098 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_rdma_device_name": "", 2024-09-15T12:18:51.098 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_rdma_dscp": "96", 2024-09-15T12:18:51.098 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-15T12:18:51.098 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-15T12:18:51.098 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_rdma_local_gid": "", 2024-09-15T12:18:51.098 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-15T12:18:51.098 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_rdma_port_num": "1", 2024-09-15T12:18:51.099 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-15T12:18:51.099 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-15T12:18:51.099 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-15T12:18:51.099 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-15T12:18:51.099 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_rdma_sl": "3", 2024-09-15T12:18:51.099 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_rdma_support_srq": "true", 2024-09-15T12:18:51.099 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_rdma_type": "ib", 2024-09-15T12:18:51.099 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_reap_threshold": "5", 2024-09-15T12:18:51.099 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_bind_before_connect": "false", 2024-09-15T12:18:51.099 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_bind_ipv4": "true", 2024-09-15T12:18:51.099 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_bind_ipv6": "false", 2024-09-15T12:18:51.099 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_bind_msgr1": "true", 2024-09-15T12:18:51.099 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_bind_msgr2": "true", 2024-09-15T12:18:51.099 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_bind_port_max": "7568", 2024-09-15T12:18:51.100 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_bind_port_min": "6800", 2024-09-15T12:18:51.100 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-15T12:18:51.100 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_bind_retry_count": "3", 2024-09-15T12:18:51.100 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_bind_retry_delay": "5", 2024-09-15T12:18:51.100 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_blackhole_client": "false", 2024-09-15T12:18:51.100 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_blackhole_mds": "false", 2024-09-15T12:18:51.100 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_blackhole_mgr": "false", 2024-09-15T12:18:51.100 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_blackhole_mon": "false", 2024-09-15T12:18:51.100 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_blackhole_osd": "false", 2024-09-15T12:18:51.100 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_client_mode": "crc", 2024-09-15T12:18:51.100 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_client_throttle_retry_time_interval": "5000", 2024-09-15T12:18:51.100 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_cluster_mode": "crc", 2024-09-15T12:18:51.100 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_cluster_type": "", 2024-09-15T12:18:51.100 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_compress_secure": "false", 2024-09-15T12:18:51.100 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_connection_idle_timeout": "900", 2024-09-15T12:18:51.101 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_connection_ready_timeout": "10", 2024-09-15T12:18:51.101 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_crc_data": "true", 2024-09-15T12:18:51.101 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_crc_header": "true", 2024-09-15T12:18:51.101 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_die_on_bad_msg": "false", 2024-09-15T12:18:51.101 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_die_on_bug": "true", 2024-09-15T12:18:51.101 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_die_on_old_message": "true", 2024-09-15T12:18:51.101 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_die_on_skipped_message": "false", 2024-09-15T12:18:51.101 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-15T12:18:51.101 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-15T12:18:51.101 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dpdk_coremask": "0xF", 2024-09-15T12:18:51.101 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-15T12:18:51.101 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-15T12:18:51.101 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dpdk_enable_tso": "true", 2024-09-15T12:18:51.101 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-15T12:18:51.101 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-15T12:18:51.102 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dpdk_hugepages": "", 2024-09-15T12:18:51.102 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-15T12:18:51.102 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-15T12:18:51.102 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dpdk_lro": "true", 2024-09-15T12:18:51.102 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dpdk_memory_channel": "4", 2024-09-15T12:18:51.102 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-15T12:18:51.102 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dpdk_pmd": "", 2024-09-15T12:18:51.102 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dpdk_port_id": "0", 2024-09-15T12:18:51.102 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-15T12:18:51.102 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-15T12:18:51.102 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dump_on_send": "false", 2024-09-15T12:18:51.102 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_initial_backoff": "0.200000", 2024-09-15T12:18:51.102 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_inject_delay_max": "1.000000", 2024-09-15T12:18:51.102 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-15T12:18:51.102 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_inject_delay_type": "", 2024-09-15T12:18:51.102 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-15T12:18:51.103 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_inject_network_congestion": "0", 2024-09-15T12:18:51.103 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_inject_socket_failures": "0", 2024-09-15T12:18:51.103 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_learn_addr_from_peer": "true", 2024-09-15T12:18:51.103 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_max_accept_failures": "4", 2024-09-15T12:18:51.103 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_max_backoff": "15.000000", 2024-09-15T12:18:51.103 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_mon_client_mode": "crc", 2024-09-15T12:18:51.103 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_mon_cluster_mode": "crc", 2024-09-15T12:18:51.103 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_mon_service_mode": "crc", 2024-09-15T12:18:51.103 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_osd_compress_min_size": "1024", 2024-09-15T12:18:51.103 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_osd_compress_mode": "none", 2024-09-15T12:18:51.103 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-15T12:18:51.103 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-15T12:18:51.103 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_pq_min_cost": "65536", 2024-09-15T12:18:51.103 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_public_type": "", 2024-09-15T12:18:51.103 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_service_mode": "crc", 2024-09-15T12:18:51.104 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_tcp_listen_backlog": "512", 2024-09-15T12:18:51.104 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_tcp_nodelay": "true", 2024-09-15T12:18:51.104 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-15T12:18:51.104 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_tcp_rcvbuf": "0", 2024-09-15T12:18:51.104 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_time_events_min_wait_interval": "1000", 2024-09-15T12:18:51.104 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_type": "async+posix", 2024-09-15T12:18:51.104 INFO:teuthology.orchestra.run.smithi077.stdout: "no_config_file": "false", 2024-09-15T12:18:51.104 INFO:teuthology.orchestra.run.smithi077.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2024-09-15T12:18:51.104 INFO:teuthology.orchestra.run.smithi077.stdout: "nvmeof_mon_client_tick_period": "2", 2024-09-15T12:18:51.104 INFO:teuthology.orchestra.run.smithi077.stdout: "objecter_completion_locks_per_session": "32", 2024-09-15T12:18:51.104 INFO:teuthology.orchestra.run.smithi077.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-15T12:18:51.104 INFO:teuthology.orchestra.run.smithi077.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-15T12:18:51.104 INFO:teuthology.orchestra.run.smithi077.stdout: "objecter_inflight_ops": "1024", 2024-09-15T12:18:51.104 INFO:teuthology.orchestra.run.smithi077.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-15T12:18:51.104 INFO:teuthology.orchestra.run.smithi077.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-15T12:18:51.105 INFO:teuthology.orchestra.run.smithi077.stdout: "objecter_tick_interval": "5.000000", 2024-09-15T12:18:51.105 INFO:teuthology.orchestra.run.smithi077.stdout: "objecter_timeout": "10.000000", 2024-09-15T12:18:51.105 INFO:teuthology.orchestra.run.smithi077.stdout: "objectstore_blackhole": "false", 2024-09-15T12:18:51.105 INFO:teuthology.orchestra.run.smithi077.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-15T12:18:51.105 INFO:teuthology.orchestra.run.smithi077.stdout: "openssl_engine_opts": "", 2024-09-15T12:18:51.105 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_agent_delay_time": "5.000000", 2024-09-15T12:18:51.105 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_agent_hist_halflife": "1000", 2024-09-15T12:18:51.105 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_agent_max_low_ops": "2", 2024-09-15T12:18:51.105 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_agent_max_ops": "4", 2024-09-15T12:18:51.105 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-15T12:18:51.105 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-15T12:18:51.105 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_agent_slop": "0.020000", 2024-09-15T12:18:51.105 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-15T12:18:51.105 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-15T12:18:51.105 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_asio_thread_count": "2", 2024-09-15T12:18:51.106 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_async_recovery_min_cost": "100", 2024-09-15T12:18:51.106 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-15T12:18:51.106 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-15T12:18:51.106 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_backfill_scan_max": "512", 2024-09-15T12:18:51.106 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_backfill_scan_min": "64", 2024-09-15T12:18:51.106 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_backoff_on_degraded": "false", 2024-09-15T12:18:51.106 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_backoff_on_peering": "false", 2024-09-15T12:18:51.106 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_backoff_on_unfound": "true", 2024-09-15T12:18:51.106 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_beacon_report_interval": "300", 2024-09-15T12:18:51.106 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_bench_duration": "30", 2024-09-15T12:18:51.106 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-15T12:18:51.106 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_bench_max_block_size": "67108864", 2024-09-15T12:18:51.106 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-15T12:18:51.106 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_blkin_trace_all": "false", 2024-09-15T12:18:51.106 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-15T12:18:51.106 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-15T12:18:51.107 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-15T12:18:51.107 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-15T12:18:51.107 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_check_for_log_corruption": "false", 2024-09-15T12:18:51.107 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-15T12:18:51.107 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-15T12:18:51.107 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-09-15T12:18:51.107 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-15T12:18:51.107 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_class_update_on_start": "true", 2024-09-15T12:18:51.107 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_client_message_cap": "256", 2024-09-15T12:18:51.107 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_client_message_size_cap": "524288000", 2024-09-15T12:18:51.107 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_client_op_priority": "63", 2024-09-15T12:18:51.107 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_client_watch_timeout": "30", 2024-09-15T12:18:51.107 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_command_max_records": "256", 2024-09-15T12:18:51.107 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_compact_on_start": "false", 2024-09-15T12:18:51.107 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-15T12:18:51.108 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-15T12:18:51.108 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-15T12:18:51.108 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_crush_update_on_start": "true", 2024-09-15T12:18:51.108 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_crush_update_weight_set": "true", 2024-09-15T12:18:51.108 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-15T12:18:51.108 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-15T12:18:51.108 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-15T12:18:51.108 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-15T12:18:51.108 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-15T12:18:51.108 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_feed_pullee": "-1", 2024-09-15T12:18:51.108 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-15T12:18:51.108 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-15T12:18:51.108 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-15T12:18:51.108 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_misdirected_ops": "false", 2024-09-15T12:18:51.108 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_no_acting_change": "false", 2024-09-15T12:18:51.109 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_no_purge_strays": "false", 2024-09-15T12:18:51.109 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_op_order": "false", 2024-09-15T12:18:51.109 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-15T12:18:51.109 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-15T12:18:51.109 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-15T12:18:51.109 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-15T12:18:51.109 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_shutdown": "false", 2024-09-15T12:18:51.109 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-15T12:18:51.109 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-15T12:18:51.109 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_trim_objects": "false", 2024-09-15T12:18:51.109 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-15T12:18:51.109 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-15T12:18:51.109 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_verify_snaps": "false", 2024-09-15T12:18:51.109 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-15T12:18:51.109 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-15T12:18:51.110 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_deep_scrub_keys": "1024", 2024-09-15T12:18:51.110 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-15T12:18:51.110 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-15T12:18:51.110 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-15T12:18:51.110 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_deep_scrub_stride": "524288", 2024-09-15T12:18:51.110 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-15T12:18:51.110 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-15T12:18:51.110 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_default_notify_timeout": "30", 2024-09-15T12:18:51.110 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_delete_sleep": "0.000000", 2024-09-15T12:18:51.110 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-15T12:18:51.110 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-15T12:18:51.110 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-15T12:18:51.110 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_discard_disconnected_ops": "true", 2024-09-15T12:18:51.110 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_ec_partial_reads": "true", 2024-09-15T12:18:51.110 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_enable_op_tracker": "true", 2024-09-15T12:18:51.111 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-15T12:18:51.111 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-15T12:18:51.111 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-15T12:18:51.111 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-15T12:18:51.111 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_fast_info": "true", 2024-09-15T12:18:51.111 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_fast_shutdown": "true", 2024-09-15T12:18:51.111 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-15T12:18:51.111 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-15T12:18:51.111 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-15T12:18:51.111 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-15T12:18:51.111 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-15T12:18:51.111 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_function_tracing": "false", 2024-09-15T12:18:51.111 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_heartbeat_grace": "20", 2024-09-15T12:18:51.111 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_heartbeat_interval": "6", 2024-09-15T12:18:51.112 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-15T12:18:51.112 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_heartbeat_min_peers": "10", 2024-09-15T12:18:51.112 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_heartbeat_min_size": "2000", 2024-09-15T12:18:51.112 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_heartbeat_stale": "600", 2024-09-15T12:18:51.112 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-15T12:18:51.112 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_hit_set_max_size": "100000", 2024-09-15T12:18:51.112 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_hit_set_min_size": "1000", 2024-09-15T12:18:51.112 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-15T12:18:51.112 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-15T12:18:51.112 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-15T12:18:51.112 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-15T12:18:51.112 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-15T12:18:51.112 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-15T12:18:51.112 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_journal_size": "5120", 2024-09-15T12:18:51.113 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_kill_backfill_at": "0", 2024-09-15T12:18:51.113 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-15T12:18:51.113 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_map_cache_size": "50", 2024-09-15T12:18:51.113 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_map_dedup": "true", 2024-09-15T12:18:51.113 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_map_message_max": "40", 2024-09-15T12:18:51.113 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-15T12:18:51.113 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_map_share_max_epochs": "40", 2024-09-15T12:18:51.113 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_attr_name_len": "100", 2024-09-15T12:18:51.113 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_attr_size": "0", 2024-09-15T12:18:51.113 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_backfills": "1", 2024-09-15T12:18:51.113 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_markdown_count": "5", 2024-09-15T12:18:51.113 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_markdown_period": "600", 2024-09-15T12:18:51.113 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_object_name_len": "2048", 2024-09-15T12:18:51.113 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_object_namespace_len": "256", 2024-09-15T12:18:51.113 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_object_size": "134217728", 2024-09-15T12:18:51.113 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-15T12:18:51.114 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-15T12:18:51.114 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_pg_blocked_by": "16", 2024-09-15T12:18:51.114 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_pg_log_entries": "10000", 2024-09-15T12:18:51.114 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-15T12:18:51.114 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_pgls": "1024", 2024-09-15T12:18:51.114 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_push_cost": "8388608", 2024-09-15T12:18:51.114 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_push_objects": "10", 2024-09-15T12:18:51.114 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_scrubs": "3", 2024-09-15T12:18:51.114 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-15T12:18:51.114 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_trimming_pgs": "2", 2024-09-15T12:18:51.114 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_write_op_reply_len": "64", 2024-09-15T12:18:51.114 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_write_size": "90", 2024-09-15T12:18:51.114 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-15T12:18:51.114 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-15T12:18:51.115 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-15T12:18:51.115 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-15T12:18:51.115 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-15T12:18:51.115 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-15T12:18:51.115 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-15T12:18:51.115 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-15T12:18:51.115 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_profile": "balanced", 2024-09-15T12:18:51.115 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-15T12:18:51.115 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-15T12:18:51.115 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-15T12:18:51.115 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-15T12:18:51.115 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-15T12:18:51.115 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-15T12:18:51.115 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-15T12:18:51.116 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-15T12:18:51.116 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-15T12:18:51.116 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-15T12:18:51.116 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-15T12:18:51.116 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_memory_base": "805306368", 2024-09-15T12:18:51.116 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_memory_cache_min": "134217728", 2024-09-15T12:18:51.116 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-15T12:18:51.116 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-15T12:18:51.116 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_memory_target": "4294967296", 2024-09-15T12:18:51.116 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_memory_target_autotune": "false", 2024-09-15T12:18:51.116 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-15T12:18:51.116 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_min_pg_log_entries": "250", 2024-09-15T12:18:51.116 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_min_recovery_priority": "0", 2024-09-15T12:18:51.116 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-15T12:18:51.117 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-15T12:18:51.117 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mon_report_interval": "5", 2024-09-15T12:18:51.117 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-15T12:18:51.117 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-15T12:18:51.117 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_num_cache_shards": "32", 2024-09-15T12:18:51.117 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_num_op_tracker_shard": "32", 2024-09-15T12:18:51.117 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_numa_auto_affinity": "true", 2024-09-15T12:18:51.117 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_numa_node": "-1", 2024-09-15T12:18:51.117 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_numa_prefer_iface": "true", 2024-09-15T12:18:51.117 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-15T12:18:51.117 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_objecter_finishers": "1", 2024-09-15T12:18:51.117 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_objectstore": "bluestore", 2024-09-15T12:18:51.117 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_objectstore_fuse": "false", 2024-09-15T12:18:51.117 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_objectstore_ideal_list_max": "64", 2024-09-15T12:18:51.117 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_objectstore_tracing": "false", 2024-09-15T12:18:51.118 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_complaint_time": "30.000000", 2024-09-15T12:18:51.118 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_history_duration": "600", 2024-09-15T12:18:51.118 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_history_size": "20", 2024-09-15T12:18:51.118 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_history_slow_op_size": "20", 2024-09-15T12:18:51.118 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-15T12:18:51.118 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_log_threshold": "5", 2024-09-15T12:18:51.118 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_num_shards": "0", 2024-09-15T12:18:51.118 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_num_shards_hdd": "5", 2024-09-15T12:18:51.118 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_num_shards_ssd": "8", 2024-09-15T12:18:51.118 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-15T12:18:51.118 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-15T12:18:51.118 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-15T12:18:51.118 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-15T12:18:51.118 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_pq_min_cost": "65536", 2024-09-15T12:18:51.119 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-15T12:18:51.119 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_queue_cut_off": "high", 2024-09-15T12:18:51.119 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-15T12:18:51.119 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_thread_timeout": "15", 2024-09-15T12:18:51.119 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_open_classes_on_start": "true", 2024-09-15T12:18:51.119 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_os_flags": "0", 2024-09-15T12:18:51.119 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_peering_op_priority": "255", 2024-09-15T12:18:51.119 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pg_delete_cost": "1048576", 2024-09-15T12:18:51.119 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pg_delete_priority": "5", 2024-09-15T12:18:51.119 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-15T12:18:51.119 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-15T12:18:51.119 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-15T12:18:51.119 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pg_log_trim_max": "10000", 2024-09-15T12:18:51.120 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pg_log_trim_min": "100", 2024-09-15T12:18:51.120 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-15T12:18:51.120 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-15T12:18:51.120 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-15T12:18:51.120 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-15T12:18:51.120 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-15T12:18:51.120 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-15T12:18:51.120 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-15T12:18:51.120 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-15T12:18:51.120 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-15T12:18:51.120 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-15T12:18:51.120 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_crimson": "true", 2024-09-15T12:18:51.120 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-15T12:18:51.121 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-15T12:18:51.121 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-15T12:18:51.121 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-15T12:18:51.121 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-15T12:18:51.121 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-15T12:18:51.121 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-15T12:18:51.121 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-15T12:18:51.121 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_flags": "0", 2024-09-15T12:18:51.121 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-15T12:18:51.121 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_min_size": "2", 2024-09-15T12:18:51.121 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-15T12:18:51.121 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_pg_num": "32", 2024-09-15T12:18:51.121 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_pgp_num": "0", 2024-09-15T12:18:51.121 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-15T12:18:51.121 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_read_ratio": "70", 2024-09-15T12:18:51.122 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_size": "3", 2024-09-15T12:18:51.122 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_type": "replicated", 2024-09-15T12:18:51.122 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-15T12:18:51.122 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-15T12:18:51.122 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_push_per_object_cost": "1000", 2024-09-15T12:18:51.122 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-15T12:18:51.122 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recover_clone_overlap": "true", 2024-09-15T12:18:51.122 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-15T12:18:51.122 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recovery_cost": "20971520", 2024-09-15T12:18:51.122 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-15T12:18:51.122 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recovery_max_active": "0", 2024-09-15T12:18:51.122 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-15T12:18:51.122 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-15T12:18:51.122 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-15T12:18:51.123 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-15T12:18:51.123 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recovery_max_single_start": "1", 2024-09-15T12:18:51.123 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recovery_op_priority": "3", 2024-09-15T12:18:51.123 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-15T12:18:51.123 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recovery_priority": "5", 2024-09-15T12:18:51.123 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-15T12:18:51.123 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recovery_sleep": "0.000000", 2024-09-15T12:18:51.123 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-15T12:18:51.123 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-15T12:18:51.123 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-15T12:18:51.123 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_repair_during_recovery": "false", 2024-09-15T12:18:51.123 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_requested_scrub_priority": "120", 2024-09-15T12:18:51.123 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-15T12:18:51.123 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-15T12:18:51.123 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_auto_repair": "false", 2024-09-15T12:18:51.124 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-15T12:18:51.124 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-15T12:18:51.124 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_begin_hour": "0", 2024-09-15T12:18:51.124 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_begin_week_day": "0", 2024-09-15T12:18:51.124 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_chunk_max": "25", 2024-09-15T12:18:51.124 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_chunk_min": "5", 2024-09-15T12:18:51.124 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_cost": "52428800", 2024-09-15T12:18:51.124 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-15T12:18:51.124 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_during_recovery": "false", 2024-09-15T12:18:51.124 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_end_hour": "0", 2024-09-15T12:18:51.124 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_end_week_day": "0", 2024-09-15T12:18:51.124 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_event_cost": "4096", 2024-09-15T12:18:51.124 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-15T12:18:51.124 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-15T12:18:51.125 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_invalid_stats": "true", 2024-09-15T12:18:51.125 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-15T12:18:51.125 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-15T12:18:51.125 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_max_preemptions": "5", 2024-09-15T12:18:51.125 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-15T12:18:51.125 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_priority": "5", 2024-09-15T12:18:51.125 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_retry_after_noscrub": "60", 2024-09-15T12:18:51.125 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_retry_delay": "30", 2024-09-15T12:18:51.125 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_retry_new_interval": "10", 2024-09-15T12:18:51.125 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_retry_pg_state": "60", 2024-09-15T12:18:51.125 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_retry_trimming": "10", 2024-09-15T12:18:51.125 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_sleep": "0.000000", 2024-09-15T12:18:51.125 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-15T12:18:51.125 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-15T12:18:51.126 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-15T12:18:51.126 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-09-15T12:18:51.126 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_skip_data_digest": "false", 2024-09-15T12:18:51.126 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_smart_report_timeout": "5", 2024-09-15T12:18:51.126 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_snap_trim_cost": "1048576", 2024-09-15T12:18:51.126 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_snap_trim_priority": "5", 2024-09-15T12:18:51.126 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-15T12:18:51.126 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-15T12:18:51.126 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-15T12:18:51.126 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-15T12:18:51.126 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-15T12:18:51.126 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-15T12:18:51.126 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-15T12:18:51.126 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_target_transaction_size": "30", 2024-09-15T12:18:51.126 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-15T12:18:51.127 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-15T12:18:51.127 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-15T12:18:51.127 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-15T12:18:51.127 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-15T12:18:51.127 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-15T12:18:51.127 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-15T12:18:51.127 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-15T12:18:51.127 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-15T12:18:51.127 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-15T12:18:51.127 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_tracing": "false", 2024-09-15T12:18:51.127 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_use_stale_snap": "false", 2024-09-15T12:18:51.127 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-15T12:18:51.127 INFO:teuthology.orchestra.run.smithi077.stdout: "osdc_blkin_trace_all": "false", 2024-09-15T12:18:51.127 INFO:teuthology.orchestra.run.smithi077.stdout: "paxos_kill_at": "0", 2024-09-15T12:18:51.127 INFO:teuthology.orchestra.run.smithi077.stdout: "paxos_max_join_drift": "10", 2024-09-15T12:18:51.128 INFO:teuthology.orchestra.run.smithi077.stdout: "paxos_min": "500", 2024-09-15T12:18:51.128 INFO:teuthology.orchestra.run.smithi077.stdout: "paxos_min_wait": "0.050000", 2024-09-15T12:18:51.128 INFO:teuthology.orchestra.run.smithi077.stdout: "paxos_propose_interval": "1.000000", 2024-09-15T12:18:51.128 INFO:teuthology.orchestra.run.smithi077.stdout: "paxos_service_trim_max": "500", 2024-09-15T12:18:51.128 INFO:teuthology.orchestra.run.smithi077.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-15T12:18:51.128 INFO:teuthology.orchestra.run.smithi077.stdout: "paxos_service_trim_min": "10", 2024-09-15T12:18:51.128 INFO:teuthology.orchestra.run.smithi077.stdout: "paxos_stash_full_interval": "25", 2024-09-15T12:18:51.128 INFO:teuthology.orchestra.run.smithi077.stdout: "paxos_trim_max": "500", 2024-09-15T12:18:51.128 INFO:teuthology.orchestra.run.smithi077.stdout: "paxos_trim_min": "250", 2024-09-15T12:18:51.128 INFO:teuthology.orchestra.run.smithi077.stdout: "perf": "true", 2024-09-15T12:18:51.128 INFO:teuthology.orchestra.run.smithi077.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-15T12:18:51.128 INFO:teuthology.orchestra.run.smithi077.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-15T12:18:51.128 INFO:teuthology.orchestra.run.smithi077.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-09-15T12:18:51.128 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "-", 2024-09-15T12:18:51.128 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrv": "", 2024-09-15T12:18:51.129 INFO:teuthology.orchestra.run.smithi077.stdout: "public_bind_addr": "-", 2024-09-15T12:18:51.129 INFO:teuthology.orchestra.run.smithi077.stdout: "public_network": "", 2024-09-15T12:18:51.129 INFO:teuthology.orchestra.run.smithi077.stdout: "public_network_interface": "", 2024-09-15T12:18:51.129 INFO:teuthology.orchestra.run.smithi077.stdout: "qat_compressor_busy_polling": "false", 2024-09-15T12:18:51.129 INFO:teuthology.orchestra.run.smithi077.stdout: "qat_compressor_enabled": "false", 2024-09-15T12:18:51.129 INFO:teuthology.orchestra.run.smithi077.stdout: "qat_compressor_session_max_number": "256", 2024-09-15T12:18:51.129 INFO:teuthology.orchestra.run.smithi077.stdout: "rados_mon_op_timeout": "0", 2024-09-15T12:18:51.129 INFO:teuthology.orchestra.run.smithi077.stdout: "rados_osd_op_timeout": "0", 2024-09-15T12:18:51.129 INFO:teuthology.orchestra.run.smithi077.stdout: "rados_tracing": "false", 2024-09-15T12:18:51.129 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_atime_update_interval": "60", 2024-09-15T12:18:51.129 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-15T12:18:51.129 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_balance_parent_reads": "false", 2024-09-15T12:18:51.129 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_balance_snap_reads": "false", 2024-09-15T12:18:51.129 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_blkin_trace_all": "false", 2024-09-15T12:18:51.130 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-15T12:18:51.130 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-15T12:18:51.130 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_cache": "true", 2024-09-15T12:18:51.130 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-15T12:18:51.130 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-15T12:18:51.130 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-15T12:18:51.130 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-15T12:18:51.130 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_cache_policy": "writearound", 2024-09-15T12:18:51.130 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_cache_size": "33554432", 2024-09-15T12:18:51.130 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-15T12:18:51.130 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-15T12:18:51.130 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_clone_copy_on_read": "false", 2024-09-15T12:18:51.130 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_compression_hint": "none", 2024-09-15T12:18:51.130 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_concurrent_management_ops": "10", 2024-09-15T12:18:51.130 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-15T12:18:51.131 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_default_clone_format": "auto", 2024-09-15T12:18:51.131 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_default_data_pool": "", 2024-09-15T12:18:51.131 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_default_features": "61", 2024-09-15T12:18:51.131 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_default_format": "2", 2024-09-15T12:18:51.131 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_default_map_options": "", 2024-09-15T12:18:51.131 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_default_order": "22", 2024-09-15T12:18:51.131 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_default_pool": "rbd", 2024-09-15T12:18:51.131 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-15T12:18:51.131 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_default_stripe_count": "0", 2024-09-15T12:18:51.131 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_default_stripe_unit": "0", 2024-09-15T12:18:51.131 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-15T12:18:51.131 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-15T12:18:51.131 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-15T12:18:51.131 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_enable_alloc_hint": "true", 2024-09-15T12:18:51.131 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-15T12:18:51.132 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_io_scheduler": "simple", 2024-09-15T12:18:51.132 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-15T12:18:51.132 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-15T12:18:51.132 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-15T12:18:51.132 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-15T12:18:51.132 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-15T12:18:51.132 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-15T12:18:51.132 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-15T12:18:51.132 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-15T12:18:51.132 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-15T12:18:51.132 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_journal_order": "24", 2024-09-15T12:18:51.132 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_journal_pool": "", 2024-09-15T12:18:51.132 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_journal_splay_width": "4", 2024-09-15T12:18:51.132 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_localize_parent_reads": "false", 2024-09-15T12:18:51.133 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_localize_snap_reads": "false", 2024-09-15T12:18:51.133 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-15T12:18:51.133 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-15T12:18:51.133 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-15T12:18:51.133 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-15T12:18:51.133 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-15T12:18:51.133 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-15T12:18:51.133 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-15T12:18:51.133 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-15T12:18:51.133 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-15T12:18:51.133 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-15T12:18:51.133 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-15T12:18:51.133 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-15T12:18:51.133 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-15T12:18:51.134 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-15T12:18:51.134 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-15T12:18:51.134 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-15T12:18:51.134 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-15T12:18:51.134 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-15T12:18:51.134 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-15T12:18:51.134 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-15T12:18:51.134 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-15T12:18:51.134 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-15T12:18:51.134 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-15T12:18:51.134 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-15T12:18:51.134 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-15T12:18:51.134 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-15T12:18:51.134 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-15T12:18:51.134 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-15T12:18:51.135 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-15T12:18:51.135 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-15T12:18:51.135 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-15T12:18:51.135 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mtime_update_interval": "60", 2024-09-15T12:18:51.135 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_non_blocking_aio": "true", 2024-09-15T12:18:51.135 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_op_thread_timeout": "60", 2024-09-15T12:18:51.135 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_op_threads": "1", 2024-09-15T12:18:51.135 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_parent_cache_enabled": "false", 2024-09-15T12:18:51.135 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-15T12:18:51.135 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-15T12:18:51.135 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-15T12:18:51.135 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_plugins": "", 2024-09-15T12:18:51.135 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_bps_burst": "0", 2024-09-15T12:18:51.135 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-15T12:18:51.135 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_bps_limit": "0", 2024-09-15T12:18:51.136 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_exclude_ops": "0", 2024-09-15T12:18:51.136 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_iops_burst": "0", 2024-09-15T12:18:51.136 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-15T12:18:51.136 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_iops_limit": "0", 2024-09-15T12:18:51.136 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-15T12:18:51.136 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-15T12:18:51.136 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-15T12:18:51.136 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-15T12:18:51.136 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-15T12:18:51.136 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-15T12:18:51.136 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-15T12:18:51.136 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-15T12:18:51.136 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-15T12:18:51.136 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-15T12:18:51.136 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-15T12:18:51.137 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-15T12:18:51.137 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-15T12:18:51.137 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-15T12:18:51.137 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_read_from_replica_policy": "default", 2024-09-15T12:18:51.137 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-15T12:18:51.137 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-15T12:18:51.137 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-15T12:18:51.137 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-15T12:18:51.137 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_skip_partial_discard": "true", 2024-09-15T12:18:51.137 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-15T12:18:51.137 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_tracing": "false", 2024-09-15T12:18:51.137 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_validate_names": "true", 2024-09-15T12:18:51.137 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_validate_pool": "true", 2024-09-15T12:18:51.137 INFO:teuthology.orchestra.run.smithi077.stdout: "restapi_base_url": "", 2024-09-15T12:18:51.138 INFO:teuthology.orchestra.run.smithi077.stdout: "restapi_log_level": "", 2024-09-15T12:18:51.138 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-15T12:18:51.138 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-15T12:18:51.138 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_acl_grants_max_num": "100", 2024-09-15T12:18:51.138 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_admin_entry": "admin", 2024-09-15T12:18:51.138 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-15T12:18:51.138 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_asio_assert_yielding": "false", 2024-09-15T12:18:51.138 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_backend_store": "rados", 2024-09-15T12:18:51.138 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_barbican_url": "", 2024-09-15T12:18:51.138 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_beast_enable_async": "true", 2024-09-15T12:18:51.138 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_bucket_counters_cache": "false", 2024-09-15T12:18:51.138 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-15T12:18:51.138 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-15T12:18:51.138 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-15T12:18:51.138 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-15T12:18:51.139 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-15T12:18:51.139 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-15T12:18:51.139 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-15T12:18:51.139 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-15T12:18:51.139 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_cache_enabled": "true", 2024-09-15T12:18:51.139 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_cache_expiry_interval": "900", 2024-09-15T12:18:51.139 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_cache_lru_size": "25000", 2024-09-15T12:18:51.139 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_config_store": "rados", 2024-09-15T12:18:51.139 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_content_length_compat": "false", 2024-09-15T12:18:51.139 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_copy_obj_progress": "true", 2024-09-15T12:18:51.139 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-15T12:18:51.139 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_cors_rules_max_num": "100", 2024-09-15T12:18:51.139 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_cross_domain_policy": "", 2024-09-15T12:18:51.139 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-15T12:18:51.139 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_kmip_addr": "", 2024-09-15T12:18:51.140 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-15T12:18:51.140 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-15T12:18:51.140 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-15T12:18:51.140 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-15T12:18:51.140 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_kmip_password": "", 2024-09-15T12:18:51.140 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-15T12:18:51.140 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_kmip_username": "", 2024-09-15T12:18:51.140 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_require_ssl": "true", 2024-09-15T12:18:51.140 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-15T12:18:51.140 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-15T12:18:51.140 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-15T12:18:51.140 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-15T12:18:51.140 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-15T12:18:51.140 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-15T12:18:51.141 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-15T12:18:51.141 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-15T12:18:51.141 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-15T12:18:51.141 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-15T12:18:51.141 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-15T12:18:51.141 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-15T12:18:51.141 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-15T12:18:51.141 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-15T12:18:51.141 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-15T12:18:51.141 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_vault_addr": "", 2024-09-15T12:18:51.141 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_vault_auth": "token", 2024-09-15T12:18:51.141 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_vault_namespace": "", 2024-09-15T12:18:51.141 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_vault_prefix": "", 2024-09-15T12:18:51.142 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-15T12:18:51.142 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-15T12:18:51.142 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-15T12:18:51.142 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-15T12:18:51.142 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_vault_token_file": "", 2024-09-15T12:18:51.142 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-15T12:18:51.142 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_curl_buffersize": "524288", 2024-09-15T12:18:51.142 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-15T12:18:51.142 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_curl_low_speed_time": "300", 2024-09-15T12:18:51.142 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-15T12:18:51.142 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-15T12:18:51.142 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-15T12:18:51.142 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-15T12:18:51.142 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-15T12:18:51.142 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-15T12:18:51.143 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-15T12:18:51.143 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-15T12:18:51.143 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-15T12:18:51.143 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-15T12:18:51.143 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2024-09-15T12:18:51.143 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2024-09-15T12:18:51.143 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-09-15T12:18:51.143 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-09-15T12:18:51.143 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-09-15T12:18:51.143 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_d4n_l1_fadvise": "4", 2024-09-15T12:18:51.143 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-09-15T12:18:51.143 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-09-15T12:18:51.143 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-15T12:18:51.143 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_data_log_changes_size": "1000", 2024-09-15T12:18:51.143 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_data_log_num_shards": "128", 2024-09-15T12:18:51.144 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-15T12:18:51.144 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_data_log_window": "30", 2024-09-15T12:18:51.144 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-15T12:18:51.144 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-15T12:18:51.144 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-15T12:18:51.144 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-15T12:18:51.144 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-15T12:18:51.144 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-15T12:18:51.144 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-15T12:18:51.144 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-15T12:18:51.144 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-15T12:18:51.144 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-15T12:18:51.144 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-15T12:18:51.144 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-15T12:18:51.144 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-15T12:18:51.145 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_disable_s3select": "false", 2024-09-15T12:18:51.145 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-15T12:18:51.145 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-15T12:18:51.145 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-15T12:18:51.145 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-15T12:18:51.145 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-15T12:18:51.145 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-15T12:18:51.145 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-15T12:18:51.145 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-15T12:18:51.145 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-15T12:18:51.145 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-15T12:18:51.145 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-15T12:18:51.145 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-15T12:18:51.145 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_dns_name": "", 2024-09-15T12:18:51.146 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_dns_s3website_name": "", 2024-09-15T12:18:51.146 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_dynamic_resharding": "true", 2024-09-15T12:18:51.146 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2024-09-15T12:18:51.146 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2024-09-15T12:18:51.146 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-15T12:18:51.146 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_enable_gc_threads": "true", 2024-09-15T12:18:51.146 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_enable_lc_threads": "true", 2024-09-15T12:18:51.146 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_enable_mdsearch": "true", 2024-09-15T12:18:51.146 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_enable_ops_log": "false", 2024-09-15T12:18:51.146 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_enable_quota_threads": "true", 2024-09-15T12:18:51.146 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_enable_static_website": "false", 2024-09-15T12:18:51.146 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_enable_usage_log": "false", 2024-09-15T12:18:51.146 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_enforce_swift_acls": "true", 2024-09-15T12:18:51.146 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_exit_timeout_secs": "120", 2024-09-15T12:18:51.146 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_expose_bucket": "false", 2024-09-15T12:18:51.147 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_extended_http_attrs": "", 2024-09-15T12:18:51.147 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_filter": "none", 2024-09-15T12:18:51.147 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-15T12:18:51.147 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_frontends": "beast port=7480", 2024-09-15T12:18:51.147 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-15T12:18:51.147 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_gc_max_deferred": "50", 2024-09-15T12:18:51.147 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-15T12:18:51.147 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_gc_max_objs": "32", 2024-09-15T12:18:51.147 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-15T12:18:51.147 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-15T12:18:51.147 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-15T12:18:51.147 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-15T12:18:51.147 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_gc_processor_period": "3600", 2024-09-15T12:18:51.147 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-15T12:18:51.147 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-15T12:18:51.148 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-15T12:18:51.148 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-15T12:18:51.148 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_init_timeout": "300", 2024-09-15T12:18:51.148 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-15T12:18:51.148 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-15T12:18:51.148 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_kafka_connection_idle": "300", 2024-09-15T12:18:51.148 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-15T12:18:51.148 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-15T12:18:51.148 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-15T12:18:51.148 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-15T12:18:51.148 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-15T12:18:51.148 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_admin_domain": "", 2024-09-15T12:18:51.148 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_admin_password": "", 2024-09-15T12:18:51.148 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_admin_password_path": "", 2024-09-15T12:18:51.148 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_admin_project": "", 2024-09-15T12:18:51.149 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_admin_tenant": "", 2024-09-15T12:18:51.149 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_admin_token": "", 2024-09-15T12:18:51.149 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_admin_token_path": "", 2024-09-15T12:18:51.149 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_admin_user": "", 2024-09-15T12:18:51.149 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_barbican_domain": "", 2024-09-15T12:18:51.149 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_barbican_password": "", 2024-09-15T12:18:51.149 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_barbican_project": "", 2024-09-15T12:18:51.149 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-15T12:18:51.149 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_barbican_user": "", 2024-09-15T12:18:51.149 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-15T12:18:51.149 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-15T12:18:51.149 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-15T12:18:51.149 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-15T12:18:51.149 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-15T12:18:51.149 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_url": "", 2024-09-15T12:18:51.150 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-15T12:18:51.150 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_lc_debug_interval": "-1", 2024-09-15T12:18:51.150 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_lc_lock_max_time": "90", 2024-09-15T12:18:51.150 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_lc_max_objs": "32", 2024-09-15T12:18:51.150 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_lc_max_rules": "1000", 2024-09-15T12:18:51.150 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_lc_max_worker": "3", 2024-09-15T12:18:51.150 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-15T12:18:51.150 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_lc_thread_delay": "0", 2024-09-15T12:18:51.150 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-15T12:18:51.150 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_ldap_dnattr": "uid", 2024-09-15T12:18:51.150 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-15T12:18:51.150 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_ldap_searchfilter": "", 2024-09-15T12:18:51.150 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-15T12:18:51.150 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_ldap_uri": "", 2024-09-15T12:18:51.151 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_lfuda_sync_frequency": "60", 2024-09-15T12:18:51.151 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-15T12:18:51.151 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-15T12:18:51.151 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-15T12:18:51.151 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_log_http_headers": "", 2024-09-15T12:18:51.151 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-15T12:18:51.151 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-15T12:18:51.151 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_log_object_name_utc": "false", 2024-09-15T12:18:51.151 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-15T12:18:51.151 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-15T12:18:51.151 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_max_attr_name_len": "0", 2024-09-15T12:18:51.151 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_max_attr_size": "0", 2024-09-15T12:18:51.151 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-15T12:18:51.151 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_max_chunk_size": "4194304", 2024-09-15T12:18:51.151 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-15T12:18:51.151 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-15T12:18:51.152 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-15T12:18:51.152 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_max_listing_results": "5000", 2024-09-15T12:18:51.152 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_max_notify_retries": "10", 2024-09-15T12:18:51.152 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-15T12:18:51.152 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_max_put_param_size": "1048576", 2024-09-15T12:18:51.152 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_max_put_size": "5368709120", 2024-09-15T12:18:51.152 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_max_slo_entries": "1000", 2024-09-15T12:18:51.152 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_md_log_max_shards": "64", 2024-09-15T12:18:51.152 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-15T12:18:51.152 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-15T12:18:51.152 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-15T12:18:51.152 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-15T12:18:51.152 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_mp_lock_max_time": "600", 2024-09-15T12:18:51.152 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-15T12:18:51.152 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-15T12:18:51.153 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-15T12:18:51.153 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-15T12:18:51.153 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-15T12:18:51.153 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-15T12:18:51.153 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-15T12:18:51.153 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-15T12:18:51.153 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_nfs_max_gc": "300", 2024-09-15T12:18:51.153 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-15T12:18:51.153 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-15T12:18:51.153 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-15T12:18:51.153 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-15T12:18:51.153 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-15T12:18:51.153 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-15T12:18:51.153 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-15T12:18:51.153 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_num_async_rados_threads": "32", 2024-09-15T12:18:51.154 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_num_control_oids": "8", 2024-09-15T12:18:51.154 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_numa_node": "-1", 2024-09-15T12:18:51.154 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-15T12:18:51.154 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-15T12:18:51.154 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_objexp_chunk_size": "100", 2024-09-15T12:18:51.154 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_objexp_gc_interval": "600", 2024-09-15T12:18:51.154 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-15T12:18:51.154 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-15T12:18:51.154 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-15T12:18:51.154 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_op_thread_timeout": "600", 2024-09-15T12:18:51.154 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_op_tracing": "false", 2024-09-15T12:18:51.154 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_opa_token": "", 2024-09-15T12:18:51.154 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_opa_url": "", 2024-09-15T12:18:51.154 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_opa_verify_ssl": "true", 2024-09-15T12:18:51.154 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-15T12:18:51.155 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-15T12:18:51.155 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_ops_log_rados": "false", 2024-09-15T12:18:51.155 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_ops_log_socket_path": "", 2024-09-15T12:18:51.155 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-15T12:18:51.155 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-15T12:18:51.155 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-15T12:18:51.155 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_period_push_interval": "2.000000", 2024-09-15T12:18:51.155 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-15T12:18:51.155 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-15T12:18:51.155 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-15T12:18:51.155 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-15T12:18:51.155 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_posix_cache_lanes": "3", 2024-09-15T12:18:51.155 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-15T12:18:51.155 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-15T12:18:51.156 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_posix_cache_partitions": "3", 2024-09-15T12:18:51.156 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-15T12:18:51.156 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_print_continue": "true", 2024-09-15T12:18:51.156 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-15T12:18:51.156 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-15T12:18:51.156 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-15T12:18:51.156 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-15T12:18:51.156 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-15T12:18:51.156 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_rados_tracing": "false", 2024-09-15T12:18:51.156 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_realm": "", 2024-09-15T12:18:51.156 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_realm_id": "", 2024-09-15T12:18:51.156 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-15T12:18:51.156 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_region": "", 2024-09-15T12:18:51.156 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-15T12:18:51.157 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-15T12:18:51.157 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-15T12:18:51.157 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-15T12:18:51.157 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_request_uri": "", 2024-09-15T12:18:51.157 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_reshard_batch_size": "64", 2024-09-15T12:18:51.157 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-15T12:18:51.157 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_reshard_debug_interval": "-1", 2024-09-15T12:18:51.157 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_reshard_max_aio": "128", 2024-09-15T12:18:51.157 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_reshard_num_logs": "16", 2024-09-15T12:18:51.157 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_reshard_progress_judge_interval": "120", 2024-09-15T12:18:51.157 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2024-09-15T12:18:51.157 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_reshard_thread_interval": "600", 2024-09-15T12:18:51.157 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_reshardlog_threshold": "30000", 2024-09-15T12:18:51.157 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_resolve_cname": "false", 2024-09-15T12:18:51.157 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-15T12:18:51.158 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_run_sync_thread": "true", 2024-09-15T12:18:51.158 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-15T12:18:51.158 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-15T12:18:51.158 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-15T12:18:51.158 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-15T12:18:51.158 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-15T12:18:51.158 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-15T12:18:51.158 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-15T12:18:51.158 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-15T12:18:51.158 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-15T12:18:51.158 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_scheduler_type": "throttler", 2024-09-15T12:18:51.158 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_script_uri": "", 2024-09-15T12:18:51.158 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_service_provider_name": "", 2024-09-15T12:18:51.158 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-15T12:18:51.158 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sts_client_id": "", 2024-09-15T12:18:51.158 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sts_client_secret": "", 2024-09-15T12:18:51.159 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sts_entry": "sts", 2024-09-15T12:18:51.159 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sts_key": "sts", 2024-09-15T12:18:51.159 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-15T12:18:51.159 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sts_min_session_duration": "900", 2024-09-15T12:18:51.159 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sts_token_introspection_url": "", 2024-09-15T12:18:51.159 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_swift_account_in_url": "false", 2024-09-15T12:18:51.159 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_swift_auth_entry": "auth", 2024-09-15T12:18:51.159 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_swift_auth_url": "", 2024-09-15T12:18:51.159 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_swift_custom_header": "", 2024-09-15T12:18:51.159 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-15T12:18:51.159 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_swift_need_stats": "true", 2024-09-15T12:18:51.159 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_swift_tenant_name": "", 2024-09-15T12:18:51.159 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_swift_token_expiration": "86400", 2024-09-15T12:18:51.159 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_swift_url": "", 2024-09-15T12:18:51.159 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_swift_url_prefix": "swift", 2024-09-15T12:18:51.160 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-15T12:18:51.160 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-15T12:18:51.160 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-15T12:18:51.160 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sync_lease_period": "120", 2024-09-15T12:18:51.160 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-15T12:18:51.160 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-15T12:18:51.160 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-15T12:18:51.160 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-15T12:18:51.160 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-15T12:18:51.160 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-15T12:18:51.160 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-15T12:18:51.160 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-15T12:18:51.160 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-15T12:18:51.160 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_thread_pool_size": "512", 2024-09-15T12:18:51.160 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-15T12:18:51.161 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-15T12:18:51.161 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-15T12:18:51.161 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-15T12:18:51.161 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_torrent_comment": "", 2024-09-15T12:18:51.161 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_torrent_createby": "", 2024-09-15T12:18:51.161 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_torrent_encoding": "", 2024-09-15T12:18:51.161 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_torrent_flag": "false", 2024-09-15T12:18:51.161 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-15T12:18:51.161 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_torrent_origin": "", 2024-09-15T12:18:51.161 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-15T12:18:51.161 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_torrent_tracker": "", 2024-09-15T12:18:51.161 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_trust_forwarded_https": "false", 2024-09-15T12:18:51.161 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-15T12:18:51.161 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-15T12:18:51.162 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_usage_max_shards": "32", 2024-09-15T12:18:51.162 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_usage_max_user_shards": "1", 2024-09-15T12:18:51.162 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_use_opa_authz": "false", 2024-09-15T12:18:51.162 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_user_counters_cache": "false", 2024-09-15T12:18:51.162 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-15T12:18:51.162 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-15T12:18:51.162 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-15T12:18:51.162 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_user_max_buckets": "1000", 2024-09-15T12:18:51.162 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_user_policies_max_num": "100", 2024-09-15T12:18:51.162 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-15T12:18:51.162 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-15T12:18:51.162 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-15T12:18:51.162 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-15T12:18:51.162 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_user_unique_email": "true", 2024-09-15T12:18:51.162 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_verify_ssl": "true", 2024-09-15T12:18:51.163 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-15T12:18:51.163 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_zone": "", 2024-09-15T12:18:51.163 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_zone_id": "", 2024-09-15T12:18:51.163 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-15T12:18:51.163 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_zonegroup": "", 2024-09-15T12:18:51.163 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_zonegroup_id": "", 2024-09-15T12:18:51.163 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-15T12:18:51.163 INFO:teuthology.orchestra.run.smithi077.stdout: "rgwlc_auto_session_clear": "true", 2024-09-15T12:18:51.163 INFO:teuthology.orchestra.run.smithi077.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-15T12:18:51.163 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_block_size": "4096", 2024-09-15T12:18:51.163 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-15T12:18:51.163 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-15T12:18:51.163 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-15T12:18:51.163 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-15T12:18:51.163 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-15T12:18:51.164 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_cache_size": "536870912", 2024-09-15T12:18:51.164 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-15T12:18:51.164 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-15T12:18:51.164 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-15T12:18:51.164 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-15T12:18:51.164 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-15T12:18:51.164 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-15T12:18:51.164 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-15T12:18:51.164 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-15T12:18:51.164 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_index_type": "binary_search", 2024-09-15T12:18:51.164 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-15T12:18:51.164 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-15T12:18:51.164 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_partition_filters": "false", 2024-09-15T12:18:51.164 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_perf": "false", 2024-09-15T12:18:51.165 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-15T12:18:51.165 INFO:teuthology.orchestra.run.smithi077.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-15T12:18:51.165 INFO:teuthology.orchestra.run.smithi077.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-15T12:18:51.165 INFO:teuthology.orchestra.run.smithi077.stdout: "run_dir": "/var/run/ceph", 2024-09-15T12:18:51.165 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_block_create": "true", 2024-09-15T12:18:51.165 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_cache_lru_size": "67108864", 2024-09-15T12:18:51.165 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-15T12:18:51.165 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-15T12:18:51.165 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_default_max_object_size": "16777216", 2024-09-15T12:18:51.165 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-15T12:18:51.165 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_device_size": "53687091200", 2024-09-15T12:18:51.165 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-15T12:18:51.165 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_full_integrity_check": "false", 2024-09-15T12:18:51.165 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_journal_batch_capacity": "16", 2024-09-15T12:18:51.166 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-15T12:18:51.166 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-15T12:18:51.166 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-15T12:18:51.166 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_main_device_type": "SSD", 2024-09-15T12:18:51.166 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-15T12:18:51.166 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-15T12:18:51.166 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-15T12:18:51.166 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-15T12:18:51.166 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-15T12:18:51.166 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-15T12:18:51.166 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_segment_size": "67108864", 2024-09-15T12:18:51.166 INFO:teuthology.orchestra.run.smithi077.stdout: "set_keepcaps": "false", 2024-09-15T12:18:51.166 INFO:teuthology.orchestra.run.smithi077.stdout: "setgroup": "", 2024-09-15T12:18:51.166 INFO:teuthology.orchestra.run.smithi077.stdout: "setuser": "", 2024-09-15T12:18:51.166 INFO:teuthology.orchestra.run.smithi077.stdout: "setuser_match_path": "", 2024-09-15T12:18:51.167 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-15T12:18:51.167 INFO:teuthology.orchestra.run.smithi077.stdout: "thp": "false", 2024-09-15T12:18:51.167 INFO:teuthology.orchestra.run.smithi077.stdout: "threadpool_default_timeout": "60", 2024-09-15T12:18:51.167 INFO:teuthology.orchestra.run.smithi077.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-15T12:18:51.167 INFO:teuthology.orchestra.run.smithi077.stdout: "throttler_perf_counter": "true", 2024-09-15T12:18:51.167 INFO:teuthology.orchestra.run.smithi077.stdout: "tmp_dir": "/tmp", 2024-09-15T12:18:51.167 INFO:teuthology.orchestra.run.smithi077.stdout: "tmp_file_template": "/tmp/ceph-mon.a.XXXXXX", 2024-09-15T12:18:51.167 INFO:teuthology.orchestra.run.smithi077.stdout: "uadk_compressor_enabled": "false", 2024-09-15T12:18:51.167 INFO:teuthology.orchestra.run.smithi077.stdout: "uadk_wd_sync_ctx_num": "2" 2024-09-15T12:18:51.167 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T12:18:51.169 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-15T12:18:51.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:51.271+0000 7f153fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:51.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:51.277+0000 7f153fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:51.293 INFO:teuthology.orchestra.run.smithi077.stdout:{} 2024-09-15T12:18:51.293 INFO:teuthology.orchestra.run.smithi077.stderr:mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-15T12:18:51.303 DEBUG:teuthology.orchestra.run.smithi077:> type ceph-objectstore-tool 2024-09-15T12:18:51.317 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-15T12:18:51.318 DEBUG:teuthology.orchestra.run.smithi138:> type ceph-objectstore-tool 2024-09-15T12:18:51.336 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-15T12:18:51.336 INFO:teuthology.run_tasks:Running task full_sequential... 2024-09-15T12:18:51.353 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-15T12:18:51.354 INFO:tasks.radosbench:Beginning radosbench... 2024-09-15T12:18:51.354 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2024-09-15T12:18:51.355 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2024-09-15T12:18:51.355 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-15T12:18:51.355 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:18:51.355 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:18:51.355 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:18:51.355 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:18:51.356 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-15T12:18:51.356 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:18:51.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:51.466+0000 7fa3b2ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:51.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:51.471+0000 7fa3b2ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:51.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:51.466+0000 7f4b03b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:51.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:51.466+0000 7fe412791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:51.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:51.477+0000 7f4b03b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:51.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:51.479+0000 7fe412791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:51.499 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:18:51.499 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:18:51.499 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:18:51.499 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:18:51.499 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:18:51.499 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:18:51.500 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:18:51.500 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:18:51.500 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:18:51.500 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:18:51.500 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:18:51.500 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:18:51.503 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:18:51.504 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:18:51.504 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:18:51.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:51.613+0000 7f32f60d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:51.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:51.622+0000 7f32f60d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:18:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:18:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:18:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:18:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:18:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:18:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:18:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:18:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:18:51.640 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:18:51.641 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:18:51.641 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:18:51.643 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:18:51.643 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:18:51.643 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:18:51.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:51.787+0000 7f03d8151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:51.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:51.796+0000 7f03d8151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:51.815 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:18:51.815 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:18:51.815 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:18:51.815 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:18:51.815 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:18:51.815 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:18:51.815 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:18:51.815 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:18:51.815 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:18:51.815 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:18:51.815 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:18:51.815 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:18:51.817 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:18:51.818 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:18:51.818 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:18:51.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:51.920+0000 7f015f6bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:51.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:51.929+0000 7f015f6bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:51.946 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:18:51.946 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:18:51.947 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:18:51.947 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:18:51.947 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:18:51.947 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:18:51.947 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:18:51.947 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:18:51.947 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:18:51.947 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:18:51.947 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:18:51.947 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:18:51.950 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:18:51.950 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:18:51.974 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'unique_pool_0' created 2024-09-15T12:18:51.993 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-09-15T12:18:52.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:52.142+0000 7f805a391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:52.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:52.155+0000 7f805a391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:52.976 INFO:teuthology.orchestra.run.smithi077.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-09-15T12:18:53.607 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:18:53.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:53.710+0000 7f9bce2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:53.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:53.716+0000 7f9bce2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:53.996 DEBUG:teuthology.orchestra.run.smithi077:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_0 bench 90 write' 2024-09-15T12:18:53.998 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-15T12:18:53.998 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-15T12:18:54.062 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:hints = 1 2024-09-15T12:18:54.062 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-15T12:18:54.062 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Object prefix: benchmark_data_smithi077_30743 2024-09-15T12:18:54.062 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-15T12:18:54.063 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 0 0 0 0 0 0 - 0 2024-09-15T12:18:55.062 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 1 16 202 186 11.6244 11.625 0.0422733 0.0829353 2024-09-15T12:18:55.816 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:18:55.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:55.955+0000 7f0ad986c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:55.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:55.962+0000 7f0ad986c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:56.062 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 2 16 384 368 11.4992 11.375 0.0569266 0.0849285 2024-09-15T12:18:56.951 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:18:56.951 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:18:56.951 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:18:56.951 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:18:57.063 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 3 16 563 547 11.3949 11.1875 0.0432928 0.0861159 2024-09-15T12:18:57.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:57.117+0000 7f311649c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:57.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:57.129+0000 7f311649c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:57.158 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:18:57.159 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:18:57.159 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:18:57.159 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:18:57.159 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:18:57.159 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:18:57.159 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:18:57.159 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:18:57.159 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:18:57.159 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:18:57.159 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:18:57.159 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:18:57.162 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:18:57.163 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:18:57.163 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:18:57.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:57.303+0000 7f5543e63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:57.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:57.319+0000 7f5543e63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:57.402 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:18:57.402 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:18:57.402 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:18:57.402 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:18:57.402 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:18:57.402 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:18:57.402 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:18:57.402 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:18:57.402 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:18:57.402 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:18:57.403 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:18:57.403 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:18:57.405 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:18:57.405 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:18:57.406 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:18:57.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:57.568+0000 7f29dd4bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:57.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:57.586+0000 7f29dd4bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:57.621 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:18:57.621 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:18:57.622 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:18:57.622 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:18:57.622 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:18:57.622 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:18:57.622 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:18:57.622 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:18:57.622 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:18:57.622 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:18:57.622 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:18:57.622 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:18:57.626 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:18:57.626 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:18:57.627 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:18:57.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:57.772+0000 7f32f5111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:57.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:57.786+0000 7f32f5111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:57.946 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:18:57.946 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:18:57.946 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:18:57.946 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:18:57.946 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:18:57.946 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:18:57.946 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:18:57.946 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:18:57.946 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:18:57.946 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:18:57.946 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:18:57.947 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:18:57.950 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:18:57.951 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:18:58.063 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 4 16 750 734 11.4678 11.6875 0.0825104 0.0862728 2024-09-15T12:18:58.320 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:18:58.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:58.460+0000 7fb3cf711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:58.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:18:58.468+0000 7fb3cf711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:18:59.063 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 5 16 917 901 11.2616 10.4375 0.177791 0.0876894 2024-09-15T12:19:00.063 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 6 16 1109 1093 11.3845 12 0.0843025 0.0873143 2024-09-15T12:19:00.820 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:19:00.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:00.969+0000 7fabbcb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:00.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:00.976+0000 7fabbcb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:01.063 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 7 16 1295 1279 11.4187 11.625 0.0695161 0.086899 2024-09-15T12:19:02.063 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 8 16 1481 1465 11.4443 11.625 0.0687949 0.0869035 2024-09-15T12:19:02.951 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:19:02.952 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:19:02.952 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:19:03.063 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 9 16 1672 1656 11.499 11.9375 0.0825648 0.0865651 2024-09-15T12:19:03.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:03.100+0000 7f080b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:03.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:03.114+0000 7f080b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:03.398 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:19:03.426 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:19:03.426 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:19:03.445 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-15T12:19:01.705638+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108048,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379312,"statfs":{"total":386547056640,"available":386436415488,"internally_reserved":0,"allocated":704512,"data_stored":1907549,"data_compressed":90096,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.729627"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:18:51.971548+0000","last_change":"2024-09-15T12:18:51.971548+0000","last_active":"2024-09-15T12:18:51.971548+0000","last_peered":"2024-09-15T12:18:51.971548+0000","last_clean":"2024-09-15T12:18:51.971548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:18:51.971548+0000","last_undegraded":"2024-09-15T12:18:51.971548+0000","last_fullsized":"2024-09-15T12:18:51.971548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:18:51.971548+0000","last_change":"2024-09-15T12:18:51.971548+0000","last_active":"2024-09-15T12:18:51.971548+0000","last_peered":"2024-09-15T12:18:51.971548+0000","last_clean":"2024-09-15T12:18:51.971548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:18:51.971548+0000","last_undegraded":"2024-09-15T12:18:51.971548+0000","last_fullsized":"2024-09-15T12:18:51.971548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:18:51.971548+0000","last_change":"2024-09-15T12:18:51.971548+0000","last_active":"2024-09-15T12:18:51.971548+0000","last_peered":"2024-09-15T12:18:51.971548+0000","last_clean":"2024-09-15T12:18:51.971548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:18:51.971548+0000","last_undegraded":"2024-09-15T12:18:51.971548+0000","last_fullsized":"2024-09-15T12:18:51.971548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:18:51.971548+0000","last_change":"2024-09-15T12:18:51.971548+0000","last_active":"2024-09-15T12:18:51.971548+0000","last_peered":"2024-09-15T12:18:51.971548+0000","last_clean":"2024-09-15T12:18:51.971548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:18:51.971548+0000","last_undegraded":"2024-09-15T12:18:51.971548+0000","last_fullsized":"2024-09-15T12:18:51.971548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:18:51.971548+0000","last_change":"2024-09-15T12:18:51.971548+0000","last_active":"2024-09-15T12:18:51.971548+0000","last_peered":"2024-09-15T12:18:51.971548+0000","last_clean":"2024-09-15T12:18:51.971548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:18:51.971548+0000","last_undegraded":"2024-09-15T12:18:51.971548+0000","last_fullsized":"2024-09-15T12:18:51.971548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:18:51.971548+0000","last_change":"2024-09-15T12:18:51.971548+0000","last_active":"2024-09-15T12:18:51.971548+0000","last_peered":"2024-09-15T12:18:51.971548+0000","last_clean":"2024-09-15T12:18:51.971548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:18:51.971548+0000","last_undegraded":"2024-09-15T12:18:51.971548+0000","last_fullsized":"2024-09-15T12:18:51.971548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:18:51.971548+0000","last_change":"2024-09-15T12:18:51.971548+0000","last_active":"2024-09-15T12:18:51.971548+0000","last_peered":"2024-09-15T12:18:51.971548+0000","last_clean":"2024-09-15T12:18:51.971548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:18:51.971548+0000","last_undegraded":"2024-09-15T12:18:51.971548+0000","last_fullsized":"2024-09-15T12:18:51.971548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:18:51.971548+0000","last_change":"2024-09-15T12:18:51.971548+0000","last_active":"2024-09-15T12:18:51.971548+0000","last_peered":"2024-09-15T12:18:51.971548+0000","last_clean":"2024-09-15T12:18:51.971548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:18:51.971548+0000","last_undegraded":"2024-09-15T12:18:51.971548+0000","last_fullsized":"2024-09-15T12:18:51.971548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":88,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.764571+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:18:46.764571+0000","last_peered":"2024-09-15T12:18:46.764571+0000","last_clean":"2024-09-15T12:18:46.764571+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:18:46.764571+0000","last_undegraded":"2024-09-15T12:18:46.764571+0000","last_fullsized":"2024-09-15T12:18:46.764571+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.767072+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:18:46.767072+0000","last_peered":"2024-09-15T12:18:46.767072+0000","last_clean":"2024-09-15T12:18:46.767072+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:18:46.767072+0000","last_undegraded":"2024-09-15T12:18:46.767072+0000","last_fullsized":"2024-09-15T12:18:46.767072+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:18:51.971548+0000","last_change":"2024-09-15T12:18:51.971548+0000","last_active":"2024-09-15T12:18:51.971548+0000","last_peered":"2024-09-15T12:18:51.971548+0000","last_clean":"2024-09-15T12:18:51.971548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:18:51.971548+0000","last_undegraded":"2024-09-15T12:18:51.971548+0000","last_fullsized":"2024-09-15T12:18:51.971548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.767335+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:18:46.767335+0000","last_peered":"2024-09-15T12:18:46.767335+0000","last_clean":"2024-09-15T12:18:46.767335+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:18:46.767335+0000","last_undegraded":"2024-09-15T12:18:46.767335+0000","last_fullsized":"2024-09-15T12:18:46.767335+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:18:51.971548+0000","last_change":"2024-09-15T12:18:51.971548+0000","last_active":"2024-09-15T12:18:51.971548+0000","last_peered":"2024-09-15T12:18:51.971548+0000","last_clean":"2024-09-15T12:18:51.971548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:18:51.971548+0000","last_undegraded":"2024-09-15T12:18:51.971548+0000","last_fullsized":"2024-09-15T12:18:51.971548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.761050+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:18:46.761050+0000","last_peered":"2024-09-15T12:18:46.761050+0000","last_clean":"2024-09-15T12:18:46.761050+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:18:46.761050+0000","last_undegraded":"2024-09-15T12:18:46.761050+0000","last_fullsized":"2024-09-15T12:18:46.761050+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:18:51.971548+0000","last_change":"2024-09-15T12:18:51.971548+0000","last_active":"2024-09-15T12:18:51.971548+0000","last_peered":"2024-09-15T12:18:51.971548+0000","last_clean":"2024-09-15T12:18:51.971548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:18:51.971548+0000","last_undegraded":"2024-09-15T12:18:51.971548+0000","last_fullsized":"2024-09-15T12:18:51.971548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.765125+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:18:46.765125+0000","last_peered":"2024-09-15T12:18:46.765125+0000","last_clean":"2024-09-15T12:18:46.765125+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:18:46.765125+0000","last_undegraded":"2024-09-15T12:18:46.765125+0000","last_fullsized":"2024-09-15T12:18:46.765125+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:18:51.971548+0000","last_change":"2024-09-15T12:18:51.971548+0000","last_active":"2024-09-15T12:18:51.971548+0000","last_peered":"2024-09-15T12:18:51.971548+0000","last_clean":"2024-09-15T12:18:51.971548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:18:51.971548+0000","last_undegraded":"2024-09-15T12:18:51.971548+0000","last_fullsized":"2024-09-15T12:18:51.971548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:18:51.971548+0000","last_change":"2024-09-15T12:18:51.971548+0000","last_active":"2024-09-15T12:18:51.971548+0000","last_peered":"2024-09-15T12:18:51.971548+0000","last_clean":"2024-09-15T12:18:51.971548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:18:51.971548+0000","last_undegraded":"2024-09-15T12:18:51.971548+0000","last_fullsized":"2024-09-15T12:18:51.971548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.764185+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:18:46.764185+0000","last_peered":"2024-09-15T12:18:46.764185+0000","last_clean":"2024-09-15T12:18:46.764185+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:18:46.764185+0000","last_undegraded":"2024-09-15T12:18:46.764185+0000","last_fullsized":"2024-09-15T12:18:46.764185+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:18:51.971548+0000","last_change":"2024-09-15T12:18:51.971548+0000","last_active":"2024-09-15T12:18:51.971548+0000","last_peered":"2024-09-15T12:18:51.971548+0000","last_clean":"2024-09-15T12:18:51.971548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:18:51.971548+0000","last_undegraded":"2024-09-15T12:18:51.971548+0000","last_fullsized":"2024-09-15T12:18:51.971548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.768342+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:18:46.768342+0000","last_peered":"2024-09-15T12:18:46.768342+0000","last_clean":"2024-09-15T12:18:46.768342+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:18:46.768342+0000","last_undegraded":"2024-09-15T12:18:46.768342+0000","last_fullsized":"2024-09-15T12:18:46.768342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:18:51.971548+0000","last_change":"2024-09-15T12:18:51.971548+0000","last_active":"2024-09-15T12:18:51.971548+0000","last_peered":"2024-09-15T12:18:51.971548+0000","last_clean":"2024-09-15T12:18:51.971548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:18:51.971548+0000","last_undegraded":"2024-09-15T12:18:51.971548+0000","last_fullsized":"2024-09-15T12:18:51.971548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.764197+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:18:46.764197+0000","last_peered":"2024-09-15T12:18:46.764197+0000","last_clean":"2024-09-15T12:18:46.764197+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:18:46.764197+0000","last_undegraded":"2024-09-15T12:18:46.764197+0000","last_fullsized":"2024-09-15T12:18:46.764197+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:18:51.971548+0000","last_change":"2024-09-15T12:18:51.971548+0000","last_active":"2024-09-15T12:18:51.971548+0000","last_peered":"2024-09-15T12:18:51.971548+0000","last_clean":"2024-09-15T12:18:51.971548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:18:51.971548+0000","last_undegraded":"2024-09-15T12:18:51.971548+0000","last_fullsized":"2024-09-15T12:18:51.971548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.765151+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:18:46.765151+0000","last_peered":"2024-09-15T12:18:46.765151+0000","last_clean":"2024-09-15T12:18:46.765151+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:18:46.765151+0000","last_undegraded":"2024-09-15T12:18:46.765151+0000","last_fullsized":"2024-09-15T12:18:46.765151+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27016,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344824,"statfs":{"total":96636764160,"available":96609099776,"internally_reserved":0,"allocated":188416,"data_stored":624465,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":624484,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26960,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344880,"statfs":{"total":96636764160,"available":96609157120,"internally_reserved":0,"allocated":131072,"data_stored":34116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":624484,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:19:03.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:03.535+0000 7fd0de2ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:03.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:03.544+0000 7fd0de2ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:04.063 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 10 16 1856 1840 11.499 11.5 0.044758 0.0866137 2024-09-15T12:19:05.063 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 11 16 2036 2020 11.4763 11.25 0.0521854 0.0867678 2024-09-15T12:19:05.945 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:19:06.063 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 12 16 2228 2212 11.5198 12 0.10422 0.0865187 2024-09-15T12:19:06.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:06.094+0000 7f99c1b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:06.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:06.103+0000 7f99c1b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:07.063 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 13 16 2409 2393 11.5038 11.3125 0.0930807 0.0866073 2024-09-15T12:19:08.064 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 14 16 2606 2590 11.5615 12.3125 0.0724745 0.0862388 2024-09-15T12:19:08.406 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:19:08.447 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:19:08.447 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:19:08.447 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:19:08.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:08.551+0000 7f062d351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:08.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:08.561+0000 7f062d351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:08.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:08.604+0000 7f72cc151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:08.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:08.620+0000 7f72cc151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:08.892 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:19:08.893 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:19:08.912 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-15T12:19:07.706649+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108048,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379312,"statfs":{"total":386547056640,"available":386436415488,"internally_reserved":0,"allocated":704512,"data_stored":1907549,"data_compressed":90096,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002091"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:18:51.971548+0000","last_change":"2024-09-15T12:18:51.971548+0000","last_active":"2024-09-15T12:18:51.971548+0000","last_peered":"2024-09-15T12:18:51.971548+0000","last_clean":"2024-09-15T12:18:51.971548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:18:51.971548+0000","last_undegraded":"2024-09-15T12:18:51.971548+0000","last_fullsized":"2024-09-15T12:18:51.971548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:18:51.971548+0000","last_change":"2024-09-15T12:18:51.971548+0000","last_active":"2024-09-15T12:18:51.971548+0000","last_peered":"2024-09-15T12:18:51.971548+0000","last_clean":"2024-09-15T12:18:51.971548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:18:51.971548+0000","last_undegraded":"2024-09-15T12:18:51.971548+0000","last_fullsized":"2024-09-15T12:18:51.971548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:18:51.971548+0000","last_change":"2024-09-15T12:18:51.971548+0000","last_active":"2024-09-15T12:18:51.971548+0000","last_peered":"2024-09-15T12:18:51.971548+0000","last_clean":"2024-09-15T12:18:51.971548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:18:51.971548+0000","last_undegraded":"2024-09-15T12:18:51.971548+0000","last_fullsized":"2024-09-15T12:18:51.971548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:18:51.971548+0000","last_change":"2024-09-15T12:18:51.971548+0000","last_active":"2024-09-15T12:18:51.971548+0000","last_peered":"2024-09-15T12:18:51.971548+0000","last_clean":"2024-09-15T12:18:51.971548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:18:51.971548+0000","last_undegraded":"2024-09-15T12:18:51.971548+0000","last_fullsized":"2024-09-15T12:18:51.971548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:18:51.971548+0000","last_change":"2024-09-15T12:18:51.971548+0000","last_active":"2024-09-15T12:18:51.971548+0000","last_peered":"2024-09-15T12:18:51.971548+0000","last_clean":"2024-09-15T12:18:51.971548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:18:51.971548+0000","last_undegraded":"2024-09-15T12:18:51.971548+0000","last_fullsized":"2024-09-15T12:18:51.971548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:18:51.971548+0000","last_change":"2024-09-15T12:18:51.971548+0000","last_active":"2024-09-15T12:18:51.971548+0000","last_peered":"2024-09-15T12:18:51.971548+0000","last_clean":"2024-09-15T12:18:51.971548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:18:51.971548+0000","last_undegraded":"2024-09-15T12:18:51.971548+0000","last_fullsized":"2024-09-15T12:18:51.971548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:18:51.971548+0000","last_change":"2024-09-15T12:18:51.971548+0000","last_active":"2024-09-15T12:18:51.971548+0000","last_peered":"2024-09-15T12:18:51.971548+0000","last_clean":"2024-09-15T12:18:51.971548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:18:51.971548+0000","last_undegraded":"2024-09-15T12:18:51.971548+0000","last_fullsized":"2024-09-15T12:18:51.971548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:18:51.971548+0000","last_change":"2024-09-15T12:18:51.971548+0000","last_active":"2024-09-15T12:18:51.971548+0000","last_peered":"2024-09-15T12:18:51.971548+0000","last_clean":"2024-09-15T12:18:51.971548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:18:51.971548+0000","last_undegraded":"2024-09-15T12:18:51.971548+0000","last_fullsized":"2024-09-15T12:18:51.971548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":88,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.764571+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:18:46.764571+0000","last_peered":"2024-09-15T12:18:46.764571+0000","last_clean":"2024-09-15T12:18:46.764571+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:18:46.764571+0000","last_undegraded":"2024-09-15T12:18:46.764571+0000","last_fullsized":"2024-09-15T12:18:46.764571+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":17,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.767072+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:18:46.767072+0000","last_peered":"2024-09-15T12:18:46.767072+0000","last_clean":"2024-09-15T12:18:46.767072+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:18:46.767072+0000","last_undegraded":"2024-09-15T12:18:46.767072+0000","last_fullsized":"2024-09-15T12:18:46.767072+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:18:51.971548+0000","last_change":"2024-09-15T12:18:51.971548+0000","last_active":"2024-09-15T12:18:51.971548+0000","last_peered":"2024-09-15T12:18:51.971548+0000","last_clean":"2024-09-15T12:18:51.971548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:18:51.971548+0000","last_undegraded":"2024-09-15T12:18:51.971548+0000","last_fullsized":"2024-09-15T12:18:51.971548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.767335+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:18:46.767335+0000","last_peered":"2024-09-15T12:18:46.767335+0000","last_clean":"2024-09-15T12:18:46.767335+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:18:46.767335+0000","last_undegraded":"2024-09-15T12:18:46.767335+0000","last_fullsized":"2024-09-15T12:18:46.767335+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:18:51.971548+0000","last_change":"2024-09-15T12:18:51.971548+0000","last_active":"2024-09-15T12:18:51.971548+0000","last_peered":"2024-09-15T12:18:51.971548+0000","last_clean":"2024-09-15T12:18:51.971548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:18:51.971548+0000","last_undegraded":"2024-09-15T12:18:51.971548+0000","last_fullsized":"2024-09-15T12:18:51.971548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.761050+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:18:46.761050+0000","last_peered":"2024-09-15T12:18:46.761050+0000","last_clean":"2024-09-15T12:18:46.761050+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:18:46.761050+0000","last_undegraded":"2024-09-15T12:18:46.761050+0000","last_fullsized":"2024-09-15T12:18:46.761050+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:18:51.971548+0000","last_change":"2024-09-15T12:18:51.971548+0000","last_active":"2024-09-15T12:18:51.971548+0000","last_peered":"2024-09-15T12:18:51.971548+0000","last_clean":"2024-09-15T12:18:51.971548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:18:51.971548+0000","last_undegraded":"2024-09-15T12:18:51.971548+0000","last_fullsized":"2024-09-15T12:18:51.971548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":18,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.765125+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:18:46.765125+0000","last_peered":"2024-09-15T12:18:46.765125+0000","last_clean":"2024-09-15T12:18:46.765125+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:18:46.765125+0000","last_undegraded":"2024-09-15T12:18:46.765125+0000","last_fullsized":"2024-09-15T12:18:46.765125+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:18:51.971548+0000","last_change":"2024-09-15T12:18:51.971548+0000","last_active":"2024-09-15T12:18:51.971548+0000","last_peered":"2024-09-15T12:18:51.971548+0000","last_clean":"2024-09-15T12:18:51.971548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:18:51.971548+0000","last_undegraded":"2024-09-15T12:18:51.971548+0000","last_fullsized":"2024-09-15T12:18:51.971548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:18:51.971548+0000","last_change":"2024-09-15T12:18:51.971548+0000","last_active":"2024-09-15T12:18:51.971548+0000","last_peered":"2024-09-15T12:18:51.971548+0000","last_clean":"2024-09-15T12:18:51.971548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:18:51.971548+0000","last_undegraded":"2024-09-15T12:18:51.971548+0000","last_fullsized":"2024-09-15T12:18:51.971548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.764185+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:18:46.764185+0000","last_peered":"2024-09-15T12:18:46.764185+0000","last_clean":"2024-09-15T12:18:46.764185+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:18:46.764185+0000","last_undegraded":"2024-09-15T12:18:46.764185+0000","last_fullsized":"2024-09-15T12:18:46.764185+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:18:51.971548+0000","last_change":"2024-09-15T12:18:51.971548+0000","last_active":"2024-09-15T12:18:51.971548+0000","last_peered":"2024-09-15T12:18:51.971548+0000","last_clean":"2024-09-15T12:18:51.971548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:18:51.971548+0000","last_undegraded":"2024-09-15T12:18:51.971548+0000","last_fullsized":"2024-09-15T12:18:51.971548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.768342+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:18:46.768342+0000","last_peered":"2024-09-15T12:18:46.768342+0000","last_clean":"2024-09-15T12:18:46.768342+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:18:46.768342+0000","last_undegraded":"2024-09-15T12:18:46.768342+0000","last_fullsized":"2024-09-15T12:18:46.768342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:18:51.971548+0000","last_change":"2024-09-15T12:18:51.971548+0000","last_active":"2024-09-15T12:18:51.971548+0000","last_peered":"2024-09-15T12:18:51.971548+0000","last_clean":"2024-09-15T12:18:51.971548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:18:51.971548+0000","last_undegraded":"2024-09-15T12:18:51.971548+0000","last_fullsized":"2024-09-15T12:18:51.971548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.764197+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:18:46.764197+0000","last_peered":"2024-09-15T12:18:46.764197+0000","last_clean":"2024-09-15T12:18:46.764197+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:18:46.764197+0000","last_undegraded":"2024-09-15T12:18:46.764197+0000","last_fullsized":"2024-09-15T12:18:46.764197+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:18:51.971548+0000","last_change":"2024-09-15T12:18:51.971548+0000","last_active":"2024-09-15T12:18:51.971548+0000","last_peered":"2024-09-15T12:18:51.971548+0000","last_clean":"2024-09-15T12:18:51.971548+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:18:51.971548+0000","last_undegraded":"2024-09-15T12:18:51.971548+0000","last_fullsized":"2024-09-15T12:18:51.971548+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-15T12:18:46.765151+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:18:46.765151+0000","last_peered":"2024-09-15T12:18:46.765151+0000","last_clean":"2024-09-15T12:18:46.765151+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:18:46.765151+0000","last_undegraded":"2024-09-15T12:18:46.765151+0000","last_fullsized":"2024-09-15T12:18:46.765151+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27016,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344824,"statfs":{"total":96636764160,"available":96609099776,"internally_reserved":0,"allocated":188416,"data_stored":624465,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":624484,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26960,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344880,"statfs":{"total":96636764160,"available":96609157120,"internally_reserved":0,"allocated":131072,"data_stored":34116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27036,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344804,"statfs":{"total":96636764160,"available":96609079296,"internally_reserved":0,"allocated":192512,"data_stored":624484,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:19:09.064 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 15 16 2787 2771 11.5448 11.3125 0.139657 0.0863769 2024-09-15T12:19:10.064 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 16 16 2977 2961 11.5654 11.875 0.0599341 0.0861979 2024-09-15T12:19:10.983 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:19:11.064 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 17 16 3158 3142 11.5505 11.3125 0.0352004 0.0862697 2024-09-15T12:19:11.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:11.127+0000 7ffb42311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:11.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:11.137+0000 7ffb42311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:12.064 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 18 16 3342 3326 11.5476 11.5 0.0858804 0.0863427 2024-09-15T12:19:13.064 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 19 16 3539 3523 11.5878 12.3125 0.0258979 0.0860143 2024-09-15T12:19:13.568 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:19:13.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:13.724+0000 7fc1b9f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:13.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:13.732+0000 7fc1b9f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:13.914 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:19:13.914 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:19:13.914 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:19:13.915 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:19:14.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:14.054+0000 7f115b711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:14.064 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:2024-09-15T12:19:14.064029+0000 min lat: 0.0153683 max lat: 0.207536 avg lat: 0.0861828 2024-09-15T12:19:14.064 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-15T12:19:14.064 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 20 16 3717 3701 11.5646 11.125 0.0854697 0.0861828 2024-09-15T12:19:14.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:14.066+0000 7f115b711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:14.116 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:19:14.117 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:19:14.117 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:19:14.117 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:19:14.117 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:19:14.117 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:19:14.117 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:19:14.117 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:19:14.117 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:19:14.117 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:19:14.117 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:19:14.117 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:19:14.121 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:19:14.121 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:19:14.122 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:19:14.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:14.304+0000 7f3f45311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:14.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:14.317+0000 7f3f45311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:14.362 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:19:14.362 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:19:14.363 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:19:14.363 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:19:14.363 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:19:14.363 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:19:14.363 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:19:14.363 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:19:14.363 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:19:14.363 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:19:14.363 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:19:14.363 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:19:14.367 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:19:14.367 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:19:14.368 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:19:14.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:14.516+0000 7f5c4cd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:14.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:14.532+0000 7f5c4cd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:14.632 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:19:14.632 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:19:14.632 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:19:14.632 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:19:14.632 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:19:14.632 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:19:14.633 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:19:14.633 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:19:14.633 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:19:14.633 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:19:14.633 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:19:14.633 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:19:14.636 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:19:14.636 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:19:14.637 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:19:14.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:14.774+0000 7fa44b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:14.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:14.787+0000 7fa44b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:14.943 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:19:14.943 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:19:14.943 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:19:14.943 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:19:14.943 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:19:14.943 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:19:14.943 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:19:14.944 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:19:14.944 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:19:14.944 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:19:14.944 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:19:14.944 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:19:14.946 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:19:14.947 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:19:15.064 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 21 16 3911 3895 11.5913 12.125 0.0725723 0.0860571 2024-09-15T12:19:16.027 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:19:16.064 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 22 16 4088 4072 11.5672 11.0625 0.0715401 0.0862162 2024-09-15T12:19:16.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:16.172+0000 7f1309aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:16.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:16.180+0000 7f1309aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:17.064 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 23 16 4267 4251 11.5506 11.1875 0.0406315 0.0864272 2024-09-15T12:19:18.064 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 24 16 4443 4427 11.5277 11 0.0822469 0.0865149 2024-09-15T12:19:18.563 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:19:18.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:18.706+0000 7efe54551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:18.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:18.714+0000 7efe54551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:19.064 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 25 16 4625 4609 11.5215 11.375 0.0997195 0.0866278 2024-09-15T12:19:19.947 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:19:19.947 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:19:19.948 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:19:20.064 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 26 16 4809 4793 11.5206 11.5 0.136538 0.0866025 2024-09-15T12:19:20.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:20.086+0000 7f0f09591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:20.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:20.101+0000 7f0f09591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:20.381 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:19:20.381 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:19:20.399 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-09-15T12:19:19.708982+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":207487539,"num_objects":3161,"num_object_clones":0,"num_object_copies":9483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3238,"num_write_kb":203156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3212,"ondisk_log_size":3212,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":177544,"kb_used_data":36936,"kb_used_omap":0,"kb_used_meta":140544,"kb_avail":377309816,"statfs":{"total":386547056640,"available":386365251584,"internally_reserved":0,"allocated":37822464,"data_stored":594265301,"data_compressed":28213022,"data_compressed_allocated":37142528,"data_compressed_original":594034688,"omap_allocated":0,"internal_metadata":143917056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":206897152,"num_objects":3157,"num_object_clones":0,"num_object_copies":9471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3157,"num_write_kb":202048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002333"},"pg_stats":[{"pgid":"3.f","version":"18'190","reported_seq":202,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:10.708791+0000","last_change":"2024-09-15T12:18:53.083350+0000","last_active":"2024-09-15T12:19:10.708791+0000","last_peered":"2024-09-15T12:19:10.708791+0000","last_clean":"2024-09-15T12:19:10.708791+0000","last_became_active":"2024-09-15T12:18:53.075051+0000","last_became_peered":"2024-09-15T12:18:53.075051+0000","last_unstale":"2024-09-15T12:19:10.708791+0000","last_undegraded":"2024-09-15T12:19:10.708791+0000","last_fullsized":"2024-09-15T12:19:10.708791+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12451840,"num_objects":190,"num_object_clones":0,"num_object_copies":570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":190,"num_write_kb":12160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'176","reported_seq":188,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:10.661205+0000","last_change":"2024-09-15T12:18:53.139711+0000","last_active":"2024-09-15T12:19:10.661205+0000","last_peered":"2024-09-15T12:19:10.661205+0000","last_clean":"2024-09-15T12:19:10.661205+0000","last_became_active":"2024-09-15T12:18:53.130124+0000","last_became_peered":"2024-09-15T12:18:53.130124+0000","last_unstale":"2024-09-15T12:19:10.661205+0000","last_undegraded":"2024-09-15T12:19:10.661205+0000","last_fullsized":"2024-09-15T12:19:10.661205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":176,"num_object_clones":0,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'201","reported_seq":213,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:10.396941+0000","last_change":"2024-09-15T12:18:53.140327+0000","last_active":"2024-09-15T12:19:10.396941+0000","last_peered":"2024-09-15T12:19:10.396941+0000","last_clean":"2024-09-15T12:19:10.396941+0000","last_became_active":"2024-09-15T12:18:53.128935+0000","last_became_peered":"2024-09-15T12:18:53.128935+0000","last_unstale":"2024-09-15T12:19:10.396941+0000","last_undegraded":"2024-09-15T12:19:10.396941+0000","last_fullsized":"2024-09-15T12:19:10.396941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13172736,"num_objects":201,"num_object_clones":0,"num_object_copies":603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":201,"num_write_kb":12864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"18'186","reported_seq":198,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:10.492994+0000","last_change":"2024-09-15T12:18:53.138678+0000","last_active":"2024-09-15T12:19:10.492994+0000","last_peered":"2024-09-15T12:19:10.492994+0000","last_clean":"2024-09-15T12:19:10.492994+0000","last_became_active":"2024-09-15T12:18:53.129492+0000","last_became_peered":"2024-09-15T12:18:53.129492+0000","last_unstale":"2024-09-15T12:19:10.492994+0000","last_undegraded":"2024-09-15T12:19:10.492994+0000","last_fullsized":"2024-09-15T12:19:10.492994+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12189696,"num_objects":186,"num_object_clones":0,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":11904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'192","reported_seq":204,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:11.557419+0000","last_change":"2024-09-15T12:18:53.109204+0000","last_active":"2024-09-15T12:19:11.557419+0000","last_peered":"2024-09-15T12:19:11.557419+0000","last_clean":"2024-09-15T12:19:11.557419+0000","last_became_active":"2024-09-15T12:18:53.087134+0000","last_became_peered":"2024-09-15T12:18:53.087134+0000","last_unstale":"2024-09-15T12:19:11.557419+0000","last_undegraded":"2024-09-15T12:19:11.557419+0000","last_fullsized":"2024-09-15T12:19:11.557419+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"18'177","reported_seq":189,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:10.563514+0000","last_change":"2024-09-15T12:18:53.119675+0000","last_active":"2024-09-15T12:19:10.563514+0000","last_peered":"2024-09-15T12:19:10.563514+0000","last_clean":"2024-09-15T12:19:10.563514+0000","last_became_active":"2024-09-15T12:18:53.112010+0000","last_became_peered":"2024-09-15T12:18:53.112010+0000","last_unstale":"2024-09-15T12:19:10.563514+0000","last_undegraded":"2024-09-15T12:19:10.563514+0000","last_fullsized":"2024-09-15T12:19:10.563514+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11599872,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":11328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"18'188","reported_seq":200,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:10.433743+0000","last_change":"2024-09-15T12:18:53.136381+0000","last_active":"2024-09-15T12:19:10.433743+0000","last_peered":"2024-09-15T12:19:10.433743+0000","last_clean":"2024-09-15T12:19:10.433743+0000","last_became_active":"2024-09-15T12:18:53.128765+0000","last_became_peered":"2024-09-15T12:18:53.128765+0000","last_unstale":"2024-09-15T12:19:10.433743+0000","last_undegraded":"2024-09-15T12:19:10.433743+0000","last_fullsized":"2024-09-15T12:19:10.433743+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12320768,"num_objects":188,"num_object_clones":0,"num_object_copies":564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":12032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"18'198","reported_seq":210,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:10.707712+0000","last_change":"2024-09-15T12:18:53.090984+0000","last_active":"2024-09-15T12:19:10.707712+0000","last_peered":"2024-09-15T12:19:10.707712+0000","last_clean":"2024-09-15T12:19:10.707712+0000","last_became_active":"2024-09-15T12:18:53.080676+0000","last_became_peered":"2024-09-15T12:18:53.080676+0000","last_unstale":"2024-09-15T12:19:10.707712+0000","last_undegraded":"2024-09-15T12:19:10.707712+0000","last_fullsized":"2024-09-15T12:19:10.707712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12976128,"num_objects":198,"num_object_clones":0,"num_object_copies":594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":12672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":97,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:53.998335+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:18:53.998335+0000","last_peered":"2024-09-15T12:18:53.998335+0000","last_clean":"2024-09-15T12:18:53.998335+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:18:53.998335+0000","last_undegraded":"2024-09-15T12:18:53.998335+0000","last_fullsized":"2024-09-15T12:18:53.998335+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.003623+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:18:54.003623+0000","last_peered":"2024-09-15T12:18:54.003623+0000","last_clean":"2024-09-15T12:18:54.003623+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:18:54.003623+0000","last_undegraded":"2024-09-15T12:18:54.003623+0000","last_fullsized":"2024-09-15T12:18:54.003623+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"18'210","reported_seq":222,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:10.514302+0000","last_change":"2024-09-15T12:18:53.172532+0000","last_active":"2024-09-15T12:19:10.514302+0000","last_peered":"2024-09-15T12:19:10.514302+0000","last_clean":"2024-09-15T12:19:10.514302+0000","last_became_active":"2024-09-15T12:18:53.166197+0000","last_became_peered":"2024-09-15T12:18:53.166197+0000","last_unstale":"2024-09-15T12:19:10.514302+0000","last_undegraded":"2024-09-15T12:19:10.514302+0000","last_fullsized":"2024-09-15T12:19:10.514302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13762560,"num_objects":210,"num_object_clones":0,"num_object_copies":630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":210,"num_write_kb":13440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.003840+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:18:54.003840+0000","last_peered":"2024-09-15T12:18:54.003840+0000","last_clean":"2024-09-15T12:18:54.003840+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:18:54.003840+0000","last_undegraded":"2024-09-15T12:18:54.003840+0000","last_fullsized":"2024-09-15T12:18:54.003840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"18'206","reported_seq":218,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:11.686959+0000","last_change":"2024-09-15T12:18:53.161283+0000","last_active":"2024-09-15T12:19:11.686959+0000","last_peered":"2024-09-15T12:19:11.686959+0000","last_clean":"2024-09-15T12:19:11.686959+0000","last_became_active":"2024-09-15T12:18:53.149710+0000","last_became_peered":"2024-09-15T12:18:53.149710+0000","last_unstale":"2024-09-15T12:19:11.686959+0000","last_undegraded":"2024-09-15T12:19:11.686959+0000","last_fullsized":"2024-09-15T12:19:11.686959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13500416,"num_objects":206,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":13184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:53.996018+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:18:53.996018+0000","last_peered":"2024-09-15T12:18:53.996018+0000","last_clean":"2024-09-15T12:18:53.996018+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:18:53.996018+0000","last_undegraded":"2024-09-15T12:18:53.996018+0000","last_fullsized":"2024-09-15T12:18:53.996018+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"18'191","reported_seq":203,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:11.735501+0000","last_change":"2024-09-15T12:18:53.169843+0000","last_active":"2024-09-15T12:19:11.735501+0000","last_peered":"2024-09-15T12:19:11.735501+0000","last_clean":"2024-09-15T12:19:11.735501+0000","last_became_active":"2024-09-15T12:18:53.161921+0000","last_became_peered":"2024-09-15T12:18:53.161921+0000","last_unstale":"2024-09-15T12:19:11.735501+0000","last_undegraded":"2024-09-15T12:19:11.735501+0000","last_fullsized":"2024-09-15T12:19:11.735501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12517376,"num_objects":191,"num_object_clones":0,"num_object_copies":573,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":12224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":27,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:53.995342+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:18:53.995342+0000","last_peered":"2024-09-15T12:18:53.995342+0000","last_clean":"2024-09-15T12:18:53.995342+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:18:53.995342+0000","last_undegraded":"2024-09-15T12:18:53.995342+0000","last_fullsized":"2024-09-15T12:18:53.995342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"18'220","reported_seq":232,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:10.633418+0000","last_change":"2024-09-15T12:18:53.100005+0000","last_active":"2024-09-15T12:19:10.633418+0000","last_peered":"2024-09-15T12:19:10.633418+0000","last_clean":"2024-09-15T12:19:10.633418+0000","last_became_active":"2024-09-15T12:18:53.080705+0000","last_became_peered":"2024-09-15T12:18:53.080705+0000","last_unstale":"2024-09-15T12:19:10.633418+0000","last_undegraded":"2024-09-15T12:19:10.633418+0000","last_fullsized":"2024-09-15T12:19:10.633418+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14417920,"num_objects":220,"num_object_clones":0,"num_object_copies":660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":14080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"18'186","reported_seq":198,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:10.588002+0000","last_change":"2024-09-15T12:18:53.122880+0000","last_active":"2024-09-15T12:19:10.588002+0000","last_peered":"2024-09-15T12:19:10.588002+0000","last_clean":"2024-09-15T12:19:10.588002+0000","last_became_active":"2024-09-15T12:18:53.111647+0000","last_became_peered":"2024-09-15T12:18:53.111647+0000","last_unstale":"2024-09-15T12:19:10.588002+0000","last_undegraded":"2024-09-15T12:19:10.588002+0000","last_fullsized":"2024-09-15T12:19:10.588002+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12189696,"num_objects":186,"num_object_clones":0,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":11904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.005037+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:18:54.005037+0000","last_peered":"2024-09-15T12:18:54.005037+0000","last_clean":"2024-09-15T12:18:54.005037+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:18:54.005037+0000","last_undegraded":"2024-09-15T12:18:54.005037+0000","last_fullsized":"2024-09-15T12:18:54.005037+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"18'200","reported_seq":212,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:10.564619+0000","last_change":"2024-09-15T12:18:53.133542+0000","last_active":"2024-09-15T12:19:10.564619+0000","last_peered":"2024-09-15T12:19:10.564619+0000","last_clean":"2024-09-15T12:19:10.564619+0000","last_became_active":"2024-09-15T12:18:53.125716+0000","last_became_peered":"2024-09-15T12:18:53.125716+0000","last_unstale":"2024-09-15T12:19:10.564619+0000","last_undegraded":"2024-09-15T12:19:10.564619+0000","last_fullsized":"2024-09-15T12:19:10.564619+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13107200,"num_objects":200,"num_object_clones":0,"num_object_copies":600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":12800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.002907+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:18:54.002907+0000","last_peered":"2024-09-15T12:18:54.002907+0000","last_clean":"2024-09-15T12:18:54.002907+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:18:54.002907+0000","last_undegraded":"2024-09-15T12:18:54.002907+0000","last_fullsized":"2024-09-15T12:18:54.002907+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"18'215","reported_seq":227,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:11.584458+0000","last_change":"2024-09-15T12:18:53.133963+0000","last_active":"2024-09-15T12:19:11.584458+0000","last_peered":"2024-09-15T12:19:11.584458+0000","last_clean":"2024-09-15T12:19:11.584458+0000","last_became_active":"2024-09-15T12:18:53.122383+0000","last_became_peered":"2024-09-15T12:18:53.122383+0000","last_unstale":"2024-09-15T12:19:11.584458+0000","last_undegraded":"2024-09-15T12:19:11.584458+0000","last_fullsized":"2024-09-15T12:19:11.584458+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14090240,"num_objects":215,"num_object_clones":0,"num_object_copies":645,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":13760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.001912+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:18:54.001912+0000","last_peered":"2024-09-15T12:18:54.001912+0000","last_clean":"2024-09-15T12:18:54.001912+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:18:54.001912+0000","last_undegraded":"2024-09-15T12:18:54.001912+0000","last_fullsized":"2024-09-15T12:18:54.001912+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"18'221","reported_seq":233,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:10.476716+0000","last_change":"2024-09-15T12:18:53.102960+0000","last_active":"2024-09-15T12:19:10.476716+0000","last_peered":"2024-09-15T12:19:10.476716+0000","last_clean":"2024-09-15T12:19:10.476716+0000","last_became_active":"2024-09-15T12:18:53.088807+0000","last_became_peered":"2024-09-15T12:18:53.088807+0000","last_unstale":"2024-09-15T12:19:10.476716+0000","last_undegraded":"2024-09-15T12:19:10.476716+0000","last_fullsized":"2024-09-15T12:19:10.476716+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14483456,"num_objects":221,"num_object_clones":0,"num_object_copies":663,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":221,"num_write_kb":14144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.002303+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:18:54.002303+0000","last_peered":"2024-09-15T12:18:54.002303+0000","last_clean":"2024-09-15T12:18:54.002303+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:18:54.002303+0000","last_undegraded":"2024-09-15T12:18:54.002303+0000","last_fullsized":"2024-09-15T12:18:54.002303+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":206897152,"num_objects":3157,"num_object_clones":0,"num_object_copies":9471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3157,"num_write_kb":202048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38780928,"data_stored":620494848,"data_compressed":29461086,"data_compressed_allocated":38780928,"data_compressed_original":620494848,"omap_allocated":0,"internal_metadata":0},"log_size":3157,"ondisk_log_size":3157,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":46320,"kb_used_data":11168,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94325520,"statfs":{"total":96636764160,"available":96589332480,"internally_reserved":0,"allocated":11436032,"data_stored":180203951,"data_compressed":8555920,"data_compressed_allocated":11264000,"data_compressed_original":180142080,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705693,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43260,"kb_used_data":8108,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94328580,"statfs":{"total":96636764160,"available":96592465920,"internally_reserved":0,"allocated":8302592,"data_stored":130003394,"data_compressed":6172365,"data_compressed_allocated":8126464,"data_compressed_original":129941504,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705693,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43996,"kb_used_data":8844,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94327844,"statfs":{"total":96636764160,"available":96591712256,"internally_reserved":0,"allocated":9056256,"data_stored":142454690,"data_compressed":6761554,"data_compressed_allocated":8900608,"data_compressed_original":142409728,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43968,"kb_used_data":8816,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94327872,"statfs":{"total":96636764160,"available":96591740928,"internally_reserved":0,"allocated":9027584,"data_stored":141603266,"data_compressed":6723183,"data_compressed_allocated":8851456,"data_compressed_original":141541376,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8810496,"data_stored":140967936,"data_compressed":6693151,"data_compressed_allocated":8810496,"data_compressed_original":140967936,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9482240,"data_stored":151715840,"data_compressed":7203458,"data_compressed_allocated":9482240,"data_compressed_original":151715840,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8630272,"data_stored":138084352,"data_compressed":6556229,"data_compressed_allocated":8630272,"data_compressed_original":138084352,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11857920,"data_stored":189726720,"data_compressed":9008248,"data_compressed_allocated":11857920,"data_compressed_original":189726720,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:19:21.013 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:19:21.065 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 27 16 4995 4979 11.5245 11.625 0.062173 0.0865651 2024-09-15T12:19:21.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:21.155+0000 7f9302791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:21.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:21.164+0000 7f9302791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:22.065 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 28 16 5194 5178 11.557 12.4375 0.0678987 0.0864268 2024-09-15T12:19:23.065 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 29 16 5367 5351 11.5313 10.8125 0.107463 0.0865971 2024-09-15T12:19:23.487 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:19:23.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:23.627+0000 7f1c21cc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:23.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:23.636+0000 7f1c21cc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:24.065 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 30 16 5555 5539 11.5386 11.75 0.0617723 0.0865145 2024-09-15T12:19:25.065 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 31 16 5730 5714 11.5192 10.9375 0.141201 0.0866101 2024-09-15T12:19:25.402 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:19:25.402 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:19:25.402 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:19:25.402 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:19:25.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:25.555+0000 7fde2eb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:25.571 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:25.569+0000 7fde2eb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:25.627 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:19:25.627 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:19:25.627 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:19:25.627 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:19:25.627 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:19:25.627 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:19:25.627 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:19:25.627 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:19:25.627 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:19:25.627 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:19:25.627 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:19:25.628 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:19:25.631 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:19:25.631 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:19:25.631 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:19:25.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:25.778+0000 7fef48708640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:25.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:25.794+0000 7fef48708640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:25.836 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:19:25.836 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:19:25.837 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:19:25.837 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:19:25.837 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:19:25.837 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:19:25.837 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:19:25.837 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:19:25.837 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:19:25.837 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:19:25.837 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:19:25.837 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:19:25.840 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:19:25.840 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:19:25.841 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:19:25.993 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:19:26.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:25.993+0000 7f0f3fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:26.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:26.012+0000 7f0f3fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:26.046 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:19:26.046 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:19:26.046 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:19:26.046 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:19:26.046 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:19:26.046 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:19:26.046 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:19:26.046 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:19:26.046 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:19:26.047 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:19:26.047 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:19:26.047 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:19:26.051 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:19:26.051 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:19:26.051 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:19:26.065 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 32 16 5903 5887 11.4971 10.8125 0.0356344 0.0867961 2024-09-15T12:19:26.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:26.147+0000 7f46c02d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:26.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:26.156+0000 7f46c02d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:26.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:26.220+0000 7f6b1defd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:26.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:26.234+0000 7f6b1defd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:26.405 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:19:26.405 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:19:26.405 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:19:26.405 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:19:26.405 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:19:26.406 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:19:26.406 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:19:26.406 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:19:26.406 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:19:26.406 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:19:26.406 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:19:26.406 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:19:26.409 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:19:26.409 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:19:27.065 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 33 16 6087 6071 11.4971 11.5 0.112361 0.0868568 2024-09-15T12:19:28.065 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 34 16 6267 6251 11.4898 11.25 0.0847961 0.0868821 2024-09-15T12:19:28.564 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:19:28.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:28.704+0000 7ff84bf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:28.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:28.711+0000 7ff84bf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:29.065 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 35 16 6451 6435 11.4901 11.5 0.127427 0.086866 2024-09-15T12:19:30.065 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 36 16 6627 6611 11.4765 11 0.122252 0.0870156 2024-09-15T12:19:31.066 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 37 16 6813 6797 11.4804 11.625 0.104821 0.0869726 2024-09-15T12:19:31.122 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:19:31.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:31.279+0000 7faab5f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:31.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:31.287+0000 7faab5f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:31.410 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:19:31.410 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:19:31.411 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:19:31.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:31.583+0000 7ff771351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:31.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:31.595+0000 7ff771351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:31.884 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:19:31.885 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:19:31.900 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-09-15T12:19:31.711140+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":207487539,"num_objects":3161,"num_object_clones":0,"num_object_copies":9483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":3238,"num_write_kb":203156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3212,"ondisk_log_size":3212,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":177544,"kb_used_data":36936,"kb_used_omap":0,"kb_used_meta":140544,"kb_avail":377309816,"statfs":{"total":386547056640,"available":386365251584,"internally_reserved":0,"allocated":37822464,"data_stored":594265301,"data_compressed":28213022,"data_compressed_allocated":37142528,"data_compressed_original":594034688,"omap_allocated":0,"internal_metadata":143917056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002158"},"pg_stats":[{"pgid":"3.f","version":"18'190","reported_seq":202,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:10.708791+0000","last_change":"2024-09-15T12:18:53.083350+0000","last_active":"2024-09-15T12:19:10.708791+0000","last_peered":"2024-09-15T12:19:10.708791+0000","last_clean":"2024-09-15T12:19:10.708791+0000","last_became_active":"2024-09-15T12:18:53.075051+0000","last_became_peered":"2024-09-15T12:18:53.075051+0000","last_unstale":"2024-09-15T12:19:10.708791+0000","last_undegraded":"2024-09-15T12:19:10.708791+0000","last_fullsized":"2024-09-15T12:19:10.708791+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12451840,"num_objects":190,"num_object_clones":0,"num_object_copies":570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":190,"num_write_kb":12160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'176","reported_seq":188,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:10.661205+0000","last_change":"2024-09-15T12:18:53.139711+0000","last_active":"2024-09-15T12:19:10.661205+0000","last_peered":"2024-09-15T12:19:10.661205+0000","last_clean":"2024-09-15T12:19:10.661205+0000","last_became_active":"2024-09-15T12:18:53.130124+0000","last_became_peered":"2024-09-15T12:18:53.130124+0000","last_unstale":"2024-09-15T12:19:10.661205+0000","last_undegraded":"2024-09-15T12:19:10.661205+0000","last_fullsized":"2024-09-15T12:19:10.661205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":176,"num_object_clones":0,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'201","reported_seq":213,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:10.396941+0000","last_change":"2024-09-15T12:18:53.140327+0000","last_active":"2024-09-15T12:19:10.396941+0000","last_peered":"2024-09-15T12:19:10.396941+0000","last_clean":"2024-09-15T12:19:10.396941+0000","last_became_active":"2024-09-15T12:18:53.128935+0000","last_became_peered":"2024-09-15T12:18:53.128935+0000","last_unstale":"2024-09-15T12:19:10.396941+0000","last_undegraded":"2024-09-15T12:19:10.396941+0000","last_fullsized":"2024-09-15T12:19:10.396941+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13172736,"num_objects":201,"num_object_clones":0,"num_object_copies":603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":201,"num_write_kb":12864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"18'186","reported_seq":198,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:10.492994+0000","last_change":"2024-09-15T12:18:53.138678+0000","last_active":"2024-09-15T12:19:10.492994+0000","last_peered":"2024-09-15T12:19:10.492994+0000","last_clean":"2024-09-15T12:19:10.492994+0000","last_became_active":"2024-09-15T12:18:53.129492+0000","last_became_peered":"2024-09-15T12:18:53.129492+0000","last_unstale":"2024-09-15T12:19:10.492994+0000","last_undegraded":"2024-09-15T12:19:10.492994+0000","last_fullsized":"2024-09-15T12:19:10.492994+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12189696,"num_objects":186,"num_object_clones":0,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":11904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'192","reported_seq":204,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:11.557419+0000","last_change":"2024-09-15T12:18:53.109204+0000","last_active":"2024-09-15T12:19:11.557419+0000","last_peered":"2024-09-15T12:19:11.557419+0000","last_clean":"2024-09-15T12:19:11.557419+0000","last_became_active":"2024-09-15T12:18:53.087134+0000","last_became_peered":"2024-09-15T12:18:53.087134+0000","last_unstale":"2024-09-15T12:19:11.557419+0000","last_undegraded":"2024-09-15T12:19:11.557419+0000","last_fullsized":"2024-09-15T12:19:11.557419+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"18'177","reported_seq":189,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:10.563514+0000","last_change":"2024-09-15T12:18:53.119675+0000","last_active":"2024-09-15T12:19:10.563514+0000","last_peered":"2024-09-15T12:19:10.563514+0000","last_clean":"2024-09-15T12:19:10.563514+0000","last_became_active":"2024-09-15T12:18:53.112010+0000","last_became_peered":"2024-09-15T12:18:53.112010+0000","last_unstale":"2024-09-15T12:19:10.563514+0000","last_undegraded":"2024-09-15T12:19:10.563514+0000","last_fullsized":"2024-09-15T12:19:10.563514+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11599872,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":11328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"18'188","reported_seq":200,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:10.433743+0000","last_change":"2024-09-15T12:18:53.136381+0000","last_active":"2024-09-15T12:19:10.433743+0000","last_peered":"2024-09-15T12:19:10.433743+0000","last_clean":"2024-09-15T12:19:10.433743+0000","last_became_active":"2024-09-15T12:18:53.128765+0000","last_became_peered":"2024-09-15T12:18:53.128765+0000","last_unstale":"2024-09-15T12:19:10.433743+0000","last_undegraded":"2024-09-15T12:19:10.433743+0000","last_fullsized":"2024-09-15T12:19:10.433743+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12320768,"num_objects":188,"num_object_clones":0,"num_object_copies":564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":188,"num_write_kb":12032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"18'198","reported_seq":210,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:10.707712+0000","last_change":"2024-09-15T12:18:53.090984+0000","last_active":"2024-09-15T12:19:10.707712+0000","last_peered":"2024-09-15T12:19:10.707712+0000","last_clean":"2024-09-15T12:19:10.707712+0000","last_became_active":"2024-09-15T12:18:53.080676+0000","last_became_peered":"2024-09-15T12:18:53.080676+0000","last_unstale":"2024-09-15T12:19:10.707712+0000","last_undegraded":"2024-09-15T12:19:10.707712+0000","last_fullsized":"2024-09-15T12:19:10.707712+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12976128,"num_objects":198,"num_object_clones":0,"num_object_copies":594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":198,"num_write_kb":12672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":97,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:53.998335+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:18:53.998335+0000","last_peered":"2024-09-15T12:18:53.998335+0000","last_clean":"2024-09-15T12:18:53.998335+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:18:53.998335+0000","last_undegraded":"2024-09-15T12:18:53.998335+0000","last_fullsized":"2024-09-15T12:18:53.998335+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.003623+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:18:54.003623+0000","last_peered":"2024-09-15T12:18:54.003623+0000","last_clean":"2024-09-15T12:18:54.003623+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:18:54.003623+0000","last_undegraded":"2024-09-15T12:18:54.003623+0000","last_fullsized":"2024-09-15T12:18:54.003623+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"18'210","reported_seq":222,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:10.514302+0000","last_change":"2024-09-15T12:18:53.172532+0000","last_active":"2024-09-15T12:19:10.514302+0000","last_peered":"2024-09-15T12:19:10.514302+0000","last_clean":"2024-09-15T12:19:10.514302+0000","last_became_active":"2024-09-15T12:18:53.166197+0000","last_became_peered":"2024-09-15T12:18:53.166197+0000","last_unstale":"2024-09-15T12:19:10.514302+0000","last_undegraded":"2024-09-15T12:19:10.514302+0000","last_fullsized":"2024-09-15T12:19:10.514302+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13762560,"num_objects":210,"num_object_clones":0,"num_object_copies":630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":210,"num_write_kb":13440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.003840+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:18:54.003840+0000","last_peered":"2024-09-15T12:18:54.003840+0000","last_clean":"2024-09-15T12:18:54.003840+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:18:54.003840+0000","last_undegraded":"2024-09-15T12:18:54.003840+0000","last_fullsized":"2024-09-15T12:18:54.003840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"18'206","reported_seq":218,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:11.686959+0000","last_change":"2024-09-15T12:18:53.161283+0000","last_active":"2024-09-15T12:19:11.686959+0000","last_peered":"2024-09-15T12:19:11.686959+0000","last_clean":"2024-09-15T12:19:11.686959+0000","last_became_active":"2024-09-15T12:18:53.149710+0000","last_became_peered":"2024-09-15T12:18:53.149710+0000","last_unstale":"2024-09-15T12:19:11.686959+0000","last_undegraded":"2024-09-15T12:19:11.686959+0000","last_fullsized":"2024-09-15T12:19:11.686959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13500416,"num_objects":206,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":13184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:53.996018+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:18:53.996018+0000","last_peered":"2024-09-15T12:18:53.996018+0000","last_clean":"2024-09-15T12:18:53.996018+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:18:53.996018+0000","last_undegraded":"2024-09-15T12:18:53.996018+0000","last_fullsized":"2024-09-15T12:18:53.996018+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"18'191","reported_seq":203,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:11.735501+0000","last_change":"2024-09-15T12:18:53.169843+0000","last_active":"2024-09-15T12:19:11.735501+0000","last_peered":"2024-09-15T12:19:11.735501+0000","last_clean":"2024-09-15T12:19:11.735501+0000","last_became_active":"2024-09-15T12:18:53.161921+0000","last_became_peered":"2024-09-15T12:18:53.161921+0000","last_unstale":"2024-09-15T12:19:11.735501+0000","last_undegraded":"2024-09-15T12:19:11.735501+0000","last_fullsized":"2024-09-15T12:19:11.735501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12517376,"num_objects":191,"num_object_clones":0,"num_object_copies":573,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":12224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":27,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:53.995342+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:18:53.995342+0000","last_peered":"2024-09-15T12:18:53.995342+0000","last_clean":"2024-09-15T12:18:53.995342+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:18:53.995342+0000","last_undegraded":"2024-09-15T12:18:53.995342+0000","last_fullsized":"2024-09-15T12:18:53.995342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"18'220","reported_seq":232,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:10.633418+0000","last_change":"2024-09-15T12:18:53.100005+0000","last_active":"2024-09-15T12:19:10.633418+0000","last_peered":"2024-09-15T12:19:10.633418+0000","last_clean":"2024-09-15T12:19:10.633418+0000","last_became_active":"2024-09-15T12:18:53.080705+0000","last_became_peered":"2024-09-15T12:18:53.080705+0000","last_unstale":"2024-09-15T12:19:10.633418+0000","last_undegraded":"2024-09-15T12:19:10.633418+0000","last_fullsized":"2024-09-15T12:19:10.633418+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14417920,"num_objects":220,"num_object_clones":0,"num_object_copies":660,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":220,"num_write_kb":14080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"18'186","reported_seq":198,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:10.588002+0000","last_change":"2024-09-15T12:18:53.122880+0000","last_active":"2024-09-15T12:19:10.588002+0000","last_peered":"2024-09-15T12:19:10.588002+0000","last_clean":"2024-09-15T12:19:10.588002+0000","last_became_active":"2024-09-15T12:18:53.111647+0000","last_became_peered":"2024-09-15T12:18:53.111647+0000","last_unstale":"2024-09-15T12:19:10.588002+0000","last_undegraded":"2024-09-15T12:19:10.588002+0000","last_fullsized":"2024-09-15T12:19:10.588002+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12189696,"num_objects":186,"num_object_clones":0,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":11904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.005037+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:18:54.005037+0000","last_peered":"2024-09-15T12:18:54.005037+0000","last_clean":"2024-09-15T12:18:54.005037+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:18:54.005037+0000","last_undegraded":"2024-09-15T12:18:54.005037+0000","last_fullsized":"2024-09-15T12:18:54.005037+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"18'200","reported_seq":212,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:10.564619+0000","last_change":"2024-09-15T12:18:53.133542+0000","last_active":"2024-09-15T12:19:10.564619+0000","last_peered":"2024-09-15T12:19:10.564619+0000","last_clean":"2024-09-15T12:19:10.564619+0000","last_became_active":"2024-09-15T12:18:53.125716+0000","last_became_peered":"2024-09-15T12:18:53.125716+0000","last_unstale":"2024-09-15T12:19:10.564619+0000","last_undegraded":"2024-09-15T12:19:10.564619+0000","last_fullsized":"2024-09-15T12:19:10.564619+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13107200,"num_objects":200,"num_object_clones":0,"num_object_copies":600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":200,"num_write_kb":12800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.002907+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:18:54.002907+0000","last_peered":"2024-09-15T12:18:54.002907+0000","last_clean":"2024-09-15T12:18:54.002907+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:18:54.002907+0000","last_undegraded":"2024-09-15T12:18:54.002907+0000","last_fullsized":"2024-09-15T12:18:54.002907+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"18'215","reported_seq":227,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:11.584458+0000","last_change":"2024-09-15T12:18:53.133963+0000","last_active":"2024-09-15T12:19:11.584458+0000","last_peered":"2024-09-15T12:19:11.584458+0000","last_clean":"2024-09-15T12:19:11.584458+0000","last_became_active":"2024-09-15T12:18:53.122383+0000","last_became_peered":"2024-09-15T12:18:53.122383+0000","last_unstale":"2024-09-15T12:19:11.584458+0000","last_undegraded":"2024-09-15T12:19:11.584458+0000","last_fullsized":"2024-09-15T12:19:11.584458+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14090240,"num_objects":215,"num_object_clones":0,"num_object_copies":645,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":13760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.001912+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:18:54.001912+0000","last_peered":"2024-09-15T12:18:54.001912+0000","last_clean":"2024-09-15T12:18:54.001912+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:18:54.001912+0000","last_undegraded":"2024-09-15T12:18:54.001912+0000","last_fullsized":"2024-09-15T12:18:54.001912+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"18'221","reported_seq":233,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:10.476716+0000","last_change":"2024-09-15T12:18:53.102960+0000","last_active":"2024-09-15T12:19:10.476716+0000","last_peered":"2024-09-15T12:19:10.476716+0000","last_clean":"2024-09-15T12:19:10.476716+0000","last_became_active":"2024-09-15T12:18:53.088807+0000","last_became_peered":"2024-09-15T12:18:53.088807+0000","last_unstale":"2024-09-15T12:19:10.476716+0000","last_undegraded":"2024-09-15T12:19:10.476716+0000","last_fullsized":"2024-09-15T12:19:10.476716+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14483456,"num_objects":221,"num_object_clones":0,"num_object_copies":663,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":221,"num_write_kb":14144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.002303+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:18:54.002303+0000","last_peered":"2024-09-15T12:18:54.002303+0000","last_clean":"2024-09-15T12:18:54.002303+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:18:54.002303+0000","last_undegraded":"2024-09-15T12:18:54.002303+0000","last_fullsized":"2024-09-15T12:18:54.002303+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":206897152,"num_objects":3157,"num_object_clones":0,"num_object_copies":9471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3157,"num_write_kb":202048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38780928,"data_stored":620494848,"data_compressed":29461086,"data_compressed_allocated":38780928,"data_compressed_original":620494848,"omap_allocated":0,"internal_metadata":0},"log_size":3157,"ondisk_log_size":3157,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":46320,"kb_used_data":11168,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94325520,"statfs":{"total":96636764160,"available":96589332480,"internally_reserved":0,"allocated":11436032,"data_stored":180203951,"data_compressed":8555920,"data_compressed_allocated":11264000,"data_compressed_original":180142080,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705693,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43260,"kb_used_data":8108,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94328580,"statfs":{"total":96636764160,"available":96592465920,"internally_reserved":0,"allocated":8302592,"data_stored":130003394,"data_compressed":6172365,"data_compressed_allocated":8126464,"data_compressed_original":129941504,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705693,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43996,"kb_used_data":8844,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94327844,"statfs":{"total":96636764160,"available":96591712256,"internally_reserved":0,"allocated":9056256,"data_stored":142454690,"data_compressed":6761554,"data_compressed_allocated":8900608,"data_compressed_original":142409728,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705694,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":43968,"kb_used_data":8816,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94327872,"statfs":{"total":96636764160,"available":96591740928,"internally_reserved":0,"allocated":9027584,"data_stored":141603266,"data_compressed":6723183,"data_compressed_allocated":8851456,"data_compressed_original":141541376,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8810496,"data_stored":140967936,"data_compressed":6693151,"data_compressed_allocated":8810496,"data_compressed_original":140967936,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9482240,"data_stored":151715840,"data_compressed":7203458,"data_compressed_allocated":9482240,"data_compressed_original":151715840,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8630272,"data_stored":138084352,"data_compressed":6556229,"data_compressed_allocated":8630272,"data_compressed_original":138084352,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11857920,"data_stored":189726720,"data_compressed":9008248,"data_compressed_allocated":11857920,"data_compressed_original":189726720,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:19:32.066 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 38 16 6998 6982 11.4826 11.5625 0.0691288 0.0869593 2024-09-15T12:19:33.066 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 39 16 7178 7162 11.4766 11.25 0.0192183 0.0870147 2024-09-15T12:19:33.587 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:19:33.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:33.740+0000 7f698b711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:33.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:33.747+0000 7f698b711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:34.066 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:2024-09-15T12:19:34.065733+0000 min lat: 0.0153683 max lat: 0.213381 avg lat: 0.087181 2024-09-15T12:19:34.066 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-15T12:19:34.066 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 40 16 7349 7333 11.4568 10.6875 0.102102 0.087181 2024-09-15T12:19:35.066 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 41 16 7525 7509 11.4457 11 0.106172 0.0872706 2024-09-15T12:19:36.066 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 42 16 7700 7684 11.4336 10.9375 0.0517717 0.0873554 2024-09-15T12:19:36.140 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:19:36.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:36.300+0000 7f719d8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:36.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:36.308+0000 7f719d8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:36.902 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:19:36.902 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:19:36.903 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:19:36.903 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:19:37.066 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 43 16 7864 7848 11.406 10.25 0.0824731 0.0875592 2024-09-15T12:19:37.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:37.060+0000 7f92f8aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:37.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:37.073+0000 7f92f8aa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:37.103 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:19:37.103 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:19:37.103 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:19:37.104 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:19:37.104 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:19:37.104 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:19:37.104 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:19:37.104 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:19:37.104 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:19:37.104 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:19:37.104 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:19:37.104 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:19:37.107 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:19:37.107 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:19:37.108 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:19:37.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:37.255+0000 7f25a5846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:37.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:37.269+0000 7f25a5846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:37.330 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:19:37.330 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:19:37.330 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:19:37.330 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:19:37.330 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:19:37.330 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:19:37.330 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:19:37.330 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:19:37.330 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:19:37.331 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:19:37.331 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:19:37.331 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:19:37.334 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:19:37.335 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:19:37.335 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:19:37.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:37.469+0000 7fac4ac46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:37.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:37.485+0000 7fac4ac46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:37.511 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:19:37.511 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:19:37.511 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:19:37.512 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:19:37.512 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:19:37.512 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:19:37.512 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:19:37.512 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:19:37.512 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:19:37.512 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:19:37.512 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:19:37.512 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:19:37.517 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:19:37.517 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:19:37.517 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:19:37.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:37.657+0000 7f2f12d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:37.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:37.670+0000 7f2f12d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:37.817 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:19:37.818 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:19:37.818 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:19:37.818 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:19:37.818 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:19:37.818 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:19:37.818 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:19:37.818 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:19:37.818 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:19:37.818 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:19:37.818 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:19:37.818 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:19:37.822 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:19:37.822 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:19:38.066 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 44 16 8029 8013 11.3811 10.3125 0.116706 0.087746 2024-09-15T12:19:38.684 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:19:38.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:38.838+0000 7f802a063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:38.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:38.846+0000 7f802a063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:39.066 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 45 16 8202 8186 11.3685 10.8125 0.124945 0.0878609 2024-09-15T12:19:40.066 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 46 16 8382 8366 11.3659 11.25 0.0478278 0.0878826 2024-09-15T12:19:41.066 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 47 16 8556 8540 11.3554 10.875 0.091058 0.087983 2024-09-15T12:19:41.310 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:19:41.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:41.448+0000 7f4e47111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:41.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:41.455+0000 7f4e47111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:42.067 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 48 16 8716 8700 11.3272 10 0.16427 0.0881736 2024-09-15T12:19:42.823 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:19:42.823 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:19:42.823 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:19:42.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:42.958+0000 7fcb3f751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:42.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:42.969+0000 7fcb3f751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:43.066 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 49 16 8877 8861 11.3013 10.0625 0.140619 0.0883517 2024-09-15T12:19:43.230 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:19:43.231 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:19:43.247 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-09-15T12:19:41.712983+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":472187443,"num_objects":7200,"num_object_clones":0,"num_object_copies":21600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":7277,"num_write_kb":461652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7251,"ondisk_log_size":7251,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":214812,"kb_used_data":82524,"kb_used_omap":0,"kb_used_meta":132224,"kb_avail":377272548,"statfs":{"total":386547056640,"available":386327089152,"internally_reserved":0,"allocated":84504576,"data_stored":1341179093,"data_compressed":63680486,"data_compressed_allocated":83824640,"data_compressed_original":1340948480,"omap_allocated":0,"internal_metadata":135397376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":264699904,"num_objects":4039,"num_object_clones":0,"num_object_copies":12117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4039,"num_write_kb":258496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002221"},"pg_stats":[{"pgid":"3.f","version":"18'502","reported_seq":514,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.613754+0000","last_change":"2024-09-15T12:18:53.083350+0000","last_active":"2024-09-15T12:19:40.613754+0000","last_peered":"2024-09-15T12:19:40.613754+0000","last_clean":"2024-09-15T12:19:40.613754+0000","last_became_active":"2024-09-15T12:18:53.075051+0000","last_became_peered":"2024-09-15T12:18:53.075051+0000","last_unstale":"2024-09-15T12:19:40.613754+0000","last_undegraded":"2024-09-15T12:19:40.613754+0000","last_fullsized":"2024-09-15T12:19:40.613754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32899072,"num_objects":502,"num_object_clones":0,"num_object_copies":1506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":502,"num_write_kb":32128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'479","reported_seq":491,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.412103+0000","last_change":"2024-09-15T12:18:53.139711+0000","last_active":"2024-09-15T12:19:40.412103+0000","last_peered":"2024-09-15T12:19:40.412103+0000","last_clean":"2024-09-15T12:19:40.412103+0000","last_became_active":"2024-09-15T12:18:53.130124+0000","last_became_peered":"2024-09-15T12:18:53.130124+0000","last_unstale":"2024-09-15T12:19:40.412103+0000","last_undegraded":"2024-09-15T12:19:40.412103+0000","last_fullsized":"2024-09-15T12:19:40.412103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31391744,"num_objects":479,"num_object_clones":0,"num_object_copies":1437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":479,"num_write_kb":30656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'550","reported_seq":562,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.489250+0000","last_change":"2024-09-15T12:18:53.140327+0000","last_active":"2024-09-15T12:19:40.489250+0000","last_peered":"2024-09-15T12:19:40.489250+0000","last_clean":"2024-09-15T12:19:40.489250+0000","last_became_active":"2024-09-15T12:18:53.128935+0000","last_became_peered":"2024-09-15T12:18:53.128935+0000","last_unstale":"2024-09-15T12:19:40.489250+0000","last_undegraded":"2024-09-15T12:19:40.489250+0000","last_fullsized":"2024-09-15T12:19:40.489250+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36044800,"num_objects":550,"num_object_clones":0,"num_object_copies":1650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":550,"num_write_kb":35200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"18'535","reported_seq":547,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.466060+0000","last_change":"2024-09-15T12:18:53.138678+0000","last_active":"2024-09-15T12:19:40.466060+0000","last_peered":"2024-09-15T12:19:40.466060+0000","last_clean":"2024-09-15T12:19:40.466060+0000","last_became_active":"2024-09-15T12:18:53.129492+0000","last_became_peered":"2024-09-15T12:18:53.129492+0000","last_unstale":"2024-09-15T12:19:40.466060+0000","last_undegraded":"2024-09-15T12:19:40.466060+0000","last_fullsized":"2024-09-15T12:19:40.466060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35061760,"num_objects":535,"num_object_clones":0,"num_object_copies":1605,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":535,"num_write_kb":34240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'192","reported_seq":204,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:11.557419+0000","last_change":"2024-09-15T12:18:53.109204+0000","last_active":"2024-09-15T12:19:11.557419+0000","last_peered":"2024-09-15T12:19:11.557419+0000","last_clean":"2024-09-15T12:19:11.557419+0000","last_became_active":"2024-09-15T12:18:53.087134+0000","last_became_peered":"2024-09-15T12:18:53.087134+0000","last_unstale":"2024-09-15T12:19:11.557419+0000","last_undegraded":"2024-09-15T12:19:11.557419+0000","last_fullsized":"2024-09-15T12:19:11.557419+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":192,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"18'517","reported_seq":529,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.718310+0000","last_change":"2024-09-15T12:18:53.119675+0000","last_active":"2024-09-15T12:19:40.718310+0000","last_peered":"2024-09-15T12:19:40.718310+0000","last_clean":"2024-09-15T12:19:40.718310+0000","last_became_active":"2024-09-15T12:18:53.112010+0000","last_became_peered":"2024-09-15T12:18:53.112010+0000","last_unstale":"2024-09-15T12:19:40.718310+0000","last_undegraded":"2024-09-15T12:19:40.718310+0000","last_fullsized":"2024-09-15T12:19:40.718310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33882112,"num_objects":517,"num_object_clones":0,"num_object_copies":1551,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":517,"num_write_kb":33088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"18'529","reported_seq":541,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.579114+0000","last_change":"2024-09-15T12:18:53.136381+0000","last_active":"2024-09-15T12:19:40.579114+0000","last_peered":"2024-09-15T12:19:40.579114+0000","last_clean":"2024-09-15T12:19:40.579114+0000","last_became_active":"2024-09-15T12:18:53.128765+0000","last_became_peered":"2024-09-15T12:18:53.128765+0000","last_unstale":"2024-09-15T12:19:40.579114+0000","last_undegraded":"2024-09-15T12:19:40.579114+0000","last_fullsized":"2024-09-15T12:19:40.579114+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":33856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"18'540","reported_seq":552,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.658996+0000","last_change":"2024-09-15T12:18:53.090984+0000","last_active":"2024-09-15T12:19:40.658996+0000","last_peered":"2024-09-15T12:19:40.658996+0000","last_clean":"2024-09-15T12:19:40.658996+0000","last_became_active":"2024-09-15T12:18:53.080676+0000","last_became_peered":"2024-09-15T12:18:53.080676+0000","last_unstale":"2024-09-15T12:19:40.658996+0000","last_undegraded":"2024-09-15T12:19:40.658996+0000","last_fullsized":"2024-09-15T12:19:40.658996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35389440,"num_objects":540,"num_object_clones":0,"num_object_copies":1620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":540,"num_write_kb":34560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":97,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:53.998335+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:18:53.998335+0000","last_peered":"2024-09-15T12:18:53.998335+0000","last_clean":"2024-09-15T12:18:53.998335+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:18:53.998335+0000","last_undegraded":"2024-09-15T12:18:53.998335+0000","last_fullsized":"2024-09-15T12:18:53.998335+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.003623+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:18:54.003623+0000","last_peered":"2024-09-15T12:18:54.003623+0000","last_clean":"2024-09-15T12:18:54.003623+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:18:54.003623+0000","last_undegraded":"2024-09-15T12:18:54.003623+0000","last_fullsized":"2024-09-15T12:18:54.003623+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"18'531","reported_seq":543,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.606218+0000","last_change":"2024-09-15T12:18:53.172532+0000","last_active":"2024-09-15T12:19:40.606218+0000","last_peered":"2024-09-15T12:19:40.606218+0000","last_clean":"2024-09-15T12:19:40.606218+0000","last_became_active":"2024-09-15T12:18:53.166197+0000","last_became_peered":"2024-09-15T12:18:53.166197+0000","last_unstale":"2024-09-15T12:19:40.606218+0000","last_undegraded":"2024-09-15T12:19:40.606218+0000","last_fullsized":"2024-09-15T12:19:40.606218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":531,"log_dups_size":0,"ondisk_log_size":531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34799616,"num_objects":531,"num_object_clones":0,"num_object_copies":1593,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":531,"num_write_kb":33984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.003840+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:18:54.003840+0000","last_peered":"2024-09-15T12:18:54.003840+0000","last_clean":"2024-09-15T12:18:54.003840+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:18:54.003840+0000","last_undegraded":"2024-09-15T12:18:54.003840+0000","last_fullsized":"2024-09-15T12:18:54.003840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"18'206","reported_seq":218,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:11.686959+0000","last_change":"2024-09-15T12:18:53.161283+0000","last_active":"2024-09-15T12:19:11.686959+0000","last_peered":"2024-09-15T12:19:11.686959+0000","last_clean":"2024-09-15T12:19:11.686959+0000","last_became_active":"2024-09-15T12:18:53.149710+0000","last_became_peered":"2024-09-15T12:18:53.149710+0000","last_unstale":"2024-09-15T12:19:11.686959+0000","last_undegraded":"2024-09-15T12:19:11.686959+0000","last_fullsized":"2024-09-15T12:19:11.686959+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13500416,"num_objects":206,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":206,"num_write_kb":13184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:53.996018+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:18:53.996018+0000","last_peered":"2024-09-15T12:18:53.996018+0000","last_clean":"2024-09-15T12:18:53.996018+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:18:53.996018+0000","last_undegraded":"2024-09-15T12:18:53.996018+0000","last_fullsized":"2024-09-15T12:18:53.996018+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"18'191","reported_seq":203,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:11.735501+0000","last_change":"2024-09-15T12:18:53.169843+0000","last_active":"2024-09-15T12:19:11.735501+0000","last_peered":"2024-09-15T12:19:11.735501+0000","last_clean":"2024-09-15T12:19:11.735501+0000","last_became_active":"2024-09-15T12:18:53.161921+0000","last_became_peered":"2024-09-15T12:18:53.161921+0000","last_unstale":"2024-09-15T12:19:11.735501+0000","last_undegraded":"2024-09-15T12:19:11.735501+0000","last_fullsized":"2024-09-15T12:19:11.735501+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12517376,"num_objects":191,"num_object_clones":0,"num_object_copies":573,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":191,"num_write_kb":12224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":27,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:53.995342+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:18:53.995342+0000","last_peered":"2024-09-15T12:18:53.995342+0000","last_clean":"2024-09-15T12:18:53.995342+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:18:53.995342+0000","last_undegraded":"2024-09-15T12:18:53.995342+0000","last_fullsized":"2024-09-15T12:18:53.995342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"18'566","reported_seq":578,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.557992+0000","last_change":"2024-09-15T12:18:53.100005+0000","last_active":"2024-09-15T12:19:40.557992+0000","last_peered":"2024-09-15T12:19:40.557992+0000","last_clean":"2024-09-15T12:19:40.557992+0000","last_became_active":"2024-09-15T12:18:53.080705+0000","last_became_peered":"2024-09-15T12:18:53.080705+0000","last_unstale":"2024-09-15T12:19:40.557992+0000","last_undegraded":"2024-09-15T12:19:40.557992+0000","last_fullsized":"2024-09-15T12:19:40.557992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37093376,"num_objects":566,"num_object_clones":0,"num_object_copies":1698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":566,"num_write_kb":36224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"18'536","reported_seq":548,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.579487+0000","last_change":"2024-09-15T12:18:53.122880+0000","last_active":"2024-09-15T12:19:40.579487+0000","last_peered":"2024-09-15T12:19:40.579487+0000","last_clean":"2024-09-15T12:19:40.579487+0000","last_became_active":"2024-09-15T12:18:53.111647+0000","last_became_peered":"2024-09-15T12:18:53.111647+0000","last_unstale":"2024-09-15T12:19:40.579487+0000","last_undegraded":"2024-09-15T12:19:40.579487+0000","last_fullsized":"2024-09-15T12:19:40.579487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35127296,"num_objects":536,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.005037+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:18:54.005037+0000","last_peered":"2024-09-15T12:18:54.005037+0000","last_clean":"2024-09-15T12:18:54.005037+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:18:54.005037+0000","last_undegraded":"2024-09-15T12:18:54.005037+0000","last_fullsized":"2024-09-15T12:18:54.005037+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"18'550","reported_seq":562,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.614011+0000","last_change":"2024-09-15T12:18:53.133542+0000","last_active":"2024-09-15T12:19:40.614011+0000","last_peered":"2024-09-15T12:19:40.614011+0000","last_clean":"2024-09-15T12:19:40.614011+0000","last_became_active":"2024-09-15T12:18:53.125716+0000","last_became_peered":"2024-09-15T12:18:53.125716+0000","last_unstale":"2024-09-15T12:19:40.614011+0000","last_undegraded":"2024-09-15T12:19:40.614011+0000","last_fullsized":"2024-09-15T12:19:40.614011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36044800,"num_objects":550,"num_object_clones":0,"num_object_copies":1650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":550,"num_write_kb":35200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.002907+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:18:54.002907+0000","last_peered":"2024-09-15T12:18:54.002907+0000","last_clean":"2024-09-15T12:18:54.002907+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:18:54.002907+0000","last_undegraded":"2024-09-15T12:18:54.002907+0000","last_fullsized":"2024-09-15T12:18:54.002907+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"18'215","reported_seq":227,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:11.584458+0000","last_change":"2024-09-15T12:18:53.133963+0000","last_active":"2024-09-15T12:19:11.584458+0000","last_peered":"2024-09-15T12:19:11.584458+0000","last_clean":"2024-09-15T12:19:11.584458+0000","last_became_active":"2024-09-15T12:18:53.122383+0000","last_became_peered":"2024-09-15T12:18:53.122383+0000","last_unstale":"2024-09-15T12:19:11.584458+0000","last_undegraded":"2024-09-15T12:19:11.584458+0000","last_fullsized":"2024-09-15T12:19:11.584458+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14090240,"num_objects":215,"num_object_clones":0,"num_object_copies":645,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":13760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.001912+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:18:54.001912+0000","last_peered":"2024-09-15T12:18:54.001912+0000","last_clean":"2024-09-15T12:18:54.001912+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:18:54.001912+0000","last_undegraded":"2024-09-15T12:18:54.001912+0000","last_fullsized":"2024-09-15T12:18:54.001912+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"18'557","reported_seq":569,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.703949+0000","last_change":"2024-09-15T12:18:53.102960+0000","last_active":"2024-09-15T12:19:40.703949+0000","last_peered":"2024-09-15T12:19:40.703949+0000","last_clean":"2024-09-15T12:19:40.703949+0000","last_became_active":"2024-09-15T12:18:53.088807+0000","last_became_peered":"2024-09-15T12:18:53.088807+0000","last_unstale":"2024-09-15T12:19:40.703949+0000","last_undegraded":"2024-09-15T12:19:40.703949+0000","last_fullsized":"2024-09-15T12:19:40.703949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36503552,"num_objects":557,"num_object_clones":0,"num_object_copies":1671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":557,"num_write_kb":35648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.002303+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:18:54.002303+0000","last_peered":"2024-09-15T12:18:54.002303+0000","last_clean":"2024-09-15T12:18:54.002303+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:18:54.002303+0000","last_undegraded":"2024-09-15T12:18:54.002303+0000","last_fullsized":"2024-09-15T12:18:54.002303+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":471597056,"num_objects":7196,"num_object_clones":0,"num_object_copies":21588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7196,"num_write_kb":460544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":85762048,"data_stored":1372192768,"data_compressed":65155726,"data_compressed_allocated":85762048,"data_compressed_original":1372192768,"omap_allocated":0,"internal_metadata":0},"log_size":7196,"ondisk_log_size":7196,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":46320,"kb_used_data":11168,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94325520,"statfs":{"total":96636764160,"available":96589332480,"internally_reserved":0,"allocated":11436032,"data_stored":180203951,"data_compressed":8555920,"data_compressed_allocated":11264000,"data_compressed_original":180142080,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54156,"kb_used_data":23164,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94317684,"statfs":{"total":96636764160,"available":96581308416,"internally_reserved":0,"allocated":23719936,"data_stored":376680898,"data_compressed":17885933,"data_compressed_allocated":23543808,"data_compressed_original":376619008,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60200,"kb_used_data":25048,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94311640,"statfs":{"total":96636764160,"available":96575119360,"internally_reserved":0,"allocated":25649152,"data_stored":407941026,"data_compressed":19368266,"data_compressed_allocated":25493504,"data_compressed_original":407896064,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54136,"kb_used_data":23144,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94317704,"statfs":{"total":96636764160,"available":96581328896,"internally_reserved":0,"allocated":23699456,"data_stored":376353218,"data_compressed":17870367,"data_compressed_allocated":23523328,"data_compressed_original":376291328,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23932928,"data_stored":382926848,"data_compressed":18182655,"data_compressed_allocated":23932928,"data_compressed_original":382926848,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25985024,"data_stored":415760384,"data_compressed":19741706,"data_compressed_allocated":25985024,"data_compressed_original":415760384,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23986176,"data_stored":383778816,"data_compressed":18223117,"data_compressed_allocated":23986176,"data_compressed_original":383778816,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11857920,"data_stored":189726720,"data_compressed":9008248,"data_compressed_allocated":11857920,"data_compressed_original":189726720,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:19:43.802 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:19:43.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:43.942+0000 7fe9416a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:43.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:43.949+0000 7fe9416a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:44.067 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 50 16 9050 9034 11.2915 10.8125 0.119818 0.088447 2024-09-15T12:19:45.067 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 51 16 9233 9217 11.2944 11.4375 0.0384983 0.0884598 2024-09-15T12:19:46.067 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 52 16 9416 9400 11.2971 11.4375 0.0729304 0.088451 2024-09-15T12:19:46.377 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:19:46.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:46.550+0000 7fa368f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:46.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:46.558+0000 7fa368f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:47.067 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 53 16 9587 9571 11.2856 10.6875 0.150312 0.0885212 2024-09-15T12:19:48.067 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 54 16 9769 9753 11.2872 11.375 0.100135 0.0884873 2024-09-15T12:19:48.249 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:19:48.249 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:19:48.249 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:19:48.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:48.395+0000 7ff3138ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:48.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:48.406+0000 7ff3138ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:48.786 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:19:48.786 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:19:48.804 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-09-15T12:19:47.714383+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":560267827,"num_objects":8544,"num_object_clones":0,"num_object_copies":25632,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8621,"num_write_kb":547668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8595,"ondisk_log_size":8595,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":237876,"kb_used_data":101428,"kb_used_omap":0,"kb_used_meta":136384,"kb_avail":377249484,"statfs":{"total":386547056640,"available":386303471616,"internally_reserved":0,"allocated":103862272,"data_stored":1650902229,"data_compressed":78387798,"data_compressed_allocated":103182336,"data_compressed_original":1650671616,"omap_allocated":0,"internal_metadata":139657216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":352780288,"num_objects":5383,"num_object_clones":0,"num_object_copies":16149,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5383,"num_write_kb":344512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002477"},"pg_stats":[{"pgid":"3.f","version":"18'502","reported_seq":514,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.613754+0000","last_change":"2024-09-15T12:18:53.083350+0000","last_active":"2024-09-15T12:19:40.613754+0000","last_peered":"2024-09-15T12:19:40.613754+0000","last_clean":"2024-09-15T12:19:40.613754+0000","last_became_active":"2024-09-15T12:18:53.075051+0000","last_became_peered":"2024-09-15T12:18:53.075051+0000","last_unstale":"2024-09-15T12:19:40.613754+0000","last_undegraded":"2024-09-15T12:19:40.613754+0000","last_fullsized":"2024-09-15T12:19:40.613754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32899072,"num_objects":502,"num_object_clones":0,"num_object_copies":1506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":502,"num_write_kb":32128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'479","reported_seq":491,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.412103+0000","last_change":"2024-09-15T12:18:53.139711+0000","last_active":"2024-09-15T12:19:40.412103+0000","last_peered":"2024-09-15T12:19:40.412103+0000","last_clean":"2024-09-15T12:19:40.412103+0000","last_became_active":"2024-09-15T12:18:53.130124+0000","last_became_peered":"2024-09-15T12:18:53.130124+0000","last_unstale":"2024-09-15T12:19:40.412103+0000","last_undegraded":"2024-09-15T12:19:40.412103+0000","last_fullsized":"2024-09-15T12:19:40.412103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31391744,"num_objects":479,"num_object_clones":0,"num_object_copies":1437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":479,"num_write_kb":30656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'550","reported_seq":562,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.489250+0000","last_change":"2024-09-15T12:18:53.140327+0000","last_active":"2024-09-15T12:19:40.489250+0000","last_peered":"2024-09-15T12:19:40.489250+0000","last_clean":"2024-09-15T12:19:40.489250+0000","last_became_active":"2024-09-15T12:18:53.128935+0000","last_became_peered":"2024-09-15T12:18:53.128935+0000","last_unstale":"2024-09-15T12:19:40.489250+0000","last_undegraded":"2024-09-15T12:19:40.489250+0000","last_fullsized":"2024-09-15T12:19:40.489250+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36044800,"num_objects":550,"num_object_clones":0,"num_object_copies":1650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":550,"num_write_kb":35200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"18'535","reported_seq":547,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.466060+0000","last_change":"2024-09-15T12:18:53.138678+0000","last_active":"2024-09-15T12:19:40.466060+0000","last_peered":"2024-09-15T12:19:40.466060+0000","last_clean":"2024-09-15T12:19:40.466060+0000","last_became_active":"2024-09-15T12:18:53.129492+0000","last_became_peered":"2024-09-15T12:18:53.129492+0000","last_unstale":"2024-09-15T12:19:40.466060+0000","last_undegraded":"2024-09-15T12:19:40.466060+0000","last_fullsized":"2024-09-15T12:19:40.466060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35061760,"num_objects":535,"num_object_clones":0,"num_object_copies":1605,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":535,"num_write_kb":34240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'516","reported_seq":528,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:41.633134+0000","last_change":"2024-09-15T12:18:53.109204+0000","last_active":"2024-09-15T12:19:41.633134+0000","last_peered":"2024-09-15T12:19:41.633134+0000","last_clean":"2024-09-15T12:19:41.633134+0000","last_became_active":"2024-09-15T12:18:53.087134+0000","last_became_peered":"2024-09-15T12:18:53.087134+0000","last_unstale":"2024-09-15T12:19:41.633134+0000","last_undegraded":"2024-09-15T12:19:41.633134+0000","last_fullsized":"2024-09-15T12:19:41.633134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":516,"log_dups_size":0,"ondisk_log_size":516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33816576,"num_objects":516,"num_object_clones":0,"num_object_copies":1548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":516,"num_write_kb":33024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"18'517","reported_seq":529,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.718310+0000","last_change":"2024-09-15T12:18:53.119675+0000","last_active":"2024-09-15T12:19:40.718310+0000","last_peered":"2024-09-15T12:19:40.718310+0000","last_clean":"2024-09-15T12:19:40.718310+0000","last_became_active":"2024-09-15T12:18:53.112010+0000","last_became_peered":"2024-09-15T12:18:53.112010+0000","last_unstale":"2024-09-15T12:19:40.718310+0000","last_undegraded":"2024-09-15T12:19:40.718310+0000","last_fullsized":"2024-09-15T12:19:40.718310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33882112,"num_objects":517,"num_object_clones":0,"num_object_copies":1551,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":517,"num_write_kb":33088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"18'529","reported_seq":541,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.579114+0000","last_change":"2024-09-15T12:18:53.136381+0000","last_active":"2024-09-15T12:19:40.579114+0000","last_peered":"2024-09-15T12:19:40.579114+0000","last_clean":"2024-09-15T12:19:40.579114+0000","last_became_active":"2024-09-15T12:18:53.128765+0000","last_became_peered":"2024-09-15T12:18:53.128765+0000","last_unstale":"2024-09-15T12:19:40.579114+0000","last_undegraded":"2024-09-15T12:19:40.579114+0000","last_fullsized":"2024-09-15T12:19:40.579114+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":33856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"18'540","reported_seq":552,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.658996+0000","last_change":"2024-09-15T12:18:53.090984+0000","last_active":"2024-09-15T12:19:40.658996+0000","last_peered":"2024-09-15T12:19:40.658996+0000","last_clean":"2024-09-15T12:19:40.658996+0000","last_became_active":"2024-09-15T12:18:53.080676+0000","last_became_peered":"2024-09-15T12:18:53.080676+0000","last_unstale":"2024-09-15T12:19:40.658996+0000","last_undegraded":"2024-09-15T12:19:40.658996+0000","last_fullsized":"2024-09-15T12:19:40.658996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35389440,"num_objects":540,"num_object_clones":0,"num_object_copies":1620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":540,"num_write_kb":34560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":97,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:53.998335+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:18:53.998335+0000","last_peered":"2024-09-15T12:18:53.998335+0000","last_clean":"2024-09-15T12:18:53.998335+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:18:53.998335+0000","last_undegraded":"2024-09-15T12:18:53.998335+0000","last_fullsized":"2024-09-15T12:18:53.998335+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.003623+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:18:54.003623+0000","last_peered":"2024-09-15T12:18:54.003623+0000","last_clean":"2024-09-15T12:18:54.003623+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:18:54.003623+0000","last_undegraded":"2024-09-15T12:18:54.003623+0000","last_fullsized":"2024-09-15T12:18:54.003623+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"18'531","reported_seq":543,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.606218+0000","last_change":"2024-09-15T12:18:53.172532+0000","last_active":"2024-09-15T12:19:40.606218+0000","last_peered":"2024-09-15T12:19:40.606218+0000","last_clean":"2024-09-15T12:19:40.606218+0000","last_became_active":"2024-09-15T12:18:53.166197+0000","last_became_peered":"2024-09-15T12:18:53.166197+0000","last_unstale":"2024-09-15T12:19:40.606218+0000","last_undegraded":"2024-09-15T12:19:40.606218+0000","last_fullsized":"2024-09-15T12:19:40.606218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":531,"log_dups_size":0,"ondisk_log_size":531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34799616,"num_objects":531,"num_object_clones":0,"num_object_copies":1593,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":531,"num_write_kb":33984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.003840+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:18:54.003840+0000","last_peered":"2024-09-15T12:18:54.003840+0000","last_clean":"2024-09-15T12:18:54.003840+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:18:54.003840+0000","last_undegraded":"2024-09-15T12:18:54.003840+0000","last_fullsized":"2024-09-15T12:18:54.003840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"18'543","reported_seq":555,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:41.656955+0000","last_change":"2024-09-15T12:18:53.161283+0000","last_active":"2024-09-15T12:19:41.656955+0000","last_peered":"2024-09-15T12:19:41.656955+0000","last_clean":"2024-09-15T12:19:41.656955+0000","last_became_active":"2024-09-15T12:18:53.149710+0000","last_became_peered":"2024-09-15T12:18:53.149710+0000","last_unstale":"2024-09-15T12:19:41.656955+0000","last_undegraded":"2024-09-15T12:19:41.656955+0000","last_fullsized":"2024-09-15T12:19:41.656955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35586048,"num_objects":543,"num_object_clones":0,"num_object_copies":1629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":543,"num_write_kb":34752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:53.996018+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:18:53.996018+0000","last_peered":"2024-09-15T12:18:53.996018+0000","last_clean":"2024-09-15T12:18:53.996018+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:18:53.996018+0000","last_undegraded":"2024-09-15T12:18:53.996018+0000","last_fullsized":"2024-09-15T12:18:53.996018+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"18'553","reported_seq":565,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:41.677242+0000","last_change":"2024-09-15T12:18:53.169843+0000","last_active":"2024-09-15T12:19:41.677242+0000","last_peered":"2024-09-15T12:19:41.677242+0000","last_clean":"2024-09-15T12:19:41.677242+0000","last_became_active":"2024-09-15T12:18:53.161921+0000","last_became_peered":"2024-09-15T12:18:53.161921+0000","last_unstale":"2024-09-15T12:19:41.677242+0000","last_undegraded":"2024-09-15T12:19:41.677242+0000","last_fullsized":"2024-09-15T12:19:41.677242+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":27,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:53.995342+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:18:53.995342+0000","last_peered":"2024-09-15T12:18:53.995342+0000","last_clean":"2024-09-15T12:18:53.995342+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:18:53.995342+0000","last_undegraded":"2024-09-15T12:18:53.995342+0000","last_fullsized":"2024-09-15T12:18:53.995342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"18'566","reported_seq":578,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.557992+0000","last_change":"2024-09-15T12:18:53.100005+0000","last_active":"2024-09-15T12:19:40.557992+0000","last_peered":"2024-09-15T12:19:40.557992+0000","last_clean":"2024-09-15T12:19:40.557992+0000","last_became_active":"2024-09-15T12:18:53.080705+0000","last_became_peered":"2024-09-15T12:18:53.080705+0000","last_unstale":"2024-09-15T12:19:40.557992+0000","last_undegraded":"2024-09-15T12:19:40.557992+0000","last_fullsized":"2024-09-15T12:19:40.557992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37093376,"num_objects":566,"num_object_clones":0,"num_object_copies":1698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":566,"num_write_kb":36224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"18'536","reported_seq":548,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.579487+0000","last_change":"2024-09-15T12:18:53.122880+0000","last_active":"2024-09-15T12:19:40.579487+0000","last_peered":"2024-09-15T12:19:40.579487+0000","last_clean":"2024-09-15T12:19:40.579487+0000","last_became_active":"2024-09-15T12:18:53.111647+0000","last_became_peered":"2024-09-15T12:18:53.111647+0000","last_unstale":"2024-09-15T12:19:40.579487+0000","last_undegraded":"2024-09-15T12:19:40.579487+0000","last_fullsized":"2024-09-15T12:19:40.579487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35127296,"num_objects":536,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.005037+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:18:54.005037+0000","last_peered":"2024-09-15T12:18:54.005037+0000","last_clean":"2024-09-15T12:18:54.005037+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:18:54.005037+0000","last_undegraded":"2024-09-15T12:18:54.005037+0000","last_fullsized":"2024-09-15T12:18:54.005037+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"18'550","reported_seq":562,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.614011+0000","last_change":"2024-09-15T12:18:53.133542+0000","last_active":"2024-09-15T12:19:40.614011+0000","last_peered":"2024-09-15T12:19:40.614011+0000","last_clean":"2024-09-15T12:19:40.614011+0000","last_became_active":"2024-09-15T12:18:53.125716+0000","last_became_peered":"2024-09-15T12:18:53.125716+0000","last_unstale":"2024-09-15T12:19:40.614011+0000","last_undegraded":"2024-09-15T12:19:40.614011+0000","last_fullsized":"2024-09-15T12:19:40.614011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36044800,"num_objects":550,"num_object_clones":0,"num_object_copies":1650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":550,"num_write_kb":35200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.002907+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:18:54.002907+0000","last_peered":"2024-09-15T12:18:54.002907+0000","last_clean":"2024-09-15T12:18:54.002907+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:18:54.002907+0000","last_undegraded":"2024-09-15T12:18:54.002907+0000","last_fullsized":"2024-09-15T12:18:54.002907+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"18'536","reported_seq":548,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:41.514400+0000","last_change":"2024-09-15T12:18:53.133963+0000","last_active":"2024-09-15T12:19:41.514400+0000","last_peered":"2024-09-15T12:19:41.514400+0000","last_clean":"2024-09-15T12:19:41.514400+0000","last_became_active":"2024-09-15T12:18:53.122383+0000","last_became_peered":"2024-09-15T12:18:53.122383+0000","last_unstale":"2024-09-15T12:19:41.514400+0000","last_undegraded":"2024-09-15T12:19:41.514400+0000","last_fullsized":"2024-09-15T12:19:41.514400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35127296,"num_objects":536,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.001912+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:18:54.001912+0000","last_peered":"2024-09-15T12:18:54.001912+0000","last_clean":"2024-09-15T12:18:54.001912+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:18:54.001912+0000","last_undegraded":"2024-09-15T12:18:54.001912+0000","last_fullsized":"2024-09-15T12:18:54.001912+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"18'557","reported_seq":569,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.703949+0000","last_change":"2024-09-15T12:18:53.102960+0000","last_active":"2024-09-15T12:19:40.703949+0000","last_peered":"2024-09-15T12:19:40.703949+0000","last_clean":"2024-09-15T12:19:40.703949+0000","last_became_active":"2024-09-15T12:18:53.088807+0000","last_became_peered":"2024-09-15T12:18:53.088807+0000","last_unstale":"2024-09-15T12:19:40.703949+0000","last_undegraded":"2024-09-15T12:19:40.703949+0000","last_fullsized":"2024-09-15T12:19:40.703949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36503552,"num_objects":557,"num_object_clones":0,"num_object_copies":1671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":557,"num_write_kb":35648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.002303+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:18:54.002303+0000","last_peered":"2024-09-15T12:18:54.002303+0000","last_clean":"2024-09-15T12:18:54.002303+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:18:54.002303+0000","last_undegraded":"2024-09-15T12:18:54.002303+0000","last_fullsized":"2024-09-15T12:18:54.002303+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":559677440,"num_objects":8540,"num_object_clones":0,"num_object_copies":25620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8540,"num_write_kb":546560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":105025536,"data_stored":1680408576,"data_compressed":79791462,"data_compressed_allocated":105025536,"data_compressed_original":1680408576,"omap_allocated":0,"internal_metadata":0},"log_size":8540,"ondisk_log_size":8540,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673019,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69384,"kb_used_data":30072,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94302456,"statfs":{"total":96636764160,"available":96565714944,"internally_reserved":0,"allocated":30793728,"data_stored":489927087,"data_compressed":23263232,"data_compressed_allocated":30621696,"data_compressed_original":489865216,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54156,"kb_used_data":23164,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94317684,"statfs":{"total":96636764160,"available":96581308416,"internally_reserved":0,"allocated":23719936,"data_stored":376680898,"data_compressed":17885933,"data_compressed_allocated":23543808,"data_compressed_original":376619008,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60200,"kb_used_data":25048,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94311640,"statfs":{"total":96636764160,"available":96575119360,"internally_reserved":0,"allocated":25649152,"data_stored":407941026,"data_compressed":19368266,"data_compressed_allocated":25493504,"data_compressed_original":407896064,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54136,"kb_used_data":23144,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94317704,"statfs":{"total":96636764160,"available":96581328896,"internally_reserved":0,"allocated":23699456,"data_stored":376353218,"data_compressed":17870367,"data_compressed_allocated":23523328,"data_compressed_original":376291328,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23932928,"data_stored":382926848,"data_compressed":18182655,"data_compressed_allocated":23932928,"data_compressed_original":382926848,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25985024,"data_stored":415760384,"data_compressed":19741706,"data_compressed_allocated":25985024,"data_compressed_original":415760384,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23986176,"data_stored":383778816,"data_compressed":18223117,"data_compressed_allocated":23986176,"data_compressed_original":383778816,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":31121408,"data_stored":497942528,"data_compressed":23643984,"data_compressed_allocated":31121408,"data_compressed_original":497942528,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:19:48.984 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:19:49.067 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 55 16 9936 9920 11.2718 10.4375 0.0366475 0.0886264 2024-09-15T12:19:49.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:49.148+0000 7f7eec551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:49.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:49.157+0000 7f7eec551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:50.067 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 56 16 10099 10083 11.2524 10.1875 0.0843344 0.0887893 2024-09-15T12:19:51.067 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 57 16 10273 10257 11.2458 10.875 0.165806 0.0888365 2024-09-15T12:19:51.594 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:19:51.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:51.727+0000 7f8f45457640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:51.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:51.736+0000 7f8f45457640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:52.067 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 58 16 10444 10428 11.2361 10.6875 0.12286 0.088911 2024-09-15T12:19:53.067 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 59 16 10619 10603 11.231 10.9375 0.125163 0.0889456 2024-09-15T12:19:53.806 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:19:53.806 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:19:53.806 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:19:53.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:53.956+0000 7ff4fbebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:53.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:53.965+0000 7ff4fbebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:54.067 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:2024-09-15T12:19:54.067465+0000 min lat: 0.0153683 max lat: 0.213381 avg lat: 0.0890277 2024-09-15T12:19:54.068 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-15T12:19:54.068 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 60 16 10793 10777 11.2251 10.875 0.0943542 0.0890277 2024-09-15T12:19:54.112 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:19:54.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:54.270+0000 7f8d61e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:54.282 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:19:54.282 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:19:54.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:54.281+0000 7f8d61e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:54.300 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":47,"stamp":"2024-09-15T12:19:53.715596+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":560267827,"num_objects":8544,"num_object_clones":0,"num_object_copies":25632,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8621,"num_write_kb":547668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8595,"ondisk_log_size":8595,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":237876,"kb_used_data":101428,"kb_used_omap":0,"kb_used_meta":136384,"kb_avail":377249484,"statfs":{"total":386547056640,"available":386303471616,"internally_reserved":0,"allocated":103862272,"data_stored":1650902229,"data_compressed":78387798,"data_compressed_allocated":103182336,"data_compressed_original":1650671616,"omap_allocated":0,"internal_metadata":139657216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":88080384,"num_objects":1344,"num_object_clones":0,"num_object_copies":4032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1344,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002612"},"pg_stats":[{"pgid":"3.f","version":"18'502","reported_seq":514,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.613754+0000","last_change":"2024-09-15T12:18:53.083350+0000","last_active":"2024-09-15T12:19:40.613754+0000","last_peered":"2024-09-15T12:19:40.613754+0000","last_clean":"2024-09-15T12:19:40.613754+0000","last_became_active":"2024-09-15T12:18:53.075051+0000","last_became_peered":"2024-09-15T12:18:53.075051+0000","last_unstale":"2024-09-15T12:19:40.613754+0000","last_undegraded":"2024-09-15T12:19:40.613754+0000","last_fullsized":"2024-09-15T12:19:40.613754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32899072,"num_objects":502,"num_object_clones":0,"num_object_copies":1506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":502,"num_write_kb":32128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'479","reported_seq":491,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.412103+0000","last_change":"2024-09-15T12:18:53.139711+0000","last_active":"2024-09-15T12:19:40.412103+0000","last_peered":"2024-09-15T12:19:40.412103+0000","last_clean":"2024-09-15T12:19:40.412103+0000","last_became_active":"2024-09-15T12:18:53.130124+0000","last_became_peered":"2024-09-15T12:18:53.130124+0000","last_unstale":"2024-09-15T12:19:40.412103+0000","last_undegraded":"2024-09-15T12:19:40.412103+0000","last_fullsized":"2024-09-15T12:19:40.412103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31391744,"num_objects":479,"num_object_clones":0,"num_object_copies":1437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":479,"num_write_kb":30656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'550","reported_seq":562,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.489250+0000","last_change":"2024-09-15T12:18:53.140327+0000","last_active":"2024-09-15T12:19:40.489250+0000","last_peered":"2024-09-15T12:19:40.489250+0000","last_clean":"2024-09-15T12:19:40.489250+0000","last_became_active":"2024-09-15T12:18:53.128935+0000","last_became_peered":"2024-09-15T12:18:53.128935+0000","last_unstale":"2024-09-15T12:19:40.489250+0000","last_undegraded":"2024-09-15T12:19:40.489250+0000","last_fullsized":"2024-09-15T12:19:40.489250+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36044800,"num_objects":550,"num_object_clones":0,"num_object_copies":1650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":550,"num_write_kb":35200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"18'535","reported_seq":547,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.466060+0000","last_change":"2024-09-15T12:18:53.138678+0000","last_active":"2024-09-15T12:19:40.466060+0000","last_peered":"2024-09-15T12:19:40.466060+0000","last_clean":"2024-09-15T12:19:40.466060+0000","last_became_active":"2024-09-15T12:18:53.129492+0000","last_became_peered":"2024-09-15T12:18:53.129492+0000","last_unstale":"2024-09-15T12:19:40.466060+0000","last_undegraded":"2024-09-15T12:19:40.466060+0000","last_fullsized":"2024-09-15T12:19:40.466060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35061760,"num_objects":535,"num_object_clones":0,"num_object_copies":1605,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":535,"num_write_kb":34240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'516","reported_seq":528,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:41.633134+0000","last_change":"2024-09-15T12:18:53.109204+0000","last_active":"2024-09-15T12:19:41.633134+0000","last_peered":"2024-09-15T12:19:41.633134+0000","last_clean":"2024-09-15T12:19:41.633134+0000","last_became_active":"2024-09-15T12:18:53.087134+0000","last_became_peered":"2024-09-15T12:18:53.087134+0000","last_unstale":"2024-09-15T12:19:41.633134+0000","last_undegraded":"2024-09-15T12:19:41.633134+0000","last_fullsized":"2024-09-15T12:19:41.633134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":516,"log_dups_size":0,"ondisk_log_size":516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33816576,"num_objects":516,"num_object_clones":0,"num_object_copies":1548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":516,"num_write_kb":33024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"18'517","reported_seq":529,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.718310+0000","last_change":"2024-09-15T12:18:53.119675+0000","last_active":"2024-09-15T12:19:40.718310+0000","last_peered":"2024-09-15T12:19:40.718310+0000","last_clean":"2024-09-15T12:19:40.718310+0000","last_became_active":"2024-09-15T12:18:53.112010+0000","last_became_peered":"2024-09-15T12:18:53.112010+0000","last_unstale":"2024-09-15T12:19:40.718310+0000","last_undegraded":"2024-09-15T12:19:40.718310+0000","last_fullsized":"2024-09-15T12:19:40.718310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33882112,"num_objects":517,"num_object_clones":0,"num_object_copies":1551,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":517,"num_write_kb":33088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"18'529","reported_seq":541,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.579114+0000","last_change":"2024-09-15T12:18:53.136381+0000","last_active":"2024-09-15T12:19:40.579114+0000","last_peered":"2024-09-15T12:19:40.579114+0000","last_clean":"2024-09-15T12:19:40.579114+0000","last_became_active":"2024-09-15T12:18:53.128765+0000","last_became_peered":"2024-09-15T12:18:53.128765+0000","last_unstale":"2024-09-15T12:19:40.579114+0000","last_undegraded":"2024-09-15T12:19:40.579114+0000","last_fullsized":"2024-09-15T12:19:40.579114+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":33856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"18'540","reported_seq":552,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.658996+0000","last_change":"2024-09-15T12:18:53.090984+0000","last_active":"2024-09-15T12:19:40.658996+0000","last_peered":"2024-09-15T12:19:40.658996+0000","last_clean":"2024-09-15T12:19:40.658996+0000","last_became_active":"2024-09-15T12:18:53.080676+0000","last_became_peered":"2024-09-15T12:18:53.080676+0000","last_unstale":"2024-09-15T12:19:40.658996+0000","last_undegraded":"2024-09-15T12:19:40.658996+0000","last_fullsized":"2024-09-15T12:19:40.658996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35389440,"num_objects":540,"num_object_clones":0,"num_object_copies":1620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":540,"num_write_kb":34560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":97,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:53.998335+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:18:53.998335+0000","last_peered":"2024-09-15T12:18:53.998335+0000","last_clean":"2024-09-15T12:18:53.998335+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:18:53.998335+0000","last_undegraded":"2024-09-15T12:18:53.998335+0000","last_fullsized":"2024-09-15T12:18:53.998335+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.003623+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:18:54.003623+0000","last_peered":"2024-09-15T12:18:54.003623+0000","last_clean":"2024-09-15T12:18:54.003623+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:18:54.003623+0000","last_undegraded":"2024-09-15T12:18:54.003623+0000","last_fullsized":"2024-09-15T12:18:54.003623+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"18'531","reported_seq":543,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.606218+0000","last_change":"2024-09-15T12:18:53.172532+0000","last_active":"2024-09-15T12:19:40.606218+0000","last_peered":"2024-09-15T12:19:40.606218+0000","last_clean":"2024-09-15T12:19:40.606218+0000","last_became_active":"2024-09-15T12:18:53.166197+0000","last_became_peered":"2024-09-15T12:18:53.166197+0000","last_unstale":"2024-09-15T12:19:40.606218+0000","last_undegraded":"2024-09-15T12:19:40.606218+0000","last_fullsized":"2024-09-15T12:19:40.606218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":531,"log_dups_size":0,"ondisk_log_size":531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34799616,"num_objects":531,"num_object_clones":0,"num_object_copies":1593,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":531,"num_write_kb":33984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.003840+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:18:54.003840+0000","last_peered":"2024-09-15T12:18:54.003840+0000","last_clean":"2024-09-15T12:18:54.003840+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:18:54.003840+0000","last_undegraded":"2024-09-15T12:18:54.003840+0000","last_fullsized":"2024-09-15T12:18:54.003840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"18'543","reported_seq":555,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:41.656955+0000","last_change":"2024-09-15T12:18:53.161283+0000","last_active":"2024-09-15T12:19:41.656955+0000","last_peered":"2024-09-15T12:19:41.656955+0000","last_clean":"2024-09-15T12:19:41.656955+0000","last_became_active":"2024-09-15T12:18:53.149710+0000","last_became_peered":"2024-09-15T12:18:53.149710+0000","last_unstale":"2024-09-15T12:19:41.656955+0000","last_undegraded":"2024-09-15T12:19:41.656955+0000","last_fullsized":"2024-09-15T12:19:41.656955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35586048,"num_objects":543,"num_object_clones":0,"num_object_copies":1629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":543,"num_write_kb":34752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:53.996018+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:18:53.996018+0000","last_peered":"2024-09-15T12:18:53.996018+0000","last_clean":"2024-09-15T12:18:53.996018+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:18:53.996018+0000","last_undegraded":"2024-09-15T12:18:53.996018+0000","last_fullsized":"2024-09-15T12:18:53.996018+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"18'553","reported_seq":565,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:41.677242+0000","last_change":"2024-09-15T12:18:53.169843+0000","last_active":"2024-09-15T12:19:41.677242+0000","last_peered":"2024-09-15T12:19:41.677242+0000","last_clean":"2024-09-15T12:19:41.677242+0000","last_became_active":"2024-09-15T12:18:53.161921+0000","last_became_peered":"2024-09-15T12:18:53.161921+0000","last_unstale":"2024-09-15T12:19:41.677242+0000","last_undegraded":"2024-09-15T12:19:41.677242+0000","last_fullsized":"2024-09-15T12:19:41.677242+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":27,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:53.995342+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:18:53.995342+0000","last_peered":"2024-09-15T12:18:53.995342+0000","last_clean":"2024-09-15T12:18:53.995342+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:18:53.995342+0000","last_undegraded":"2024-09-15T12:18:53.995342+0000","last_fullsized":"2024-09-15T12:18:53.995342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"18'566","reported_seq":578,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.557992+0000","last_change":"2024-09-15T12:18:53.100005+0000","last_active":"2024-09-15T12:19:40.557992+0000","last_peered":"2024-09-15T12:19:40.557992+0000","last_clean":"2024-09-15T12:19:40.557992+0000","last_became_active":"2024-09-15T12:18:53.080705+0000","last_became_peered":"2024-09-15T12:18:53.080705+0000","last_unstale":"2024-09-15T12:19:40.557992+0000","last_undegraded":"2024-09-15T12:19:40.557992+0000","last_fullsized":"2024-09-15T12:19:40.557992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37093376,"num_objects":566,"num_object_clones":0,"num_object_copies":1698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":566,"num_write_kb":36224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"18'536","reported_seq":548,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.579487+0000","last_change":"2024-09-15T12:18:53.122880+0000","last_active":"2024-09-15T12:19:40.579487+0000","last_peered":"2024-09-15T12:19:40.579487+0000","last_clean":"2024-09-15T12:19:40.579487+0000","last_became_active":"2024-09-15T12:18:53.111647+0000","last_became_peered":"2024-09-15T12:18:53.111647+0000","last_unstale":"2024-09-15T12:19:40.579487+0000","last_undegraded":"2024-09-15T12:19:40.579487+0000","last_fullsized":"2024-09-15T12:19:40.579487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35127296,"num_objects":536,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.005037+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:18:54.005037+0000","last_peered":"2024-09-15T12:18:54.005037+0000","last_clean":"2024-09-15T12:18:54.005037+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:18:54.005037+0000","last_undegraded":"2024-09-15T12:18:54.005037+0000","last_fullsized":"2024-09-15T12:18:54.005037+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"18'550","reported_seq":562,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.614011+0000","last_change":"2024-09-15T12:18:53.133542+0000","last_active":"2024-09-15T12:19:40.614011+0000","last_peered":"2024-09-15T12:19:40.614011+0000","last_clean":"2024-09-15T12:19:40.614011+0000","last_became_active":"2024-09-15T12:18:53.125716+0000","last_became_peered":"2024-09-15T12:18:53.125716+0000","last_unstale":"2024-09-15T12:19:40.614011+0000","last_undegraded":"2024-09-15T12:19:40.614011+0000","last_fullsized":"2024-09-15T12:19:40.614011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36044800,"num_objects":550,"num_object_clones":0,"num_object_copies":1650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":550,"num_write_kb":35200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.002907+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:18:54.002907+0000","last_peered":"2024-09-15T12:18:54.002907+0000","last_clean":"2024-09-15T12:18:54.002907+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:18:54.002907+0000","last_undegraded":"2024-09-15T12:18:54.002907+0000","last_fullsized":"2024-09-15T12:18:54.002907+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"18'536","reported_seq":548,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:41.514400+0000","last_change":"2024-09-15T12:18:53.133963+0000","last_active":"2024-09-15T12:19:41.514400+0000","last_peered":"2024-09-15T12:19:41.514400+0000","last_clean":"2024-09-15T12:19:41.514400+0000","last_became_active":"2024-09-15T12:18:53.122383+0000","last_became_peered":"2024-09-15T12:18:53.122383+0000","last_unstale":"2024-09-15T12:19:41.514400+0000","last_undegraded":"2024-09-15T12:19:41.514400+0000","last_fullsized":"2024-09-15T12:19:41.514400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35127296,"num_objects":536,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.001912+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:18:54.001912+0000","last_peered":"2024-09-15T12:18:54.001912+0000","last_clean":"2024-09-15T12:18:54.001912+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:18:54.001912+0000","last_undegraded":"2024-09-15T12:18:54.001912+0000","last_fullsized":"2024-09-15T12:18:54.001912+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"18'557","reported_seq":569,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.703949+0000","last_change":"2024-09-15T12:18:53.102960+0000","last_active":"2024-09-15T12:19:40.703949+0000","last_peered":"2024-09-15T12:19:40.703949+0000","last_clean":"2024-09-15T12:19:40.703949+0000","last_became_active":"2024-09-15T12:18:53.088807+0000","last_became_peered":"2024-09-15T12:18:53.088807+0000","last_unstale":"2024-09-15T12:19:40.703949+0000","last_undegraded":"2024-09-15T12:19:40.703949+0000","last_fullsized":"2024-09-15T12:19:40.703949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36503552,"num_objects":557,"num_object_clones":0,"num_object_copies":1671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":557,"num_write_kb":35648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.002303+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:18:54.002303+0000","last_peered":"2024-09-15T12:18:54.002303+0000","last_clean":"2024-09-15T12:18:54.002303+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:18:54.002303+0000","last_undegraded":"2024-09-15T12:18:54.002303+0000","last_fullsized":"2024-09-15T12:18:54.002303+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":559677440,"num_objects":8540,"num_object_clones":0,"num_object_copies":25620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8540,"num_write_kb":546560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":105025536,"data_stored":1680408576,"data_compressed":79791462,"data_compressed_allocated":105025536,"data_compressed_original":1680408576,"omap_allocated":0,"internal_metadata":0},"log_size":8540,"ondisk_log_size":8540,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673019,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69384,"kb_used_data":30072,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94302456,"statfs":{"total":96636764160,"available":96565714944,"internally_reserved":0,"allocated":30793728,"data_stored":489927087,"data_compressed":23263232,"data_compressed_allocated":30621696,"data_compressed_original":489865216,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54156,"kb_used_data":23164,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94317684,"statfs":{"total":96636764160,"available":96581308416,"internally_reserved":0,"allocated":23719936,"data_stored":376680898,"data_compressed":17885933,"data_compressed_allocated":23543808,"data_compressed_original":376619008,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60200,"kb_used_data":25048,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94311640,"statfs":{"total":96636764160,"available":96575119360,"internally_reserved":0,"allocated":25649152,"data_stored":407941026,"data_compressed":19368266,"data_compressed_allocated":25493504,"data_compressed_original":407896064,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54136,"kb_used_data":23144,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94317704,"statfs":{"total":96636764160,"available":96581328896,"internally_reserved":0,"allocated":23699456,"data_stored":376353218,"data_compressed":17870367,"data_compressed_allocated":23523328,"data_compressed_original":376291328,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23932928,"data_stored":382926848,"data_compressed":18182655,"data_compressed_allocated":23932928,"data_compressed_original":382926848,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25985024,"data_stored":415760384,"data_compressed":19741706,"data_compressed_allocated":25985024,"data_compressed_original":415760384,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23986176,"data_stored":383778816,"data_compressed":18223117,"data_compressed_allocated":23986176,"data_compressed_original":383778816,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":31121408,"data_stored":497942528,"data_compressed":23643984,"data_compressed_allocated":31121408,"data_compressed_original":497942528,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:19:55.068 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 61 16 10958 10942 11.2101 10.3125 0.0697022 0.0891153 2024-09-15T12:19:56.068 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 62 16 11125 11109 11.1976 10.4375 0.081936 0.0891947 2024-09-15T12:19:56.715 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:19:56.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:56.853+0000 7f137f111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:56.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:56.864+0000 7f137f111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:57.068 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 63 16 11284 11268 11.1776 9.9375 0.106468 0.0893749 2024-09-15T12:19:58.068 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 64 16 11447 11431 11.1621 10.1875 0.106943 0.0894966 2024-09-15T12:19:59.068 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 65 16 11628 11612 11.1644 11.3125 0.127418 0.08951 2024-09-15T12:19:59.221 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:19:59.303 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:19:59.303 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-15T12:19:59.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:59.380+0000 7f167d511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:59.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:59.391+0000 7f167d511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:59.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:59.461+0000 7f6a25b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:19:59.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:19:59.478+0000 7f6a25b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:00.068 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 66 16 11790 11774 11.1487 10.125 0.081504 0.0896214 2024-09-15T12:20:00.458 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.0 to 1 (10000) 2024-09-15T12:20:00.483 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-15T12:20:00.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:00.622+0000 7f6cbf791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:00.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:00.640+0000 7f6cbf791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:01.068 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 67 16 11962 11946 11.1427 10.75 0.0854975 0.0896801 2024-09-15T12:20:01.458 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.1 to 1 (10000) 2024-09-15T12:20:01.480 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-15T12:20:01.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:01.617+0000 7f707a25c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:01.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:01.633+0000 7f707a25c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:01.832 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:20:01.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:01.984+0000 7f387de23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:01.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:01.993+0000 7f387de23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:02.068 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 68 16 12131 12115 11.1341 10.5625 0.0932092 0.0897502 2024-09-15T12:20:02.463 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.2 to 1 (10000) 2024-09-15T12:20:02.486 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-15T12:20:02.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:02.663+0000 7f30ecb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:02.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:02.679+0000 7f30ecb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:03.068 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 69 16 12299 12283 11.1249 10.5 0.0394035 0.0898241 2024-09-15T12:20:03.474 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.3 to 1 (10000) 2024-09-15T12:20:03.496 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-15T12:20:03.496 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:20:03.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:03.647+0000 7eff3ef51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:03.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:03.656+0000 7eff3ef51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:03.995 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:20:03.996 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:20:04.010 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-09-15T12:20:03.717571+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":560267827,"num_objects":8544,"num_object_clones":0,"num_object_copies":25632,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8621,"num_write_kb":547668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8595,"ondisk_log_size":8595,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":237876,"kb_used_data":101428,"kb_used_omap":0,"kb_used_meta":136384,"kb_avail":377249484,"statfs":{"total":386547056640,"available":386303471616,"internally_reserved":0,"allocated":103862272,"data_stored":1650902229,"data_compressed":78387798,"data_compressed_allocated":103182336,"data_compressed_original":1650671616,"omap_allocated":0,"internal_metadata":139657216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000873"},"pg_stats":[{"pgid":"3.f","version":"18'502","reported_seq":514,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.613754+0000","last_change":"2024-09-15T12:18:53.083350+0000","last_active":"2024-09-15T12:19:40.613754+0000","last_peered":"2024-09-15T12:19:40.613754+0000","last_clean":"2024-09-15T12:19:40.613754+0000","last_became_active":"2024-09-15T12:18:53.075051+0000","last_became_peered":"2024-09-15T12:18:53.075051+0000","last_unstale":"2024-09-15T12:19:40.613754+0000","last_undegraded":"2024-09-15T12:19:40.613754+0000","last_fullsized":"2024-09-15T12:19:40.613754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32899072,"num_objects":502,"num_object_clones":0,"num_object_copies":1506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":502,"num_write_kb":32128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'479","reported_seq":491,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.412103+0000","last_change":"2024-09-15T12:18:53.139711+0000","last_active":"2024-09-15T12:19:40.412103+0000","last_peered":"2024-09-15T12:19:40.412103+0000","last_clean":"2024-09-15T12:19:40.412103+0000","last_became_active":"2024-09-15T12:18:53.130124+0000","last_became_peered":"2024-09-15T12:18:53.130124+0000","last_unstale":"2024-09-15T12:19:40.412103+0000","last_undegraded":"2024-09-15T12:19:40.412103+0000","last_fullsized":"2024-09-15T12:19:40.412103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31391744,"num_objects":479,"num_object_clones":0,"num_object_copies":1437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":479,"num_write_kb":30656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'550","reported_seq":562,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.489250+0000","last_change":"2024-09-15T12:18:53.140327+0000","last_active":"2024-09-15T12:19:40.489250+0000","last_peered":"2024-09-15T12:19:40.489250+0000","last_clean":"2024-09-15T12:19:40.489250+0000","last_became_active":"2024-09-15T12:18:53.128935+0000","last_became_peered":"2024-09-15T12:18:53.128935+0000","last_unstale":"2024-09-15T12:19:40.489250+0000","last_undegraded":"2024-09-15T12:19:40.489250+0000","last_fullsized":"2024-09-15T12:19:40.489250+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36044800,"num_objects":550,"num_object_clones":0,"num_object_copies":1650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":550,"num_write_kb":35200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"18'535","reported_seq":547,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.466060+0000","last_change":"2024-09-15T12:18:53.138678+0000","last_active":"2024-09-15T12:19:40.466060+0000","last_peered":"2024-09-15T12:19:40.466060+0000","last_clean":"2024-09-15T12:19:40.466060+0000","last_became_active":"2024-09-15T12:18:53.129492+0000","last_became_peered":"2024-09-15T12:18:53.129492+0000","last_unstale":"2024-09-15T12:19:40.466060+0000","last_undegraded":"2024-09-15T12:19:40.466060+0000","last_fullsized":"2024-09-15T12:19:40.466060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35061760,"num_objects":535,"num_object_clones":0,"num_object_copies":1605,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":535,"num_write_kb":34240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'516","reported_seq":528,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:41.633134+0000","last_change":"2024-09-15T12:18:53.109204+0000","last_active":"2024-09-15T12:19:41.633134+0000","last_peered":"2024-09-15T12:19:41.633134+0000","last_clean":"2024-09-15T12:19:41.633134+0000","last_became_active":"2024-09-15T12:18:53.087134+0000","last_became_peered":"2024-09-15T12:18:53.087134+0000","last_unstale":"2024-09-15T12:19:41.633134+0000","last_undegraded":"2024-09-15T12:19:41.633134+0000","last_fullsized":"2024-09-15T12:19:41.633134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":516,"log_dups_size":0,"ondisk_log_size":516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33816576,"num_objects":516,"num_object_clones":0,"num_object_copies":1548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":516,"num_write_kb":33024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"18'517","reported_seq":529,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.718310+0000","last_change":"2024-09-15T12:18:53.119675+0000","last_active":"2024-09-15T12:19:40.718310+0000","last_peered":"2024-09-15T12:19:40.718310+0000","last_clean":"2024-09-15T12:19:40.718310+0000","last_became_active":"2024-09-15T12:18:53.112010+0000","last_became_peered":"2024-09-15T12:18:53.112010+0000","last_unstale":"2024-09-15T12:19:40.718310+0000","last_undegraded":"2024-09-15T12:19:40.718310+0000","last_fullsized":"2024-09-15T12:19:40.718310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33882112,"num_objects":517,"num_object_clones":0,"num_object_copies":1551,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":517,"num_write_kb":33088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"18'529","reported_seq":541,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.579114+0000","last_change":"2024-09-15T12:18:53.136381+0000","last_active":"2024-09-15T12:19:40.579114+0000","last_peered":"2024-09-15T12:19:40.579114+0000","last_clean":"2024-09-15T12:19:40.579114+0000","last_became_active":"2024-09-15T12:18:53.128765+0000","last_became_peered":"2024-09-15T12:18:53.128765+0000","last_unstale":"2024-09-15T12:19:40.579114+0000","last_undegraded":"2024-09-15T12:19:40.579114+0000","last_fullsized":"2024-09-15T12:19:40.579114+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":33856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"18'540","reported_seq":552,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.658996+0000","last_change":"2024-09-15T12:18:53.090984+0000","last_active":"2024-09-15T12:19:40.658996+0000","last_peered":"2024-09-15T12:19:40.658996+0000","last_clean":"2024-09-15T12:19:40.658996+0000","last_became_active":"2024-09-15T12:18:53.080676+0000","last_became_peered":"2024-09-15T12:18:53.080676+0000","last_unstale":"2024-09-15T12:19:40.658996+0000","last_undegraded":"2024-09-15T12:19:40.658996+0000","last_fullsized":"2024-09-15T12:19:40.658996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35389440,"num_objects":540,"num_object_clones":0,"num_object_copies":1620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":540,"num_write_kb":34560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":97,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:53.998335+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:18:53.998335+0000","last_peered":"2024-09-15T12:18:53.998335+0000","last_clean":"2024-09-15T12:18:53.998335+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:18:53.998335+0000","last_undegraded":"2024-09-15T12:18:53.998335+0000","last_fullsized":"2024-09-15T12:18:53.998335+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.003623+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:18:54.003623+0000","last_peered":"2024-09-15T12:18:54.003623+0000","last_clean":"2024-09-15T12:18:54.003623+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:18:54.003623+0000","last_undegraded":"2024-09-15T12:18:54.003623+0000","last_fullsized":"2024-09-15T12:18:54.003623+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"18'531","reported_seq":543,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.606218+0000","last_change":"2024-09-15T12:18:53.172532+0000","last_active":"2024-09-15T12:19:40.606218+0000","last_peered":"2024-09-15T12:19:40.606218+0000","last_clean":"2024-09-15T12:19:40.606218+0000","last_became_active":"2024-09-15T12:18:53.166197+0000","last_became_peered":"2024-09-15T12:18:53.166197+0000","last_unstale":"2024-09-15T12:19:40.606218+0000","last_undegraded":"2024-09-15T12:19:40.606218+0000","last_fullsized":"2024-09-15T12:19:40.606218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":531,"log_dups_size":0,"ondisk_log_size":531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34799616,"num_objects":531,"num_object_clones":0,"num_object_copies":1593,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":531,"num_write_kb":33984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.003840+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:18:54.003840+0000","last_peered":"2024-09-15T12:18:54.003840+0000","last_clean":"2024-09-15T12:18:54.003840+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:18:54.003840+0000","last_undegraded":"2024-09-15T12:18:54.003840+0000","last_fullsized":"2024-09-15T12:18:54.003840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"18'543","reported_seq":555,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:41.656955+0000","last_change":"2024-09-15T12:18:53.161283+0000","last_active":"2024-09-15T12:19:41.656955+0000","last_peered":"2024-09-15T12:19:41.656955+0000","last_clean":"2024-09-15T12:19:41.656955+0000","last_became_active":"2024-09-15T12:18:53.149710+0000","last_became_peered":"2024-09-15T12:18:53.149710+0000","last_unstale":"2024-09-15T12:19:41.656955+0000","last_undegraded":"2024-09-15T12:19:41.656955+0000","last_fullsized":"2024-09-15T12:19:41.656955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35586048,"num_objects":543,"num_object_clones":0,"num_object_copies":1629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":543,"num_write_kb":34752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:53.996018+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:18:53.996018+0000","last_peered":"2024-09-15T12:18:53.996018+0000","last_clean":"2024-09-15T12:18:53.996018+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:18:53.996018+0000","last_undegraded":"2024-09-15T12:18:53.996018+0000","last_fullsized":"2024-09-15T12:18:53.996018+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"18'553","reported_seq":565,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:41.677242+0000","last_change":"2024-09-15T12:18:53.169843+0000","last_active":"2024-09-15T12:19:41.677242+0000","last_peered":"2024-09-15T12:19:41.677242+0000","last_clean":"2024-09-15T12:19:41.677242+0000","last_became_active":"2024-09-15T12:18:53.161921+0000","last_became_peered":"2024-09-15T12:18:53.161921+0000","last_unstale":"2024-09-15T12:19:41.677242+0000","last_undegraded":"2024-09-15T12:19:41.677242+0000","last_fullsized":"2024-09-15T12:19:41.677242+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":27,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:53.995342+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:18:53.995342+0000","last_peered":"2024-09-15T12:18:53.995342+0000","last_clean":"2024-09-15T12:18:53.995342+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:18:53.995342+0000","last_undegraded":"2024-09-15T12:18:53.995342+0000","last_fullsized":"2024-09-15T12:18:53.995342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"18'566","reported_seq":578,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.557992+0000","last_change":"2024-09-15T12:18:53.100005+0000","last_active":"2024-09-15T12:19:40.557992+0000","last_peered":"2024-09-15T12:19:40.557992+0000","last_clean":"2024-09-15T12:19:40.557992+0000","last_became_active":"2024-09-15T12:18:53.080705+0000","last_became_peered":"2024-09-15T12:18:53.080705+0000","last_unstale":"2024-09-15T12:19:40.557992+0000","last_undegraded":"2024-09-15T12:19:40.557992+0000","last_fullsized":"2024-09-15T12:19:40.557992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37093376,"num_objects":566,"num_object_clones":0,"num_object_copies":1698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":566,"num_write_kb":36224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"18'536","reported_seq":548,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.579487+0000","last_change":"2024-09-15T12:18:53.122880+0000","last_active":"2024-09-15T12:19:40.579487+0000","last_peered":"2024-09-15T12:19:40.579487+0000","last_clean":"2024-09-15T12:19:40.579487+0000","last_became_active":"2024-09-15T12:18:53.111647+0000","last_became_peered":"2024-09-15T12:18:53.111647+0000","last_unstale":"2024-09-15T12:19:40.579487+0000","last_undegraded":"2024-09-15T12:19:40.579487+0000","last_fullsized":"2024-09-15T12:19:40.579487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35127296,"num_objects":536,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.005037+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:18:54.005037+0000","last_peered":"2024-09-15T12:18:54.005037+0000","last_clean":"2024-09-15T12:18:54.005037+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:18:54.005037+0000","last_undegraded":"2024-09-15T12:18:54.005037+0000","last_fullsized":"2024-09-15T12:18:54.005037+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"18'550","reported_seq":562,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.614011+0000","last_change":"2024-09-15T12:18:53.133542+0000","last_active":"2024-09-15T12:19:40.614011+0000","last_peered":"2024-09-15T12:19:40.614011+0000","last_clean":"2024-09-15T12:19:40.614011+0000","last_became_active":"2024-09-15T12:18:53.125716+0000","last_became_peered":"2024-09-15T12:18:53.125716+0000","last_unstale":"2024-09-15T12:19:40.614011+0000","last_undegraded":"2024-09-15T12:19:40.614011+0000","last_fullsized":"2024-09-15T12:19:40.614011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36044800,"num_objects":550,"num_object_clones":0,"num_object_copies":1650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":550,"num_write_kb":35200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.002907+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:18:54.002907+0000","last_peered":"2024-09-15T12:18:54.002907+0000","last_clean":"2024-09-15T12:18:54.002907+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:18:54.002907+0000","last_undegraded":"2024-09-15T12:18:54.002907+0000","last_fullsized":"2024-09-15T12:18:54.002907+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"18'536","reported_seq":548,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:41.514400+0000","last_change":"2024-09-15T12:18:53.133963+0000","last_active":"2024-09-15T12:19:41.514400+0000","last_peered":"2024-09-15T12:19:41.514400+0000","last_clean":"2024-09-15T12:19:41.514400+0000","last_became_active":"2024-09-15T12:18:53.122383+0000","last_became_peered":"2024-09-15T12:18:53.122383+0000","last_unstale":"2024-09-15T12:19:41.514400+0000","last_undegraded":"2024-09-15T12:19:41.514400+0000","last_fullsized":"2024-09-15T12:19:41.514400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35127296,"num_objects":536,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.001912+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:18:54.001912+0000","last_peered":"2024-09-15T12:18:54.001912+0000","last_clean":"2024-09-15T12:18:54.001912+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:18:54.001912+0000","last_undegraded":"2024-09-15T12:18:54.001912+0000","last_fullsized":"2024-09-15T12:18:54.001912+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"18'557","reported_seq":569,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.703949+0000","last_change":"2024-09-15T12:18:53.102960+0000","last_active":"2024-09-15T12:19:40.703949+0000","last_peered":"2024-09-15T12:19:40.703949+0000","last_clean":"2024-09-15T12:19:40.703949+0000","last_became_active":"2024-09-15T12:18:53.088807+0000","last_became_peered":"2024-09-15T12:18:53.088807+0000","last_unstale":"2024-09-15T12:19:40.703949+0000","last_undegraded":"2024-09-15T12:19:40.703949+0000","last_fullsized":"2024-09-15T12:19:40.703949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36503552,"num_objects":557,"num_object_clones":0,"num_object_copies":1671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":557,"num_write_kb":35648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.002303+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:18:54.002303+0000","last_peered":"2024-09-15T12:18:54.002303+0000","last_clean":"2024-09-15T12:18:54.002303+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:18:54.002303+0000","last_undegraded":"2024-09-15T12:18:54.002303+0000","last_fullsized":"2024-09-15T12:18:54.002303+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":559677440,"num_objects":8540,"num_object_clones":0,"num_object_copies":25620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8540,"num_write_kb":546560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":105025536,"data_stored":1680408576,"data_compressed":79791462,"data_compressed_allocated":105025536,"data_compressed_original":1680408576,"omap_allocated":0,"internal_metadata":0},"log_size":8540,"ondisk_log_size":8540,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673019,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69384,"kb_used_data":30072,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94302456,"statfs":{"total":96636764160,"available":96565714944,"internally_reserved":0,"allocated":30793728,"data_stored":489927087,"data_compressed":23263232,"data_compressed_allocated":30621696,"data_compressed_original":489865216,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54156,"kb_used_data":23164,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94317684,"statfs":{"total":96636764160,"available":96581308416,"internally_reserved":0,"allocated":23719936,"data_stored":376680898,"data_compressed":17885933,"data_compressed_allocated":23543808,"data_compressed_original":376619008,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60200,"kb_used_data":25048,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94311640,"statfs":{"total":96636764160,"available":96575119360,"internally_reserved":0,"allocated":25649152,"data_stored":407941026,"data_compressed":19368266,"data_compressed_allocated":25493504,"data_compressed_original":407896064,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54136,"kb_used_data":23144,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94317704,"statfs":{"total":96636764160,"available":96581328896,"internally_reserved":0,"allocated":23699456,"data_stored":376353218,"data_compressed":17870367,"data_compressed_allocated":23523328,"data_compressed_original":376291328,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23932928,"data_stored":382926848,"data_compressed":18182655,"data_compressed_allocated":23932928,"data_compressed_original":382926848,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25985024,"data_stored":415760384,"data_compressed":19741706,"data_compressed_allocated":25985024,"data_compressed_original":415760384,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23986176,"data_stored":383778816,"data_compressed":18223117,"data_compressed_allocated":23986176,"data_compressed_original":383778816,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":31121408,"data_stored":497942528,"data_compressed":23643984,"data_compressed_allocated":31121408,"data_compressed_original":497942528,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:20:04.012 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:20:04.068 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 70 16 12451 12435 11.1017 9.5 0.0969113 0.0899704 2024-09-15T12:20:04.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:04.157+0000 7f8851351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:04.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:04.171+0000 7f8851351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:04.425 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:20:04.439 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:20:04.440 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:20:04.467 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-09-15T12:20:03.717571+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":560267827,"num_objects":8544,"num_object_clones":0,"num_object_copies":25632,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8621,"num_write_kb":547668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8595,"ondisk_log_size":8595,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":237876,"kb_used_data":101428,"kb_used_omap":0,"kb_used_meta":136384,"kb_avail":377249484,"statfs":{"total":386547056640,"available":386303471616,"internally_reserved":0,"allocated":103862272,"data_stored":1650902229,"data_compressed":78387798,"data_compressed_allocated":103182336,"data_compressed_original":1650671616,"omap_allocated":0,"internal_metadata":139657216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000873"},"pg_stats":[{"pgid":"3.f","version":"18'502","reported_seq":514,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.613754+0000","last_change":"2024-09-15T12:18:53.083350+0000","last_active":"2024-09-15T12:19:40.613754+0000","last_peered":"2024-09-15T12:19:40.613754+0000","last_clean":"2024-09-15T12:19:40.613754+0000","last_became_active":"2024-09-15T12:18:53.075051+0000","last_became_peered":"2024-09-15T12:18:53.075051+0000","last_unstale":"2024-09-15T12:19:40.613754+0000","last_undegraded":"2024-09-15T12:19:40.613754+0000","last_fullsized":"2024-09-15T12:19:40.613754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32899072,"num_objects":502,"num_object_clones":0,"num_object_copies":1506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":502,"num_write_kb":32128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'479","reported_seq":491,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.412103+0000","last_change":"2024-09-15T12:18:53.139711+0000","last_active":"2024-09-15T12:19:40.412103+0000","last_peered":"2024-09-15T12:19:40.412103+0000","last_clean":"2024-09-15T12:19:40.412103+0000","last_became_active":"2024-09-15T12:18:53.130124+0000","last_became_peered":"2024-09-15T12:18:53.130124+0000","last_unstale":"2024-09-15T12:19:40.412103+0000","last_undegraded":"2024-09-15T12:19:40.412103+0000","last_fullsized":"2024-09-15T12:19:40.412103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31391744,"num_objects":479,"num_object_clones":0,"num_object_copies":1437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":479,"num_write_kb":30656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'550","reported_seq":562,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.489250+0000","last_change":"2024-09-15T12:18:53.140327+0000","last_active":"2024-09-15T12:19:40.489250+0000","last_peered":"2024-09-15T12:19:40.489250+0000","last_clean":"2024-09-15T12:19:40.489250+0000","last_became_active":"2024-09-15T12:18:53.128935+0000","last_became_peered":"2024-09-15T12:18:53.128935+0000","last_unstale":"2024-09-15T12:19:40.489250+0000","last_undegraded":"2024-09-15T12:19:40.489250+0000","last_fullsized":"2024-09-15T12:19:40.489250+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36044800,"num_objects":550,"num_object_clones":0,"num_object_copies":1650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":550,"num_write_kb":35200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"18'535","reported_seq":547,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.466060+0000","last_change":"2024-09-15T12:18:53.138678+0000","last_active":"2024-09-15T12:19:40.466060+0000","last_peered":"2024-09-15T12:19:40.466060+0000","last_clean":"2024-09-15T12:19:40.466060+0000","last_became_active":"2024-09-15T12:18:53.129492+0000","last_became_peered":"2024-09-15T12:18:53.129492+0000","last_unstale":"2024-09-15T12:19:40.466060+0000","last_undegraded":"2024-09-15T12:19:40.466060+0000","last_fullsized":"2024-09-15T12:19:40.466060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35061760,"num_objects":535,"num_object_clones":0,"num_object_copies":1605,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":535,"num_write_kb":34240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'516","reported_seq":528,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:41.633134+0000","last_change":"2024-09-15T12:18:53.109204+0000","last_active":"2024-09-15T12:19:41.633134+0000","last_peered":"2024-09-15T12:19:41.633134+0000","last_clean":"2024-09-15T12:19:41.633134+0000","last_became_active":"2024-09-15T12:18:53.087134+0000","last_became_peered":"2024-09-15T12:18:53.087134+0000","last_unstale":"2024-09-15T12:19:41.633134+0000","last_undegraded":"2024-09-15T12:19:41.633134+0000","last_fullsized":"2024-09-15T12:19:41.633134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":516,"log_dups_size":0,"ondisk_log_size":516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33816576,"num_objects":516,"num_object_clones":0,"num_object_copies":1548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":516,"num_write_kb":33024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"18'517","reported_seq":529,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.718310+0000","last_change":"2024-09-15T12:18:53.119675+0000","last_active":"2024-09-15T12:19:40.718310+0000","last_peered":"2024-09-15T12:19:40.718310+0000","last_clean":"2024-09-15T12:19:40.718310+0000","last_became_active":"2024-09-15T12:18:53.112010+0000","last_became_peered":"2024-09-15T12:18:53.112010+0000","last_unstale":"2024-09-15T12:19:40.718310+0000","last_undegraded":"2024-09-15T12:19:40.718310+0000","last_fullsized":"2024-09-15T12:19:40.718310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33882112,"num_objects":517,"num_object_clones":0,"num_object_copies":1551,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":517,"num_write_kb":33088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"18'529","reported_seq":541,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.579114+0000","last_change":"2024-09-15T12:18:53.136381+0000","last_active":"2024-09-15T12:19:40.579114+0000","last_peered":"2024-09-15T12:19:40.579114+0000","last_clean":"2024-09-15T12:19:40.579114+0000","last_became_active":"2024-09-15T12:18:53.128765+0000","last_became_peered":"2024-09-15T12:18:53.128765+0000","last_unstale":"2024-09-15T12:19:40.579114+0000","last_undegraded":"2024-09-15T12:19:40.579114+0000","last_fullsized":"2024-09-15T12:19:40.579114+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":33856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"18'540","reported_seq":552,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.658996+0000","last_change":"2024-09-15T12:18:53.090984+0000","last_active":"2024-09-15T12:19:40.658996+0000","last_peered":"2024-09-15T12:19:40.658996+0000","last_clean":"2024-09-15T12:19:40.658996+0000","last_became_active":"2024-09-15T12:18:53.080676+0000","last_became_peered":"2024-09-15T12:18:53.080676+0000","last_unstale":"2024-09-15T12:19:40.658996+0000","last_undegraded":"2024-09-15T12:19:40.658996+0000","last_fullsized":"2024-09-15T12:19:40.658996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35389440,"num_objects":540,"num_object_clones":0,"num_object_copies":1620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":540,"num_write_kb":34560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":97,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:53.998335+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:18:53.998335+0000","last_peered":"2024-09-15T12:18:53.998335+0000","last_clean":"2024-09-15T12:18:53.998335+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:18:53.998335+0000","last_undegraded":"2024-09-15T12:18:53.998335+0000","last_fullsized":"2024-09-15T12:18:53.998335+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.003623+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:18:54.003623+0000","last_peered":"2024-09-15T12:18:54.003623+0000","last_clean":"2024-09-15T12:18:54.003623+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:18:54.003623+0000","last_undegraded":"2024-09-15T12:18:54.003623+0000","last_fullsized":"2024-09-15T12:18:54.003623+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"18'531","reported_seq":543,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.606218+0000","last_change":"2024-09-15T12:18:53.172532+0000","last_active":"2024-09-15T12:19:40.606218+0000","last_peered":"2024-09-15T12:19:40.606218+0000","last_clean":"2024-09-15T12:19:40.606218+0000","last_became_active":"2024-09-15T12:18:53.166197+0000","last_became_peered":"2024-09-15T12:18:53.166197+0000","last_unstale":"2024-09-15T12:19:40.606218+0000","last_undegraded":"2024-09-15T12:19:40.606218+0000","last_fullsized":"2024-09-15T12:19:40.606218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":531,"log_dups_size":0,"ondisk_log_size":531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34799616,"num_objects":531,"num_object_clones":0,"num_object_copies":1593,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":531,"num_write_kb":33984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.003840+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:18:54.003840+0000","last_peered":"2024-09-15T12:18:54.003840+0000","last_clean":"2024-09-15T12:18:54.003840+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:18:54.003840+0000","last_undegraded":"2024-09-15T12:18:54.003840+0000","last_fullsized":"2024-09-15T12:18:54.003840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"18'543","reported_seq":555,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:41.656955+0000","last_change":"2024-09-15T12:18:53.161283+0000","last_active":"2024-09-15T12:19:41.656955+0000","last_peered":"2024-09-15T12:19:41.656955+0000","last_clean":"2024-09-15T12:19:41.656955+0000","last_became_active":"2024-09-15T12:18:53.149710+0000","last_became_peered":"2024-09-15T12:18:53.149710+0000","last_unstale":"2024-09-15T12:19:41.656955+0000","last_undegraded":"2024-09-15T12:19:41.656955+0000","last_fullsized":"2024-09-15T12:19:41.656955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35586048,"num_objects":543,"num_object_clones":0,"num_object_copies":1629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":543,"num_write_kb":34752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:53.996018+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:18:53.996018+0000","last_peered":"2024-09-15T12:18:53.996018+0000","last_clean":"2024-09-15T12:18:53.996018+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:18:53.996018+0000","last_undegraded":"2024-09-15T12:18:53.996018+0000","last_fullsized":"2024-09-15T12:18:53.996018+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"18'553","reported_seq":565,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:41.677242+0000","last_change":"2024-09-15T12:18:53.169843+0000","last_active":"2024-09-15T12:19:41.677242+0000","last_peered":"2024-09-15T12:19:41.677242+0000","last_clean":"2024-09-15T12:19:41.677242+0000","last_became_active":"2024-09-15T12:18:53.161921+0000","last_became_peered":"2024-09-15T12:18:53.161921+0000","last_unstale":"2024-09-15T12:19:41.677242+0000","last_undegraded":"2024-09-15T12:19:41.677242+0000","last_fullsized":"2024-09-15T12:19:41.677242+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":27,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:53.995342+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:18:53.995342+0000","last_peered":"2024-09-15T12:18:53.995342+0000","last_clean":"2024-09-15T12:18:53.995342+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:18:53.995342+0000","last_undegraded":"2024-09-15T12:18:53.995342+0000","last_fullsized":"2024-09-15T12:18:53.995342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"18'566","reported_seq":578,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.557992+0000","last_change":"2024-09-15T12:18:53.100005+0000","last_active":"2024-09-15T12:19:40.557992+0000","last_peered":"2024-09-15T12:19:40.557992+0000","last_clean":"2024-09-15T12:19:40.557992+0000","last_became_active":"2024-09-15T12:18:53.080705+0000","last_became_peered":"2024-09-15T12:18:53.080705+0000","last_unstale":"2024-09-15T12:19:40.557992+0000","last_undegraded":"2024-09-15T12:19:40.557992+0000","last_fullsized":"2024-09-15T12:19:40.557992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37093376,"num_objects":566,"num_object_clones":0,"num_object_copies":1698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":566,"num_write_kb":36224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"18'536","reported_seq":548,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.579487+0000","last_change":"2024-09-15T12:18:53.122880+0000","last_active":"2024-09-15T12:19:40.579487+0000","last_peered":"2024-09-15T12:19:40.579487+0000","last_clean":"2024-09-15T12:19:40.579487+0000","last_became_active":"2024-09-15T12:18:53.111647+0000","last_became_peered":"2024-09-15T12:18:53.111647+0000","last_unstale":"2024-09-15T12:19:40.579487+0000","last_undegraded":"2024-09-15T12:19:40.579487+0000","last_fullsized":"2024-09-15T12:19:40.579487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35127296,"num_objects":536,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.005037+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:18:54.005037+0000","last_peered":"2024-09-15T12:18:54.005037+0000","last_clean":"2024-09-15T12:18:54.005037+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:18:54.005037+0000","last_undegraded":"2024-09-15T12:18:54.005037+0000","last_fullsized":"2024-09-15T12:18:54.005037+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"18'550","reported_seq":562,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.614011+0000","last_change":"2024-09-15T12:18:53.133542+0000","last_active":"2024-09-15T12:19:40.614011+0000","last_peered":"2024-09-15T12:19:40.614011+0000","last_clean":"2024-09-15T12:19:40.614011+0000","last_became_active":"2024-09-15T12:18:53.125716+0000","last_became_peered":"2024-09-15T12:18:53.125716+0000","last_unstale":"2024-09-15T12:19:40.614011+0000","last_undegraded":"2024-09-15T12:19:40.614011+0000","last_fullsized":"2024-09-15T12:19:40.614011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36044800,"num_objects":550,"num_object_clones":0,"num_object_copies":1650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":550,"num_write_kb":35200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.002907+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:18:54.002907+0000","last_peered":"2024-09-15T12:18:54.002907+0000","last_clean":"2024-09-15T12:18:54.002907+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:18:54.002907+0000","last_undegraded":"2024-09-15T12:18:54.002907+0000","last_fullsized":"2024-09-15T12:18:54.002907+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"18'536","reported_seq":548,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:41.514400+0000","last_change":"2024-09-15T12:18:53.133963+0000","last_active":"2024-09-15T12:19:41.514400+0000","last_peered":"2024-09-15T12:19:41.514400+0000","last_clean":"2024-09-15T12:19:41.514400+0000","last_became_active":"2024-09-15T12:18:53.122383+0000","last_became_peered":"2024-09-15T12:18:53.122383+0000","last_unstale":"2024-09-15T12:19:41.514400+0000","last_undegraded":"2024-09-15T12:19:41.514400+0000","last_fullsized":"2024-09-15T12:19:41.514400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35127296,"num_objects":536,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.001912+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:18:54.001912+0000","last_peered":"2024-09-15T12:18:54.001912+0000","last_clean":"2024-09-15T12:18:54.001912+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:18:54.001912+0000","last_undegraded":"2024-09-15T12:18:54.001912+0000","last_fullsized":"2024-09-15T12:18:54.001912+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"18'557","reported_seq":569,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.703949+0000","last_change":"2024-09-15T12:18:53.102960+0000","last_active":"2024-09-15T12:19:40.703949+0000","last_peered":"2024-09-15T12:19:40.703949+0000","last_clean":"2024-09-15T12:19:40.703949+0000","last_became_active":"2024-09-15T12:18:53.088807+0000","last_became_peered":"2024-09-15T12:18:53.088807+0000","last_unstale":"2024-09-15T12:19:40.703949+0000","last_undegraded":"2024-09-15T12:19:40.703949+0000","last_fullsized":"2024-09-15T12:19:40.703949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36503552,"num_objects":557,"num_object_clones":0,"num_object_copies":1671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":557,"num_write_kb":35648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.002303+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:18:54.002303+0000","last_peered":"2024-09-15T12:18:54.002303+0000","last_clean":"2024-09-15T12:18:54.002303+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:18:54.002303+0000","last_undegraded":"2024-09-15T12:18:54.002303+0000","last_fullsized":"2024-09-15T12:18:54.002303+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":559677440,"num_objects":8540,"num_object_clones":0,"num_object_copies":25620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8540,"num_write_kb":546560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":105025536,"data_stored":1680408576,"data_compressed":79791462,"data_compressed_allocated":105025536,"data_compressed_original":1680408576,"omap_allocated":0,"internal_metadata":0},"log_size":8540,"ondisk_log_size":8540,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673019,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69384,"kb_used_data":30072,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94302456,"statfs":{"total":96636764160,"available":96565714944,"internally_reserved":0,"allocated":30793728,"data_stored":489927087,"data_compressed":23263232,"data_compressed_allocated":30621696,"data_compressed_original":489865216,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54156,"kb_used_data":23164,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94317684,"statfs":{"total":96636764160,"available":96581308416,"internally_reserved":0,"allocated":23719936,"data_stored":376680898,"data_compressed":17885933,"data_compressed_allocated":23543808,"data_compressed_original":376619008,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60200,"kb_used_data":25048,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94311640,"statfs":{"total":96636764160,"available":96575119360,"internally_reserved":0,"allocated":25649152,"data_stored":407941026,"data_compressed":19368266,"data_compressed_allocated":25493504,"data_compressed_original":407896064,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54136,"kb_used_data":23144,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94317704,"statfs":{"total":96636764160,"available":96581328896,"internally_reserved":0,"allocated":23699456,"data_stored":376353218,"data_compressed":17870367,"data_compressed_allocated":23523328,"data_compressed_original":376291328,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23932928,"data_stored":382926848,"data_compressed":18182655,"data_compressed_allocated":23932928,"data_compressed_original":382926848,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25985024,"data_stored":415760384,"data_compressed":19741706,"data_compressed_allocated":25985024,"data_compressed_original":415760384,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23986176,"data_stored":383778816,"data_compressed":18223117,"data_compressed_allocated":23986176,"data_compressed_original":383778816,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":31121408,"data_stored":497942528,"data_compressed":23643984,"data_compressed_allocated":31121408,"data_compressed_original":497942528,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:20:04.468 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-15T12:20:04.468 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:20:04.469 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:20:04.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:04.589+0000 7f537db51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:04.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:04.599+0000 7f537db51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:04.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:04.654+0000 7f57a90c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:04.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:04.670+0000 7f57a90c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:05.054 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:20:05.055 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:20:05.068 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 71 16 12597 12581 11.0739 9.125 0.0920199 0.090181 2024-09-15T12:20:05.069 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-09-15T12:20:03.717571+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":560267827,"num_objects":8544,"num_object_clones":0,"num_object_copies":25632,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8621,"num_write_kb":547668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8595,"ondisk_log_size":8595,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":237876,"kb_used_data":101428,"kb_used_omap":0,"kb_used_meta":136384,"kb_avail":377249484,"statfs":{"total":386547056640,"available":386303471616,"internally_reserved":0,"allocated":103862272,"data_stored":1650902229,"data_compressed":78387798,"data_compressed_allocated":103182336,"data_compressed_original":1650671616,"omap_allocated":0,"internal_metadata":139657216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000873"},"pg_stats":[{"pgid":"3.f","version":"18'502","reported_seq":514,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.613754+0000","last_change":"2024-09-15T12:18:53.083350+0000","last_active":"2024-09-15T12:19:40.613754+0000","last_peered":"2024-09-15T12:19:40.613754+0000","last_clean":"2024-09-15T12:19:40.613754+0000","last_became_active":"2024-09-15T12:18:53.075051+0000","last_became_peered":"2024-09-15T12:18:53.075051+0000","last_unstale":"2024-09-15T12:19:40.613754+0000","last_undegraded":"2024-09-15T12:19:40.613754+0000","last_fullsized":"2024-09-15T12:19:40.613754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32899072,"num_objects":502,"num_object_clones":0,"num_object_copies":1506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":502,"num_write_kb":32128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'479","reported_seq":491,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.412103+0000","last_change":"2024-09-15T12:18:53.139711+0000","last_active":"2024-09-15T12:19:40.412103+0000","last_peered":"2024-09-15T12:19:40.412103+0000","last_clean":"2024-09-15T12:19:40.412103+0000","last_became_active":"2024-09-15T12:18:53.130124+0000","last_became_peered":"2024-09-15T12:18:53.130124+0000","last_unstale":"2024-09-15T12:19:40.412103+0000","last_undegraded":"2024-09-15T12:19:40.412103+0000","last_fullsized":"2024-09-15T12:19:40.412103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31391744,"num_objects":479,"num_object_clones":0,"num_object_copies":1437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":479,"num_write_kb":30656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'550","reported_seq":562,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.489250+0000","last_change":"2024-09-15T12:18:53.140327+0000","last_active":"2024-09-15T12:19:40.489250+0000","last_peered":"2024-09-15T12:19:40.489250+0000","last_clean":"2024-09-15T12:19:40.489250+0000","last_became_active":"2024-09-15T12:18:53.128935+0000","last_became_peered":"2024-09-15T12:18:53.128935+0000","last_unstale":"2024-09-15T12:19:40.489250+0000","last_undegraded":"2024-09-15T12:19:40.489250+0000","last_fullsized":"2024-09-15T12:19:40.489250+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36044800,"num_objects":550,"num_object_clones":0,"num_object_copies":1650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":550,"num_write_kb":35200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"18'535","reported_seq":547,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.466060+0000","last_change":"2024-09-15T12:18:53.138678+0000","last_active":"2024-09-15T12:19:40.466060+0000","last_peered":"2024-09-15T12:19:40.466060+0000","last_clean":"2024-09-15T12:19:40.466060+0000","last_became_active":"2024-09-15T12:18:53.129492+0000","last_became_peered":"2024-09-15T12:18:53.129492+0000","last_unstale":"2024-09-15T12:19:40.466060+0000","last_undegraded":"2024-09-15T12:19:40.466060+0000","last_fullsized":"2024-09-15T12:19:40.466060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35061760,"num_objects":535,"num_object_clones":0,"num_object_copies":1605,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":535,"num_write_kb":34240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'516","reported_seq":528,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:41.633134+0000","last_change":"2024-09-15T12:18:53.109204+0000","last_active":"2024-09-15T12:19:41.633134+0000","last_peered":"2024-09-15T12:19:41.633134+0000","last_clean":"2024-09-15T12:19:41.633134+0000","last_became_active":"2024-09-15T12:18:53.087134+0000","last_became_peered":"2024-09-15T12:18:53.087134+0000","last_unstale":"2024-09-15T12:19:41.633134+0000","last_undegraded":"2024-09-15T12:19:41.633134+0000","last_fullsized":"2024-09-15T12:19:41.633134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":516,"log_dups_size":0,"ondisk_log_size":516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33816576,"num_objects":516,"num_object_clones":0,"num_object_copies":1548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":516,"num_write_kb":33024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"18'517","reported_seq":529,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.718310+0000","last_change":"2024-09-15T12:18:53.119675+0000","last_active":"2024-09-15T12:19:40.718310+0000","last_peered":"2024-09-15T12:19:40.718310+0000","last_clean":"2024-09-15T12:19:40.718310+0000","last_became_active":"2024-09-15T12:18:53.112010+0000","last_became_peered":"2024-09-15T12:18:53.112010+0000","last_unstale":"2024-09-15T12:19:40.718310+0000","last_undegraded":"2024-09-15T12:19:40.718310+0000","last_fullsized":"2024-09-15T12:19:40.718310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33882112,"num_objects":517,"num_object_clones":0,"num_object_copies":1551,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":517,"num_write_kb":33088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"18'529","reported_seq":541,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.579114+0000","last_change":"2024-09-15T12:18:53.136381+0000","last_active":"2024-09-15T12:19:40.579114+0000","last_peered":"2024-09-15T12:19:40.579114+0000","last_clean":"2024-09-15T12:19:40.579114+0000","last_became_active":"2024-09-15T12:18:53.128765+0000","last_became_peered":"2024-09-15T12:18:53.128765+0000","last_unstale":"2024-09-15T12:19:40.579114+0000","last_undegraded":"2024-09-15T12:19:40.579114+0000","last_fullsized":"2024-09-15T12:19:40.579114+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":33856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"18'540","reported_seq":552,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.658996+0000","last_change":"2024-09-15T12:18:53.090984+0000","last_active":"2024-09-15T12:19:40.658996+0000","last_peered":"2024-09-15T12:19:40.658996+0000","last_clean":"2024-09-15T12:19:40.658996+0000","last_became_active":"2024-09-15T12:18:53.080676+0000","last_became_peered":"2024-09-15T12:18:53.080676+0000","last_unstale":"2024-09-15T12:19:40.658996+0000","last_undegraded":"2024-09-15T12:19:40.658996+0000","last_fullsized":"2024-09-15T12:19:40.658996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35389440,"num_objects":540,"num_object_clones":0,"num_object_copies":1620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":540,"num_write_kb":34560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":97,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:53.998335+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:18:53.998335+0000","last_peered":"2024-09-15T12:18:53.998335+0000","last_clean":"2024-09-15T12:18:53.998335+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:18:53.998335+0000","last_undegraded":"2024-09-15T12:18:53.998335+0000","last_fullsized":"2024-09-15T12:18:53.998335+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.003623+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:18:54.003623+0000","last_peered":"2024-09-15T12:18:54.003623+0000","last_clean":"2024-09-15T12:18:54.003623+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:18:54.003623+0000","last_undegraded":"2024-09-15T12:18:54.003623+0000","last_fullsized":"2024-09-15T12:18:54.003623+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"18'531","reported_seq":543,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.606218+0000","last_change":"2024-09-15T12:18:53.172532+0000","last_active":"2024-09-15T12:19:40.606218+0000","last_peered":"2024-09-15T12:19:40.606218+0000","last_clean":"2024-09-15T12:19:40.606218+0000","last_became_active":"2024-09-15T12:18:53.166197+0000","last_became_peered":"2024-09-15T12:18:53.166197+0000","last_unstale":"2024-09-15T12:19:40.606218+0000","last_undegraded":"2024-09-15T12:19:40.606218+0000","last_fullsized":"2024-09-15T12:19:40.606218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":531,"log_dups_size":0,"ondisk_log_size":531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34799616,"num_objects":531,"num_object_clones":0,"num_object_copies":1593,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":531,"num_write_kb":33984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.003840+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:18:54.003840+0000","last_peered":"2024-09-15T12:18:54.003840+0000","last_clean":"2024-09-15T12:18:54.003840+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:18:54.003840+0000","last_undegraded":"2024-09-15T12:18:54.003840+0000","last_fullsized":"2024-09-15T12:18:54.003840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"18'543","reported_seq":555,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:41.656955+0000","last_change":"2024-09-15T12:18:53.161283+0000","last_active":"2024-09-15T12:19:41.656955+0000","last_peered":"2024-09-15T12:19:41.656955+0000","last_clean":"2024-09-15T12:19:41.656955+0000","last_became_active":"2024-09-15T12:18:53.149710+0000","last_became_peered":"2024-09-15T12:18:53.149710+0000","last_unstale":"2024-09-15T12:19:41.656955+0000","last_undegraded":"2024-09-15T12:19:41.656955+0000","last_fullsized":"2024-09-15T12:19:41.656955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35586048,"num_objects":543,"num_object_clones":0,"num_object_copies":1629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":543,"num_write_kb":34752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:53.996018+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:18:53.996018+0000","last_peered":"2024-09-15T12:18:53.996018+0000","last_clean":"2024-09-15T12:18:53.996018+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:18:53.996018+0000","last_undegraded":"2024-09-15T12:18:53.996018+0000","last_fullsized":"2024-09-15T12:18:53.996018+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"18'553","reported_seq":565,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:41.677242+0000","last_change":"2024-09-15T12:18:53.169843+0000","last_active":"2024-09-15T12:19:41.677242+0000","last_peered":"2024-09-15T12:19:41.677242+0000","last_clean":"2024-09-15T12:19:41.677242+0000","last_became_active":"2024-09-15T12:18:53.161921+0000","last_became_peered":"2024-09-15T12:18:53.161921+0000","last_unstale":"2024-09-15T12:19:41.677242+0000","last_undegraded":"2024-09-15T12:19:41.677242+0000","last_fullsized":"2024-09-15T12:19:41.677242+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":27,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:53.995342+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:18:53.995342+0000","last_peered":"2024-09-15T12:18:53.995342+0000","last_clean":"2024-09-15T12:18:53.995342+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:18:53.995342+0000","last_undegraded":"2024-09-15T12:18:53.995342+0000","last_fullsized":"2024-09-15T12:18:53.995342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"18'566","reported_seq":578,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.557992+0000","last_change":"2024-09-15T12:18:53.100005+0000","last_active":"2024-09-15T12:19:40.557992+0000","last_peered":"2024-09-15T12:19:40.557992+0000","last_clean":"2024-09-15T12:19:40.557992+0000","last_became_active":"2024-09-15T12:18:53.080705+0000","last_became_peered":"2024-09-15T12:18:53.080705+0000","last_unstale":"2024-09-15T12:19:40.557992+0000","last_undegraded":"2024-09-15T12:19:40.557992+0000","last_fullsized":"2024-09-15T12:19:40.557992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37093376,"num_objects":566,"num_object_clones":0,"num_object_copies":1698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":566,"num_write_kb":36224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"18'536","reported_seq":548,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.579487+0000","last_change":"2024-09-15T12:18:53.122880+0000","last_active":"2024-09-15T12:19:40.579487+0000","last_peered":"2024-09-15T12:19:40.579487+0000","last_clean":"2024-09-15T12:19:40.579487+0000","last_became_active":"2024-09-15T12:18:53.111647+0000","last_became_peered":"2024-09-15T12:18:53.111647+0000","last_unstale":"2024-09-15T12:19:40.579487+0000","last_undegraded":"2024-09-15T12:19:40.579487+0000","last_fullsized":"2024-09-15T12:19:40.579487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35127296,"num_objects":536,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.005037+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:18:54.005037+0000","last_peered":"2024-09-15T12:18:54.005037+0000","last_clean":"2024-09-15T12:18:54.005037+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:18:54.005037+0000","last_undegraded":"2024-09-15T12:18:54.005037+0000","last_fullsized":"2024-09-15T12:18:54.005037+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"18'550","reported_seq":562,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.614011+0000","last_change":"2024-09-15T12:18:53.133542+0000","last_active":"2024-09-15T12:19:40.614011+0000","last_peered":"2024-09-15T12:19:40.614011+0000","last_clean":"2024-09-15T12:19:40.614011+0000","last_became_active":"2024-09-15T12:18:53.125716+0000","last_became_peered":"2024-09-15T12:18:53.125716+0000","last_unstale":"2024-09-15T12:19:40.614011+0000","last_undegraded":"2024-09-15T12:19:40.614011+0000","last_fullsized":"2024-09-15T12:19:40.614011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36044800,"num_objects":550,"num_object_clones":0,"num_object_copies":1650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":550,"num_write_kb":35200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.002907+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:18:54.002907+0000","last_peered":"2024-09-15T12:18:54.002907+0000","last_clean":"2024-09-15T12:18:54.002907+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:18:54.002907+0000","last_undegraded":"2024-09-15T12:18:54.002907+0000","last_fullsized":"2024-09-15T12:18:54.002907+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"18'536","reported_seq":548,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:41.514400+0000","last_change":"2024-09-15T12:18:53.133963+0000","last_active":"2024-09-15T12:19:41.514400+0000","last_peered":"2024-09-15T12:19:41.514400+0000","last_clean":"2024-09-15T12:19:41.514400+0000","last_became_active":"2024-09-15T12:18:53.122383+0000","last_became_peered":"2024-09-15T12:18:53.122383+0000","last_unstale":"2024-09-15T12:19:41.514400+0000","last_undegraded":"2024-09-15T12:19:41.514400+0000","last_fullsized":"2024-09-15T12:19:41.514400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35127296,"num_objects":536,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.001912+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:18:54.001912+0000","last_peered":"2024-09-15T12:18:54.001912+0000","last_clean":"2024-09-15T12:18:54.001912+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:18:54.001912+0000","last_undegraded":"2024-09-15T12:18:54.001912+0000","last_fullsized":"2024-09-15T12:18:54.001912+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"18'557","reported_seq":569,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.703949+0000","last_change":"2024-09-15T12:18:53.102960+0000","last_active":"2024-09-15T12:19:40.703949+0000","last_peered":"2024-09-15T12:19:40.703949+0000","last_clean":"2024-09-15T12:19:40.703949+0000","last_became_active":"2024-09-15T12:18:53.088807+0000","last_became_peered":"2024-09-15T12:18:53.088807+0000","last_unstale":"2024-09-15T12:19:40.703949+0000","last_undegraded":"2024-09-15T12:19:40.703949+0000","last_fullsized":"2024-09-15T12:19:40.703949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36503552,"num_objects":557,"num_object_clones":0,"num_object_copies":1671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":557,"num_write_kb":35648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.002303+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:18:54.002303+0000","last_peered":"2024-09-15T12:18:54.002303+0000","last_clean":"2024-09-15T12:18:54.002303+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:18:54.002303+0000","last_undegraded":"2024-09-15T12:18:54.002303+0000","last_fullsized":"2024-09-15T12:18:54.002303+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":559677440,"num_objects":8540,"num_object_clones":0,"num_object_copies":25620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8540,"num_write_kb":546560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":105025536,"data_stored":1680408576,"data_compressed":79791462,"data_compressed_allocated":105025536,"data_compressed_original":1680408576,"omap_allocated":0,"internal_metadata":0},"log_size":8540,"ondisk_log_size":8540,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673019,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69384,"kb_used_data":30072,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94302456,"statfs":{"total":96636764160,"available":96565714944,"internally_reserved":0,"allocated":30793728,"data_stored":489927087,"data_compressed":23263232,"data_compressed_allocated":30621696,"data_compressed_original":489865216,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54156,"kb_used_data":23164,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94317684,"statfs":{"total":96636764160,"available":96581308416,"internally_reserved":0,"allocated":23719936,"data_stored":376680898,"data_compressed":17885933,"data_compressed_allocated":23543808,"data_compressed_original":376619008,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60200,"kb_used_data":25048,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94311640,"statfs":{"total":96636764160,"available":96575119360,"internally_reserved":0,"allocated":25649152,"data_stored":407941026,"data_compressed":19368266,"data_compressed_allocated":25493504,"data_compressed_original":407896064,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54136,"kb_used_data":23144,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94317704,"statfs":{"total":96636764160,"available":96581328896,"internally_reserved":0,"allocated":23699456,"data_stored":376353218,"data_compressed":17870367,"data_compressed_allocated":23523328,"data_compressed_original":376291328,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23932928,"data_stored":382926848,"data_compressed":18182655,"data_compressed_allocated":23932928,"data_compressed_original":382926848,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25985024,"data_stored":415760384,"data_compressed":19741706,"data_compressed_allocated":25985024,"data_compressed_original":415760384,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23986176,"data_stored":383778816,"data_compressed":18223117,"data_compressed_allocated":23986176,"data_compressed_original":383778816,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":31121408,"data_stored":497942528,"data_compressed":23643984,"data_compressed_allocated":31121408,"data_compressed_original":497942528,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:20:06.069 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 72 16 12741 12725 11.045 9 0.12808 0.0904848 2024-09-15T12:20:07.046 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:20:07.069 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 73 16 12908 12892 11.0367 10.4375 0.113561 0.090525 2024-09-15T12:20:07.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:07.182+0000 7f51c3097640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:07.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:07.189+0000 7f51c3097640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:08.069 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 74 16 13081 13065 11.0337 10.8125 0.0543906 0.0905659 2024-09-15T12:20:09.069 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 75 16 13254 13238 11.0307 10.8125 0.122445 0.0905818 2024-09-15T12:20:09.742 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:20:09.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:09.875+0000 7f25aa111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:09.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:09.884+0000 7f25aa111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:10.069 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 76 16 13414 13398 11.0171 10 0.0412102 0.0907259 2024-09-15T12:20:10.071 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:20:10.072 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:20:10.072 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:20:10.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:10.206+0000 7f290bd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:10.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:10.216+0000 7f290bd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:10.492 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:20:10.492 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:20:10.510 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-09-15T12:20:09.718982+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":560267827,"num_objects":8544,"num_object_clones":0,"num_object_copies":25632,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8621,"num_write_kb":547668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8595,"ondisk_log_size":8595,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":237876,"kb_used_data":101428,"kb_used_omap":0,"kb_used_meta":136384,"kb_avail":377249484,"statfs":{"total":386547056640,"available":386303471616,"internally_reserved":0,"allocated":103862272,"data_stored":1650902229,"data_compressed":78387798,"data_compressed_allocated":103182336,"data_compressed_original":1650671616,"omap_allocated":0,"internal_metadata":139657216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001847"},"pg_stats":[{"pgid":"3.f","version":"18'502","reported_seq":514,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.613754+0000","last_change":"2024-09-15T12:18:53.083350+0000","last_active":"2024-09-15T12:19:40.613754+0000","last_peered":"2024-09-15T12:19:40.613754+0000","last_clean":"2024-09-15T12:19:40.613754+0000","last_became_active":"2024-09-15T12:18:53.075051+0000","last_became_peered":"2024-09-15T12:18:53.075051+0000","last_unstale":"2024-09-15T12:19:40.613754+0000","last_undegraded":"2024-09-15T12:19:40.613754+0000","last_fullsized":"2024-09-15T12:19:40.613754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32899072,"num_objects":502,"num_object_clones":0,"num_object_copies":1506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":502,"num_write_kb":32128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'479","reported_seq":491,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.412103+0000","last_change":"2024-09-15T12:18:53.139711+0000","last_active":"2024-09-15T12:19:40.412103+0000","last_peered":"2024-09-15T12:19:40.412103+0000","last_clean":"2024-09-15T12:19:40.412103+0000","last_became_active":"2024-09-15T12:18:53.130124+0000","last_became_peered":"2024-09-15T12:18:53.130124+0000","last_unstale":"2024-09-15T12:19:40.412103+0000","last_undegraded":"2024-09-15T12:19:40.412103+0000","last_fullsized":"2024-09-15T12:19:40.412103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31391744,"num_objects":479,"num_object_clones":0,"num_object_copies":1437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":479,"num_write_kb":30656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"18'550","reported_seq":562,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.489250+0000","last_change":"2024-09-15T12:18:53.140327+0000","last_active":"2024-09-15T12:19:40.489250+0000","last_peered":"2024-09-15T12:19:40.489250+0000","last_clean":"2024-09-15T12:19:40.489250+0000","last_became_active":"2024-09-15T12:18:53.128935+0000","last_became_peered":"2024-09-15T12:18:53.128935+0000","last_unstale":"2024-09-15T12:19:40.489250+0000","last_undegraded":"2024-09-15T12:19:40.489250+0000","last_fullsized":"2024-09-15T12:19:40.489250+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36044800,"num_objects":550,"num_object_clones":0,"num_object_copies":1650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":550,"num_write_kb":35200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"18'535","reported_seq":547,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.466060+0000","last_change":"2024-09-15T12:18:53.138678+0000","last_active":"2024-09-15T12:19:40.466060+0000","last_peered":"2024-09-15T12:19:40.466060+0000","last_clean":"2024-09-15T12:19:40.466060+0000","last_became_active":"2024-09-15T12:18:53.129492+0000","last_became_peered":"2024-09-15T12:18:53.129492+0000","last_unstale":"2024-09-15T12:19:40.466060+0000","last_undegraded":"2024-09-15T12:19:40.466060+0000","last_fullsized":"2024-09-15T12:19:40.466060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35061760,"num_objects":535,"num_object_clones":0,"num_object_copies":1605,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":535,"num_write_kb":34240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'516","reported_seq":528,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:41.633134+0000","last_change":"2024-09-15T12:18:53.109204+0000","last_active":"2024-09-15T12:19:41.633134+0000","last_peered":"2024-09-15T12:19:41.633134+0000","last_clean":"2024-09-15T12:19:41.633134+0000","last_became_active":"2024-09-15T12:18:53.087134+0000","last_became_peered":"2024-09-15T12:18:53.087134+0000","last_unstale":"2024-09-15T12:19:41.633134+0000","last_undegraded":"2024-09-15T12:19:41.633134+0000","last_fullsized":"2024-09-15T12:19:41.633134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":516,"log_dups_size":0,"ondisk_log_size":516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33816576,"num_objects":516,"num_object_clones":0,"num_object_copies":1548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":516,"num_write_kb":33024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"18'517","reported_seq":529,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.718310+0000","last_change":"2024-09-15T12:18:53.119675+0000","last_active":"2024-09-15T12:19:40.718310+0000","last_peered":"2024-09-15T12:19:40.718310+0000","last_clean":"2024-09-15T12:19:40.718310+0000","last_became_active":"2024-09-15T12:18:53.112010+0000","last_became_peered":"2024-09-15T12:18:53.112010+0000","last_unstale":"2024-09-15T12:19:40.718310+0000","last_undegraded":"2024-09-15T12:19:40.718310+0000","last_fullsized":"2024-09-15T12:19:40.718310+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33882112,"num_objects":517,"num_object_clones":0,"num_object_copies":1551,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":517,"num_write_kb":33088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"18'529","reported_seq":541,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.579114+0000","last_change":"2024-09-15T12:18:53.136381+0000","last_active":"2024-09-15T12:19:40.579114+0000","last_peered":"2024-09-15T12:19:40.579114+0000","last_clean":"2024-09-15T12:19:40.579114+0000","last_became_active":"2024-09-15T12:18:53.128765+0000","last_became_peered":"2024-09-15T12:18:53.128765+0000","last_unstale":"2024-09-15T12:19:40.579114+0000","last_undegraded":"2024-09-15T12:19:40.579114+0000","last_fullsized":"2024-09-15T12:19:40.579114+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":33856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"18'540","reported_seq":552,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.658996+0000","last_change":"2024-09-15T12:18:53.090984+0000","last_active":"2024-09-15T12:19:40.658996+0000","last_peered":"2024-09-15T12:19:40.658996+0000","last_clean":"2024-09-15T12:19:40.658996+0000","last_became_active":"2024-09-15T12:18:53.080676+0000","last_became_peered":"2024-09-15T12:18:53.080676+0000","last_unstale":"2024-09-15T12:19:40.658996+0000","last_undegraded":"2024-09-15T12:19:40.658996+0000","last_fullsized":"2024-09-15T12:19:40.658996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35389440,"num_objects":540,"num_object_clones":0,"num_object_copies":1620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":540,"num_write_kb":34560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":97,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:53.998335+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:18:53.998335+0000","last_peered":"2024-09-15T12:18:53.998335+0000","last_clean":"2024-09-15T12:18:53.998335+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:18:53.998335+0000","last_undegraded":"2024-09-15T12:18:53.998335+0000","last_fullsized":"2024-09-15T12:18:53.998335+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":26,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.003623+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:18:54.003623+0000","last_peered":"2024-09-15T12:18:54.003623+0000","last_clean":"2024-09-15T12:18:54.003623+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:18:54.003623+0000","last_undegraded":"2024-09-15T12:18:54.003623+0000","last_fullsized":"2024-09-15T12:18:54.003623+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"18'531","reported_seq":543,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.606218+0000","last_change":"2024-09-15T12:18:53.172532+0000","last_active":"2024-09-15T12:19:40.606218+0000","last_peered":"2024-09-15T12:19:40.606218+0000","last_clean":"2024-09-15T12:19:40.606218+0000","last_became_active":"2024-09-15T12:18:53.166197+0000","last_became_peered":"2024-09-15T12:18:53.166197+0000","last_unstale":"2024-09-15T12:19:40.606218+0000","last_undegraded":"2024-09-15T12:19:40.606218+0000","last_fullsized":"2024-09-15T12:19:40.606218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":531,"log_dups_size":0,"ondisk_log_size":531,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34799616,"num_objects":531,"num_object_clones":0,"num_object_copies":1593,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":531,"num_write_kb":33984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.003840+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:18:54.003840+0000","last_peered":"2024-09-15T12:18:54.003840+0000","last_clean":"2024-09-15T12:18:54.003840+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:18:54.003840+0000","last_undegraded":"2024-09-15T12:18:54.003840+0000","last_fullsized":"2024-09-15T12:18:54.003840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"18'543","reported_seq":555,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:41.656955+0000","last_change":"2024-09-15T12:18:53.161283+0000","last_active":"2024-09-15T12:19:41.656955+0000","last_peered":"2024-09-15T12:19:41.656955+0000","last_clean":"2024-09-15T12:19:41.656955+0000","last_became_active":"2024-09-15T12:18:53.149710+0000","last_became_peered":"2024-09-15T12:18:53.149710+0000","last_unstale":"2024-09-15T12:19:41.656955+0000","last_undegraded":"2024-09-15T12:19:41.656955+0000","last_fullsized":"2024-09-15T12:19:41.656955+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35586048,"num_objects":543,"num_object_clones":0,"num_object_copies":1629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":543,"num_write_kb":34752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:53.996018+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:18:53.996018+0000","last_peered":"2024-09-15T12:18:53.996018+0000","last_clean":"2024-09-15T12:18:53.996018+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:18:53.996018+0000","last_undegraded":"2024-09-15T12:18:53.996018+0000","last_fullsized":"2024-09-15T12:18:53.996018+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"18'553","reported_seq":565,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:41.677242+0000","last_change":"2024-09-15T12:18:53.169843+0000","last_active":"2024-09-15T12:19:41.677242+0000","last_peered":"2024-09-15T12:19:41.677242+0000","last_clean":"2024-09-15T12:19:41.677242+0000","last_became_active":"2024-09-15T12:18:53.161921+0000","last_became_peered":"2024-09-15T12:18:53.161921+0000","last_unstale":"2024-09-15T12:19:41.677242+0000","last_undegraded":"2024-09-15T12:19:41.677242+0000","last_fullsized":"2024-09-15T12:19:41.677242+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":27,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:53.995342+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:18:53.995342+0000","last_peered":"2024-09-15T12:18:53.995342+0000","last_clean":"2024-09-15T12:18:53.995342+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:18:53.995342+0000","last_undegraded":"2024-09-15T12:18:53.995342+0000","last_fullsized":"2024-09-15T12:18:53.995342+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"18'566","reported_seq":578,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.557992+0000","last_change":"2024-09-15T12:18:53.100005+0000","last_active":"2024-09-15T12:19:40.557992+0000","last_peered":"2024-09-15T12:19:40.557992+0000","last_clean":"2024-09-15T12:19:40.557992+0000","last_became_active":"2024-09-15T12:18:53.080705+0000","last_became_peered":"2024-09-15T12:18:53.080705+0000","last_unstale":"2024-09-15T12:19:40.557992+0000","last_undegraded":"2024-09-15T12:19:40.557992+0000","last_fullsized":"2024-09-15T12:19:40.557992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37093376,"num_objects":566,"num_object_clones":0,"num_object_copies":1698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":566,"num_write_kb":36224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"18'536","reported_seq":548,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.579487+0000","last_change":"2024-09-15T12:18:53.122880+0000","last_active":"2024-09-15T12:19:40.579487+0000","last_peered":"2024-09-15T12:19:40.579487+0000","last_clean":"2024-09-15T12:19:40.579487+0000","last_became_active":"2024-09-15T12:18:53.111647+0000","last_became_peered":"2024-09-15T12:18:53.111647+0000","last_unstale":"2024-09-15T12:19:40.579487+0000","last_undegraded":"2024-09-15T12:19:40.579487+0000","last_fullsized":"2024-09-15T12:19:40.579487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35127296,"num_objects":536,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.005037+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:18:54.005037+0000","last_peered":"2024-09-15T12:18:54.005037+0000","last_clean":"2024-09-15T12:18:54.005037+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:18:54.005037+0000","last_undegraded":"2024-09-15T12:18:54.005037+0000","last_fullsized":"2024-09-15T12:18:54.005037+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"18'550","reported_seq":562,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.614011+0000","last_change":"2024-09-15T12:18:53.133542+0000","last_active":"2024-09-15T12:19:40.614011+0000","last_peered":"2024-09-15T12:19:40.614011+0000","last_clean":"2024-09-15T12:19:40.614011+0000","last_became_active":"2024-09-15T12:18:53.125716+0000","last_became_peered":"2024-09-15T12:18:53.125716+0000","last_unstale":"2024-09-15T12:19:40.614011+0000","last_undegraded":"2024-09-15T12:19:40.614011+0000","last_fullsized":"2024-09-15T12:19:40.614011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36044800,"num_objects":550,"num_object_clones":0,"num_object_copies":1650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":550,"num_write_kb":35200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.002907+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:18:54.002907+0000","last_peered":"2024-09-15T12:18:54.002907+0000","last_clean":"2024-09-15T12:18:54.002907+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:18:54.002907+0000","last_undegraded":"2024-09-15T12:18:54.002907+0000","last_fullsized":"2024-09-15T12:18:54.002907+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"18'536","reported_seq":548,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:41.514400+0000","last_change":"2024-09-15T12:18:53.133963+0000","last_active":"2024-09-15T12:19:41.514400+0000","last_peered":"2024-09-15T12:19:41.514400+0000","last_clean":"2024-09-15T12:19:41.514400+0000","last_became_active":"2024-09-15T12:18:53.122383+0000","last_became_peered":"2024-09-15T12:18:53.122383+0000","last_unstale":"2024-09-15T12:19:41.514400+0000","last_undegraded":"2024-09-15T12:19:41.514400+0000","last_fullsized":"2024-09-15T12:19:41.514400+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":536,"log_dups_size":0,"ondisk_log_size":536,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35127296,"num_objects":536,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.001912+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:18:54.001912+0000","last_peered":"2024-09-15T12:18:54.001912+0000","last_clean":"2024-09-15T12:18:54.001912+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:18:54.001912+0000","last_undegraded":"2024-09-15T12:18:54.001912+0000","last_fullsized":"2024-09-15T12:18:54.001912+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"18'557","reported_seq":569,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:19:40.703949+0000","last_change":"2024-09-15T12:18:53.102960+0000","last_active":"2024-09-15T12:19:40.703949+0000","last_peered":"2024-09-15T12:19:40.703949+0000","last_clean":"2024-09-15T12:19:40.703949+0000","last_became_active":"2024-09-15T12:18:53.088807+0000","last_became_peered":"2024-09-15T12:18:53.088807+0000","last_unstale":"2024-09-15T12:19:40.703949+0000","last_undegraded":"2024-09-15T12:19:40.703949+0000","last_fullsized":"2024-09-15T12:19:40.703949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36503552,"num_objects":557,"num_object_clones":0,"num_object_copies":1671,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":557,"num_write_kb":35648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-15T12:18:54.002303+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:18:54.002303+0000","last_peered":"2024-09-15T12:18:54.002303+0000","last_clean":"2024-09-15T12:18:54.002303+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:18:54.002303+0000","last_undegraded":"2024-09-15T12:18:54.002303+0000","last_fullsized":"2024-09-15T12:18:54.002303+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":559677440,"num_objects":8540,"num_object_clones":0,"num_object_copies":25620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8540,"num_write_kb":546560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":105025536,"data_stored":1680408576,"data_compressed":79791462,"data_compressed_allocated":105025536,"data_compressed_original":1680408576,"omap_allocated":0,"internal_metadata":0},"log_size":8540,"ondisk_log_size":8540,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673019,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69384,"kb_used_data":30072,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94302456,"statfs":{"total":96636764160,"available":96565714944,"internally_reserved":0,"allocated":30793728,"data_stored":489927087,"data_compressed":23263232,"data_compressed_allocated":30621696,"data_compressed_original":489865216,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54156,"kb_used_data":23164,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94317684,"statfs":{"total":96636764160,"available":96581308416,"internally_reserved":0,"allocated":23719936,"data_stored":376680898,"data_compressed":17885933,"data_compressed_allocated":23543808,"data_compressed_original":376619008,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":60200,"kb_used_data":25048,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94311640,"statfs":{"total":96636764160,"available":96575119360,"internally_reserved":0,"allocated":25649152,"data_stored":407941026,"data_compressed":19368266,"data_compressed_allocated":25493504,"data_compressed_original":407896064,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54136,"kb_used_data":23144,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94317704,"statfs":{"total":96636764160,"available":96581328896,"internally_reserved":0,"allocated":23699456,"data_stored":376353218,"data_compressed":17870367,"data_compressed_allocated":23523328,"data_compressed_original":376291328,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23932928,"data_stored":382926848,"data_compressed":18182655,"data_compressed_allocated":23932928,"data_compressed_original":382926848,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25985024,"data_stored":415760384,"data_compressed":19741706,"data_compressed_allocated":25985024,"data_compressed_original":415760384,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23986176,"data_stored":383778816,"data_compressed":18223117,"data_compressed_allocated":23986176,"data_compressed_original":383778816,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":31121408,"data_stored":497942528,"data_compressed":23643984,"data_compressed_allocated":31121408,"data_compressed_original":497942528,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:20:11.069 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 77 16 13580 13564 11.0088 10.375 0.0619466 0.090776 2024-09-15T12:20:12.069 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 78 16 13740 13724 10.9958 10 0.109924 0.0908874 2024-09-15T12:20:12.242 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:20:12.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:12.379+0000 7f4defb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:12.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:12.389+0000 7f4defb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:13.069 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 79 16 13911 13895 10.9919 10.6875 0.154213 0.0909244 2024-09-15T12:20:14.069 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:2024-09-15T12:20:14.069251+0000 min lat: 0.0153683 max lat: 0.305284 avg lat: 0.0910579 2024-09-15T12:20:14.070 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-15T12:20:14.070 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 80 16 14064 14048 10.9741 9.5625 0.174743 0.0910579 2024-09-15T12:20:14.707 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:20:14.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:14.855+0000 7fd912b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:14.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:14.862+0000 7fd912b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:15.069 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 81 16 14236 14220 10.9713 10.75 0.0708961 0.0910859 2024-09-15T12:20:15.512 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:20:15.513 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:20:15.513 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:20:15.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:15.658+0000 7fda1d751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:15.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:15.669+0000 7fda1d751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:16.009 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:20:16.009 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:20:16.027 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-09-15T12:20:15.720200+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":889520691,"num_objects":13568,"num_object_clones":0,"num_object_copies":40704,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":13645,"num_write_kb":869204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13619,"ondisk_log_size":13619,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":294376,"kb_used_data":162088,"kb_used_omap":0,"kb_used_meta":132224,"kb_avail":377192984,"statfs":{"total":386547056640,"available":386245615616,"internally_reserved":0,"allocated":165978112,"data_stored":2642710885,"data_compressed":125481691,"data_compressed_allocated":165167104,"data_compressed_original":2642427904,"omap_allocated":0,"internal_metadata":135397376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":329252864,"num_objects":5024,"num_object_clones":0,"num_object_copies":15072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5024,"num_write_kb":321536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002628"},"pg_stats":[{"pgid":"3.f","version":"22'811","reported_seq":835,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.596667+0000","last_change":"2024-09-15T12:18:53.083350+0000","last_active":"2024-09-15T12:20:10.596667+0000","last_peered":"2024-09-15T12:20:10.596667+0000","last_clean":"2024-09-15T12:20:10.596667+0000","last_became_active":"2024-09-15T12:18:53.075051+0000","last_became_peered":"2024-09-15T12:18:53.075051+0000","last_unstale":"2024-09-15T12:20:10.596667+0000","last_undegraded":"2024-09-15T12:20:10.596667+0000","last_fullsized":"2024-09-15T12:20:10.596667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53149696,"num_objects":811,"num_object_clones":0,"num_object_copies":2433,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":811,"num_write_kb":51904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"22'796","reported_seq":820,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.560947+0000","last_change":"2024-09-15T12:18:53.139711+0000","last_active":"2024-09-15T12:20:10.560947+0000","last_peered":"2024-09-15T12:20:10.560947+0000","last_clean":"2024-09-15T12:20:10.560947+0000","last_became_active":"2024-09-15T12:18:53.130124+0000","last_became_peered":"2024-09-15T12:18:53.130124+0000","last_unstale":"2024-09-15T12:20:10.560947+0000","last_undegraded":"2024-09-15T12:20:10.560947+0000","last_fullsized":"2024-09-15T12:20:10.560947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":796,"log_dups_size":0,"ondisk_log_size":796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52166656,"num_objects":796,"num_object_clones":0,"num_object_copies":2388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":796,"num_write_kb":50944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'876","reported_seq":900,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.659893+0000","last_change":"2024-09-15T12:18:53.140327+0000","last_active":"2024-09-15T12:20:10.659893+0000","last_peered":"2024-09-15T12:20:10.659893+0000","last_clean":"2024-09-15T12:20:10.659893+0000","last_became_active":"2024-09-15T12:18:53.128935+0000","last_became_peered":"2024-09-15T12:18:53.128935+0000","last_unstale":"2024-09-15T12:20:10.659893+0000","last_undegraded":"2024-09-15T12:20:10.659893+0000","last_fullsized":"2024-09-15T12:20:10.659893+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":876,"log_dups_size":0,"ondisk_log_size":876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57409536,"num_objects":876,"num_object_clones":0,"num_object_copies":2628,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":876,"num_write_kb":56064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"22'857","reported_seq":881,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.646335+0000","last_change":"2024-09-15T12:18:53.138678+0000","last_active":"2024-09-15T12:20:10.646335+0000","last_peered":"2024-09-15T12:20:10.646335+0000","last_clean":"2024-09-15T12:20:10.646335+0000","last_became_active":"2024-09-15T12:18:53.129492+0000","last_became_peered":"2024-09-15T12:18:53.129492+0000","last_unstale":"2024-09-15T12:20:10.646335+0000","last_undegraded":"2024-09-15T12:20:10.646335+0000","last_fullsized":"2024-09-15T12:20:10.646335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56164352,"num_objects":857,"num_object_clones":0,"num_object_copies":2571,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":857,"num_write_kb":54848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'836","reported_seq":860,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:11.729081+0000","last_change":"2024-09-15T12:18:53.109204+0000","last_active":"2024-09-15T12:20:11.729081+0000","last_peered":"2024-09-15T12:20:11.729081+0000","last_clean":"2024-09-15T12:20:11.729081+0000","last_became_active":"2024-09-15T12:18:53.087134+0000","last_became_peered":"2024-09-15T12:18:53.087134+0000","last_unstale":"2024-09-15T12:20:11.729081+0000","last_undegraded":"2024-09-15T12:20:11.729081+0000","last_fullsized":"2024-09-15T12:20:11.729081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54788096,"num_objects":836,"num_object_clones":0,"num_object_copies":2508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":836,"num_write_kb":53504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"22'836","reported_seq":860,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.441343+0000","last_change":"2024-09-15T12:18:53.119675+0000","last_active":"2024-09-15T12:20:10.441343+0000","last_peered":"2024-09-15T12:20:10.441343+0000","last_clean":"2024-09-15T12:20:10.441343+0000","last_became_active":"2024-09-15T12:18:53.112010+0000","last_became_peered":"2024-09-15T12:18:53.112010+0000","last_unstale":"2024-09-15T12:20:10.441343+0000","last_undegraded":"2024-09-15T12:20:10.441343+0000","last_fullsized":"2024-09-15T12:20:10.441343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54788096,"num_objects":836,"num_object_clones":0,"num_object_copies":2508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":836,"num_write_kb":53504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"22'832","reported_seq":856,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.416212+0000","last_change":"2024-09-15T12:18:53.136381+0000","last_active":"2024-09-15T12:20:10.416212+0000","last_peered":"2024-09-15T12:20:10.416212+0000","last_clean":"2024-09-15T12:20:10.416212+0000","last_became_active":"2024-09-15T12:18:53.128765+0000","last_became_peered":"2024-09-15T12:18:53.128765+0000","last_unstale":"2024-09-15T12:20:10.416212+0000","last_undegraded":"2024-09-15T12:20:10.416212+0000","last_fullsized":"2024-09-15T12:20:10.416212+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":832,"num_object_clones":0,"num_object_copies":2496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":832,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"22'842","reported_seq":866,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.366734+0000","last_change":"2024-09-15T12:18:53.090984+0000","last_active":"2024-09-15T12:20:10.366734+0000","last_peered":"2024-09-15T12:20:10.366734+0000","last_clean":"2024-09-15T12:20:10.366734+0000","last_became_active":"2024-09-15T12:18:53.080676+0000","last_became_peered":"2024-09-15T12:18:53.080676+0000","last_unstale":"2024-09-15T12:20:10.366734+0000","last_undegraded":"2024-09-15T12:20:10.366734+0000","last_fullsized":"2024-09-15T12:20:10.366734+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":842,"log_dups_size":0,"ondisk_log_size":842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55181312,"num_objects":842,"num_object_clones":0,"num_object_copies":2526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":842,"num_write_kb":53888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":109,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.522583+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:20:03.522583+0000","last_peered":"2024-09-15T12:20:03.522583+0000","last_clean":"2024-09-15T12:20:03.522583+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:20:03.522583+0000","last_undegraded":"2024-09-15T12:20:03.522583+0000","last_fullsized":"2024-09-15T12:20:03.522583+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":38,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.545304+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:20:03.545304+0000","last_peered":"2024-09-15T12:20:03.545304+0000","last_clean":"2024-09-15T12:20:03.545304+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:20:03.545304+0000","last_undegraded":"2024-09-15T12:20:03.545304+0000","last_fullsized":"2024-09-15T12:20:03.545304+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"22'872","reported_seq":896,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.677176+0000","last_change":"2024-09-15T12:18:53.172532+0000","last_active":"2024-09-15T12:20:10.677176+0000","last_peered":"2024-09-15T12:20:10.677176+0000","last_clean":"2024-09-15T12:20:10.677176+0000","last_became_active":"2024-09-15T12:18:53.166197+0000","last_became_peered":"2024-09-15T12:18:53.166197+0000","last_unstale":"2024-09-15T12:20:10.677176+0000","last_undegraded":"2024-09-15T12:20:10.677176+0000","last_fullsized":"2024-09-15T12:20:10.677176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57147392,"num_objects":872,"num_object_clones":0,"num_object_copies":2616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":872,"num_write_kb":55808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.498796+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:20:03.498796+0000","last_peered":"2024-09-15T12:20:03.498796+0000","last_clean":"2024-09-15T12:20:03.498796+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:20:03.498796+0000","last_undegraded":"2024-09-15T12:20:03.498796+0000","last_fullsized":"2024-09-15T12:20:03.498796+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"22'823","reported_seq":847,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:11.541254+0000","last_change":"2024-09-15T12:18:53.161283+0000","last_active":"2024-09-15T12:20:11.541254+0000","last_peered":"2024-09-15T12:20:11.541254+0000","last_clean":"2024-09-15T12:20:11.541254+0000","last_became_active":"2024-09-15T12:18:53.149710+0000","last_became_peered":"2024-09-15T12:18:53.149710+0000","last_unstale":"2024-09-15T12:20:11.541254+0000","last_undegraded":"2024-09-15T12:20:11.541254+0000","last_fullsized":"2024-09-15T12:20:11.541254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53936128,"num_objects":823,"num_object_clones":0,"num_object_copies":2469,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":823,"num_write_kb":52672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.541630+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:20:03.541630+0000","last_peered":"2024-09-15T12:20:03.541630+0000","last_clean":"2024-09-15T12:20:03.541630+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:20:03.541630+0000","last_undegraded":"2024-09-15T12:20:03.541630+0000","last_fullsized":"2024-09-15T12:20:03.541630+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"22'869","reported_seq":893,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:11.664363+0000","last_change":"2024-09-15T12:18:53.169843+0000","last_active":"2024-09-15T12:20:11.664363+0000","last_peered":"2024-09-15T12:20:11.664363+0000","last_clean":"2024-09-15T12:20:11.664363+0000","last_became_active":"2024-09-15T12:18:53.161921+0000","last_became_peered":"2024-09-15T12:18:53.161921+0000","last_unstale":"2024-09-15T12:20:11.664363+0000","last_undegraded":"2024-09-15T12:20:11.664363+0000","last_fullsized":"2024-09-15T12:20:11.664363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56950784,"num_objects":869,"num_object_clones":0,"num_object_copies":2607,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":869,"num_write_kb":55616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":39,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.493324+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:20:03.493324+0000","last_peered":"2024-09-15T12:20:03.493324+0000","last_clean":"2024-09-15T12:20:03.493324+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:20:03.493324+0000","last_undegraded":"2024-09-15T12:20:03.493324+0000","last_fullsized":"2024-09-15T12:20:03.493324+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"22'859","reported_seq":883,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.634318+0000","last_change":"2024-09-15T12:18:53.100005+0000","last_active":"2024-09-15T12:20:10.634318+0000","last_peered":"2024-09-15T12:20:10.634318+0000","last_clean":"2024-09-15T12:20:10.634318+0000","last_became_active":"2024-09-15T12:18:53.080705+0000","last_became_peered":"2024-09-15T12:18:53.080705+0000","last_unstale":"2024-09-15T12:20:10.634318+0000","last_undegraded":"2024-09-15T12:20:10.634318+0000","last_fullsized":"2024-09-15T12:20:10.634318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":859,"log_dups_size":0,"ondisk_log_size":859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56295424,"num_objects":859,"num_object_clones":0,"num_object_copies":2577,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":859,"num_write_kb":54976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"22'856","reported_seq":880,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.340847+0000","last_change":"2024-09-15T12:18:53.122880+0000","last_active":"2024-09-15T12:20:10.340847+0000","last_peered":"2024-09-15T12:20:10.340847+0000","last_clean":"2024-09-15T12:20:10.340847+0000","last_became_active":"2024-09-15T12:18:53.111647+0000","last_became_peered":"2024-09-15T12:18:53.111647+0000","last_unstale":"2024-09-15T12:20:10.340847+0000","last_undegraded":"2024-09-15T12:20:10.340847+0000","last_fullsized":"2024-09-15T12:20:10.340847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":856,"log_dups_size":0,"ondisk_log_size":856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56098816,"num_objects":856,"num_object_clones":0,"num_object_copies":2568,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":54784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.523562+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:20:03.523562+0000","last_peered":"2024-09-15T12:20:03.523562+0000","last_clean":"2024-09-15T12:20:03.523562+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:20:03.523562+0000","last_undegraded":"2024-09-15T12:20:03.523562+0000","last_fullsized":"2024-09-15T12:20:03.523562+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"22'871","reported_seq":895,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.658348+0000","last_change":"2024-09-15T12:18:53.133542+0000","last_active":"2024-09-15T12:20:10.658348+0000","last_peered":"2024-09-15T12:20:10.658348+0000","last_clean":"2024-09-15T12:20:10.658348+0000","last_became_active":"2024-09-15T12:18:53.125716+0000","last_became_peered":"2024-09-15T12:18:53.125716+0000","last_unstale":"2024-09-15T12:20:10.658348+0000","last_undegraded":"2024-09-15T12:20:10.658348+0000","last_fullsized":"2024-09-15T12:20:10.658348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":871,"log_dups_size":0,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57081856,"num_objects":871,"num_object_clones":0,"num_object_copies":2613,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":871,"num_write_kb":55744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.527734+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:20:03.527734+0000","last_peered":"2024-09-15T12:20:03.527734+0000","last_clean":"2024-09-15T12:20:03.527734+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:20:03.527734+0000","last_undegraded":"2024-09-15T12:20:03.527734+0000","last_fullsized":"2024-09-15T12:20:03.527734+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"22'855","reported_seq":879,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:11.712022+0000","last_change":"2024-09-15T12:18:53.133963+0000","last_active":"2024-09-15T12:20:11.712022+0000","last_peered":"2024-09-15T12:20:11.712022+0000","last_clean":"2024-09-15T12:20:11.712022+0000","last_became_active":"2024-09-15T12:18:53.122383+0000","last_became_peered":"2024-09-15T12:18:53.122383+0000","last_unstale":"2024-09-15T12:20:11.712022+0000","last_undegraded":"2024-09-15T12:20:11.712022+0000","last_fullsized":"2024-09-15T12:20:11.712022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":855,"log_dups_size":0,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56033280,"num_objects":855,"num_object_clones":0,"num_object_copies":2565,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":855,"num_write_kb":54720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.528751+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:20:03.528751+0000","last_peered":"2024-09-15T12:20:03.528751+0000","last_clean":"2024-09-15T12:20:03.528751+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:20:03.528751+0000","last_undegraded":"2024-09-15T12:20:03.528751+0000","last_fullsized":"2024-09-15T12:20:03.528751+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"22'873","reported_seq":897,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.410772+0000","last_change":"2024-09-15T12:18:53.102960+0000","last_active":"2024-09-15T12:20:10.410772+0000","last_peered":"2024-09-15T12:20:10.410772+0000","last_clean":"2024-09-15T12:20:10.410772+0000","last_became_active":"2024-09-15T12:18:53.088807+0000","last_became_peered":"2024-09-15T12:18:53.088807+0000","last_unstale":"2024-09-15T12:20:10.410772+0000","last_undegraded":"2024-09-15T12:20:10.410772+0000","last_fullsized":"2024-09-15T12:20:10.410772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":873,"log_dups_size":0,"ondisk_log_size":873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57212928,"num_objects":873,"num_object_clones":0,"num_object_copies":2619,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":873,"num_write_kb":55872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.547011+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:20:03.547011+0000","last_peered":"2024-09-15T12:20:03.547011+0000","last_clean":"2024-09-15T12:20:03.547011+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:20:03.547011+0000","last_undegraded":"2024-09-15T12:20:03.547011+0000","last_fullsized":"2024-09-15T12:20:03.547011+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":888930304,"num_objects":13564,"num_object_clones":0,"num_object_copies":40692,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13564,"num_write_kb":868096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":166776832,"data_stored":2668429312,"data_compressed":126707971,"data_compressed_allocated":166776832,"data_compressed_original":2668429312,"omap_allocated":0,"internal_metadata":0},"log_size":13564,"ondisk_log_size":13564,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673049,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":87068,"kb_used_data":47756,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94284772,"statfs":{"total":96636764160,"available":96547606528,"internally_reserved":0,"allocated":48902144,"data_stored":779150547,"data_compressed":36996487,"data_compressed_allocated":48697344,"data_compressed_original":779075584,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68096,"kb_used_data":37104,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94303744,"statfs":{"total":96636764160,"available":96567033856,"internally_reserved":0,"allocated":37994496,"data_stored":604562662,"data_compressed":28706357,"data_compressed_allocated":37785600,"data_compressed_original":604487680,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71232,"kb_used_data":40240,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94300608,"statfs":{"total":96636764160,"available":96563822592,"internally_reserved":0,"allocated":41205760,"data_stored":656335558,"data_compressed":31162745,"data_compressed_allocated":41017344,"data_compressed_original":656277504,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":67980,"kb_used_data":36988,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94303860,"statfs":{"total":96636764160,"available":96567152640,"internally_reserved":0,"allocated":37875712,"data_stored":602662118,"data_compressed":28616102,"data_compressed_allocated":37666816,"data_compressed_original":602587136,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38080512,"data_stored":609288192,"data_compressed":28931502,"data_compressed_allocated":38080512,"data_compressed_original":609288192,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41414656,"data_stored":662634496,"data_compressed":31464609,"data_compressed_allocated":41414656,"data_compressed_original":662634496,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":38129664,"data_stored":610074624,"data_compressed":28968853,"data_compressed_allocated":38129664,"data_compressed_original":610074624,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152000,"data_stored":786432000,"data_compressed":37343007,"data_compressed_allocated":49152000,"data_compressed_original":786432000,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:20:16.069 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 82 16 14391 14375 10.9556 9.6875 0.0799571 0.0912265 2024-09-15T12:20:17.069 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 83 16 14559 14543 10.9501 10.5 0.121773 0.091243 2024-09-15T12:20:17.285 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:20:17.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:17.424+0000 7f82122d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:17.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:17.431+0000 7f82122d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:18.070 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 84 16 14731 14715 10.9477 10.75 0.0833909 0.0912774 2024-09-15T12:20:19.070 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 85 16 14905 14889 10.9468 10.875 0.0735447 0.0912916 2024-09-15T12:20:19.881 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:20:20.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:20.034+0000 7fed3aa88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:20.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:20.042+0000 7fed3aa88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:20.070 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 86 16 15075 15059 10.9431 10.625 0.108936 0.0913422 2024-09-15T12:20:21.030 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:20:21.030 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:20:21.030 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:20:21.070 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 87 16 15229 15213 10.9279 9.625 0.0686586 0.0914293 2024-09-15T12:20:21.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:21.182+0000 7f388e4bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:21.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:21.196+0000 7f388e4bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:21.455 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:20:21.455 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:20:21.476 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-09-15T12:20:19.720931+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":889520691,"num_objects":13568,"num_object_clones":0,"num_object_copies":40704,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":13645,"num_write_kb":869204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13619,"ondisk_log_size":13619,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":294376,"kb_used_data":162088,"kb_used_omap":0,"kb_used_meta":132224,"kb_avail":377192984,"statfs":{"total":386547056640,"available":386245615616,"internally_reserved":0,"allocated":165978112,"data_stored":2642710885,"data_compressed":125481691,"data_compressed_allocated":165167104,"data_compressed_original":2642427904,"omap_allocated":0,"internal_metadata":135397376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":329252864,"num_objects":5024,"num_object_clones":0,"num_object_copies":15072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5024,"num_write_kb":321536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002301"},"pg_stats":[{"pgid":"3.f","version":"22'811","reported_seq":835,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.596667+0000","last_change":"2024-09-15T12:18:53.083350+0000","last_active":"2024-09-15T12:20:10.596667+0000","last_peered":"2024-09-15T12:20:10.596667+0000","last_clean":"2024-09-15T12:20:10.596667+0000","last_became_active":"2024-09-15T12:18:53.075051+0000","last_became_peered":"2024-09-15T12:18:53.075051+0000","last_unstale":"2024-09-15T12:20:10.596667+0000","last_undegraded":"2024-09-15T12:20:10.596667+0000","last_fullsized":"2024-09-15T12:20:10.596667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53149696,"num_objects":811,"num_object_clones":0,"num_object_copies":2433,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":811,"num_write_kb":51904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"22'796","reported_seq":820,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.560947+0000","last_change":"2024-09-15T12:18:53.139711+0000","last_active":"2024-09-15T12:20:10.560947+0000","last_peered":"2024-09-15T12:20:10.560947+0000","last_clean":"2024-09-15T12:20:10.560947+0000","last_became_active":"2024-09-15T12:18:53.130124+0000","last_became_peered":"2024-09-15T12:18:53.130124+0000","last_unstale":"2024-09-15T12:20:10.560947+0000","last_undegraded":"2024-09-15T12:20:10.560947+0000","last_fullsized":"2024-09-15T12:20:10.560947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":796,"log_dups_size":0,"ondisk_log_size":796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52166656,"num_objects":796,"num_object_clones":0,"num_object_copies":2388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":796,"num_write_kb":50944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'876","reported_seq":900,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.659893+0000","last_change":"2024-09-15T12:18:53.140327+0000","last_active":"2024-09-15T12:20:10.659893+0000","last_peered":"2024-09-15T12:20:10.659893+0000","last_clean":"2024-09-15T12:20:10.659893+0000","last_became_active":"2024-09-15T12:18:53.128935+0000","last_became_peered":"2024-09-15T12:18:53.128935+0000","last_unstale":"2024-09-15T12:20:10.659893+0000","last_undegraded":"2024-09-15T12:20:10.659893+0000","last_fullsized":"2024-09-15T12:20:10.659893+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":876,"log_dups_size":0,"ondisk_log_size":876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57409536,"num_objects":876,"num_object_clones":0,"num_object_copies":2628,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":876,"num_write_kb":56064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"22'857","reported_seq":881,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.646335+0000","last_change":"2024-09-15T12:18:53.138678+0000","last_active":"2024-09-15T12:20:10.646335+0000","last_peered":"2024-09-15T12:20:10.646335+0000","last_clean":"2024-09-15T12:20:10.646335+0000","last_became_active":"2024-09-15T12:18:53.129492+0000","last_became_peered":"2024-09-15T12:18:53.129492+0000","last_unstale":"2024-09-15T12:20:10.646335+0000","last_undegraded":"2024-09-15T12:20:10.646335+0000","last_fullsized":"2024-09-15T12:20:10.646335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56164352,"num_objects":857,"num_object_clones":0,"num_object_copies":2571,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":857,"num_write_kb":54848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'836","reported_seq":860,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:11.729081+0000","last_change":"2024-09-15T12:18:53.109204+0000","last_active":"2024-09-15T12:20:11.729081+0000","last_peered":"2024-09-15T12:20:11.729081+0000","last_clean":"2024-09-15T12:20:11.729081+0000","last_became_active":"2024-09-15T12:18:53.087134+0000","last_became_peered":"2024-09-15T12:18:53.087134+0000","last_unstale":"2024-09-15T12:20:11.729081+0000","last_undegraded":"2024-09-15T12:20:11.729081+0000","last_fullsized":"2024-09-15T12:20:11.729081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54788096,"num_objects":836,"num_object_clones":0,"num_object_copies":2508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":836,"num_write_kb":53504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"22'836","reported_seq":860,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.441343+0000","last_change":"2024-09-15T12:18:53.119675+0000","last_active":"2024-09-15T12:20:10.441343+0000","last_peered":"2024-09-15T12:20:10.441343+0000","last_clean":"2024-09-15T12:20:10.441343+0000","last_became_active":"2024-09-15T12:18:53.112010+0000","last_became_peered":"2024-09-15T12:18:53.112010+0000","last_unstale":"2024-09-15T12:20:10.441343+0000","last_undegraded":"2024-09-15T12:20:10.441343+0000","last_fullsized":"2024-09-15T12:20:10.441343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54788096,"num_objects":836,"num_object_clones":0,"num_object_copies":2508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":836,"num_write_kb":53504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"22'832","reported_seq":856,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.416212+0000","last_change":"2024-09-15T12:18:53.136381+0000","last_active":"2024-09-15T12:20:10.416212+0000","last_peered":"2024-09-15T12:20:10.416212+0000","last_clean":"2024-09-15T12:20:10.416212+0000","last_became_active":"2024-09-15T12:18:53.128765+0000","last_became_peered":"2024-09-15T12:18:53.128765+0000","last_unstale":"2024-09-15T12:20:10.416212+0000","last_undegraded":"2024-09-15T12:20:10.416212+0000","last_fullsized":"2024-09-15T12:20:10.416212+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":832,"num_object_clones":0,"num_object_copies":2496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":832,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"22'842","reported_seq":866,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.366734+0000","last_change":"2024-09-15T12:18:53.090984+0000","last_active":"2024-09-15T12:20:10.366734+0000","last_peered":"2024-09-15T12:20:10.366734+0000","last_clean":"2024-09-15T12:20:10.366734+0000","last_became_active":"2024-09-15T12:18:53.080676+0000","last_became_peered":"2024-09-15T12:18:53.080676+0000","last_unstale":"2024-09-15T12:20:10.366734+0000","last_undegraded":"2024-09-15T12:20:10.366734+0000","last_fullsized":"2024-09-15T12:20:10.366734+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":842,"log_dups_size":0,"ondisk_log_size":842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55181312,"num_objects":842,"num_object_clones":0,"num_object_copies":2526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":842,"num_write_kb":53888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":109,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.522583+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:20:03.522583+0000","last_peered":"2024-09-15T12:20:03.522583+0000","last_clean":"2024-09-15T12:20:03.522583+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:20:03.522583+0000","last_undegraded":"2024-09-15T12:20:03.522583+0000","last_fullsized":"2024-09-15T12:20:03.522583+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":38,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.545304+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:20:03.545304+0000","last_peered":"2024-09-15T12:20:03.545304+0000","last_clean":"2024-09-15T12:20:03.545304+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:20:03.545304+0000","last_undegraded":"2024-09-15T12:20:03.545304+0000","last_fullsized":"2024-09-15T12:20:03.545304+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"22'872","reported_seq":896,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.677176+0000","last_change":"2024-09-15T12:18:53.172532+0000","last_active":"2024-09-15T12:20:10.677176+0000","last_peered":"2024-09-15T12:20:10.677176+0000","last_clean":"2024-09-15T12:20:10.677176+0000","last_became_active":"2024-09-15T12:18:53.166197+0000","last_became_peered":"2024-09-15T12:18:53.166197+0000","last_unstale":"2024-09-15T12:20:10.677176+0000","last_undegraded":"2024-09-15T12:20:10.677176+0000","last_fullsized":"2024-09-15T12:20:10.677176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57147392,"num_objects":872,"num_object_clones":0,"num_object_copies":2616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":872,"num_write_kb":55808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.498796+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:20:03.498796+0000","last_peered":"2024-09-15T12:20:03.498796+0000","last_clean":"2024-09-15T12:20:03.498796+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:20:03.498796+0000","last_undegraded":"2024-09-15T12:20:03.498796+0000","last_fullsized":"2024-09-15T12:20:03.498796+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"22'823","reported_seq":847,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:11.541254+0000","last_change":"2024-09-15T12:18:53.161283+0000","last_active":"2024-09-15T12:20:11.541254+0000","last_peered":"2024-09-15T12:20:11.541254+0000","last_clean":"2024-09-15T12:20:11.541254+0000","last_became_active":"2024-09-15T12:18:53.149710+0000","last_became_peered":"2024-09-15T12:18:53.149710+0000","last_unstale":"2024-09-15T12:20:11.541254+0000","last_undegraded":"2024-09-15T12:20:11.541254+0000","last_fullsized":"2024-09-15T12:20:11.541254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53936128,"num_objects":823,"num_object_clones":0,"num_object_copies":2469,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":823,"num_write_kb":52672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.541630+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:20:03.541630+0000","last_peered":"2024-09-15T12:20:03.541630+0000","last_clean":"2024-09-15T12:20:03.541630+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:20:03.541630+0000","last_undegraded":"2024-09-15T12:20:03.541630+0000","last_fullsized":"2024-09-15T12:20:03.541630+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"22'869","reported_seq":893,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:11.664363+0000","last_change":"2024-09-15T12:18:53.169843+0000","last_active":"2024-09-15T12:20:11.664363+0000","last_peered":"2024-09-15T12:20:11.664363+0000","last_clean":"2024-09-15T12:20:11.664363+0000","last_became_active":"2024-09-15T12:18:53.161921+0000","last_became_peered":"2024-09-15T12:18:53.161921+0000","last_unstale":"2024-09-15T12:20:11.664363+0000","last_undegraded":"2024-09-15T12:20:11.664363+0000","last_fullsized":"2024-09-15T12:20:11.664363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56950784,"num_objects":869,"num_object_clones":0,"num_object_copies":2607,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":869,"num_write_kb":55616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":39,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.493324+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:20:03.493324+0000","last_peered":"2024-09-15T12:20:03.493324+0000","last_clean":"2024-09-15T12:20:03.493324+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:20:03.493324+0000","last_undegraded":"2024-09-15T12:20:03.493324+0000","last_fullsized":"2024-09-15T12:20:03.493324+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"22'859","reported_seq":883,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.634318+0000","last_change":"2024-09-15T12:18:53.100005+0000","last_active":"2024-09-15T12:20:10.634318+0000","last_peered":"2024-09-15T12:20:10.634318+0000","last_clean":"2024-09-15T12:20:10.634318+0000","last_became_active":"2024-09-15T12:18:53.080705+0000","last_became_peered":"2024-09-15T12:18:53.080705+0000","last_unstale":"2024-09-15T12:20:10.634318+0000","last_undegraded":"2024-09-15T12:20:10.634318+0000","last_fullsized":"2024-09-15T12:20:10.634318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":859,"log_dups_size":0,"ondisk_log_size":859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56295424,"num_objects":859,"num_object_clones":0,"num_object_copies":2577,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":859,"num_write_kb":54976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"22'856","reported_seq":880,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.340847+0000","last_change":"2024-09-15T12:18:53.122880+0000","last_active":"2024-09-15T12:20:10.340847+0000","last_peered":"2024-09-15T12:20:10.340847+0000","last_clean":"2024-09-15T12:20:10.340847+0000","last_became_active":"2024-09-15T12:18:53.111647+0000","last_became_peered":"2024-09-15T12:18:53.111647+0000","last_unstale":"2024-09-15T12:20:10.340847+0000","last_undegraded":"2024-09-15T12:20:10.340847+0000","last_fullsized":"2024-09-15T12:20:10.340847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":856,"log_dups_size":0,"ondisk_log_size":856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56098816,"num_objects":856,"num_object_clones":0,"num_object_copies":2568,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":54784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.523562+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:20:03.523562+0000","last_peered":"2024-09-15T12:20:03.523562+0000","last_clean":"2024-09-15T12:20:03.523562+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:20:03.523562+0000","last_undegraded":"2024-09-15T12:20:03.523562+0000","last_fullsized":"2024-09-15T12:20:03.523562+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"22'871","reported_seq":895,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.658348+0000","last_change":"2024-09-15T12:18:53.133542+0000","last_active":"2024-09-15T12:20:10.658348+0000","last_peered":"2024-09-15T12:20:10.658348+0000","last_clean":"2024-09-15T12:20:10.658348+0000","last_became_active":"2024-09-15T12:18:53.125716+0000","last_became_peered":"2024-09-15T12:18:53.125716+0000","last_unstale":"2024-09-15T12:20:10.658348+0000","last_undegraded":"2024-09-15T12:20:10.658348+0000","last_fullsized":"2024-09-15T12:20:10.658348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":871,"log_dups_size":0,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57081856,"num_objects":871,"num_object_clones":0,"num_object_copies":2613,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":871,"num_write_kb":55744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.527734+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:20:03.527734+0000","last_peered":"2024-09-15T12:20:03.527734+0000","last_clean":"2024-09-15T12:20:03.527734+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:20:03.527734+0000","last_undegraded":"2024-09-15T12:20:03.527734+0000","last_fullsized":"2024-09-15T12:20:03.527734+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"22'855","reported_seq":879,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:11.712022+0000","last_change":"2024-09-15T12:18:53.133963+0000","last_active":"2024-09-15T12:20:11.712022+0000","last_peered":"2024-09-15T12:20:11.712022+0000","last_clean":"2024-09-15T12:20:11.712022+0000","last_became_active":"2024-09-15T12:18:53.122383+0000","last_became_peered":"2024-09-15T12:18:53.122383+0000","last_unstale":"2024-09-15T12:20:11.712022+0000","last_undegraded":"2024-09-15T12:20:11.712022+0000","last_fullsized":"2024-09-15T12:20:11.712022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":855,"log_dups_size":0,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56033280,"num_objects":855,"num_object_clones":0,"num_object_copies":2565,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":855,"num_write_kb":54720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.528751+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:20:03.528751+0000","last_peered":"2024-09-15T12:20:03.528751+0000","last_clean":"2024-09-15T12:20:03.528751+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:20:03.528751+0000","last_undegraded":"2024-09-15T12:20:03.528751+0000","last_fullsized":"2024-09-15T12:20:03.528751+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"22'873","reported_seq":897,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.410772+0000","last_change":"2024-09-15T12:18:53.102960+0000","last_active":"2024-09-15T12:20:10.410772+0000","last_peered":"2024-09-15T12:20:10.410772+0000","last_clean":"2024-09-15T12:20:10.410772+0000","last_became_active":"2024-09-15T12:18:53.088807+0000","last_became_peered":"2024-09-15T12:18:53.088807+0000","last_unstale":"2024-09-15T12:20:10.410772+0000","last_undegraded":"2024-09-15T12:20:10.410772+0000","last_fullsized":"2024-09-15T12:20:10.410772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":873,"log_dups_size":0,"ondisk_log_size":873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57212928,"num_objects":873,"num_object_clones":0,"num_object_copies":2619,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":873,"num_write_kb":55872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.547011+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:20:03.547011+0000","last_peered":"2024-09-15T12:20:03.547011+0000","last_clean":"2024-09-15T12:20:03.547011+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:20:03.547011+0000","last_undegraded":"2024-09-15T12:20:03.547011+0000","last_fullsized":"2024-09-15T12:20:03.547011+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":888930304,"num_objects":13564,"num_object_clones":0,"num_object_copies":40692,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13564,"num_write_kb":868096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":166776832,"data_stored":2668429312,"data_compressed":126707971,"data_compressed_allocated":166776832,"data_compressed_original":2668429312,"omap_allocated":0,"internal_metadata":0},"log_size":13564,"ondisk_log_size":13564,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673049,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":87068,"kb_used_data":47756,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94284772,"statfs":{"total":96636764160,"available":96547606528,"internally_reserved":0,"allocated":48902144,"data_stored":779150547,"data_compressed":36996487,"data_compressed_allocated":48697344,"data_compressed_original":779075584,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68096,"kb_used_data":37104,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94303744,"statfs":{"total":96636764160,"available":96567033856,"internally_reserved":0,"allocated":37994496,"data_stored":604562662,"data_compressed":28706357,"data_compressed_allocated":37785600,"data_compressed_original":604487680,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71232,"kb_used_data":40240,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94300608,"statfs":{"total":96636764160,"available":96563822592,"internally_reserved":0,"allocated":41205760,"data_stored":656335558,"data_compressed":31162745,"data_compressed_allocated":41017344,"data_compressed_original":656277504,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":67980,"kb_used_data":36988,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94303860,"statfs":{"total":96636764160,"available":96567152640,"internally_reserved":0,"allocated":37875712,"data_stored":602662118,"data_compressed":28616102,"data_compressed_allocated":37666816,"data_compressed_original":602587136,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38080512,"data_stored":609288192,"data_compressed":28931502,"data_compressed_allocated":38080512,"data_compressed_original":609288192,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41414656,"data_stored":662634496,"data_compressed":31464609,"data_compressed_allocated":41414656,"data_compressed_original":662634496,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":38129664,"data_stored":610074624,"data_compressed":28968853,"data_compressed_allocated":38129664,"data_compressed_original":610074624,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152000,"data_stored":786432000,"data_compressed":37343007,"data_compressed_allocated":49152000,"data_compressed_original":786432000,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:20:22.070 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 88 16 15386 15370 10.9152 9.8125 0.062634 0.0915753 2024-09-15T12:20:22.444 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:20:22.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:22.604+0000 7fe24e511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:22.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:22.611+0000 7fe24e511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:23.070 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 89 16 15537 15521 10.8986 9.4375 0.11309 0.0916654 2024-09-15T12:20:24.070 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 90 15 15705 15690 10.8949 10.5625 0.0919292 0.0917359 2024-09-15T12:20:25.071 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Total time run: 90.0508 2024-09-15T12:20:25.071 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Total writes made: 15705 2024-09-15T12:20:25.071 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Write size: 65536 2024-09-15T12:20:25.071 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Object size: 65536 2024-09-15T12:20:25.071 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Bandwidth (MB/sec): 10.9001 2024-09-15T12:20:25.071 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Stddev Bandwidth: 0.726517 2024-09-15T12:20:25.071 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Max bandwidth (MB/sec): 12.4375 2024-09-15T12:20:25.071 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Min bandwidth (MB/sec): 9 2024-09-15T12:20:25.071 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Average IOPS: 174 2024-09-15T12:20:25.071 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Stddev IOPS: 11.6243 2024-09-15T12:20:25.071 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Max IOPS: 199 2024-09-15T12:20:25.071 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Min IOPS: 144 2024-09-15T12:20:25.072 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Average Latency(s): 0.0917172 2024-09-15T12:20:25.072 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Stddev Latency(s): 0.0345411 2024-09-15T12:20:25.072 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Max latency(s): 0.305284 2024-09-15T12:20:25.072 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Min latency(s): 0.0153683 2024-09-15T12:20:25.099 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Cleaning up (deleting benchmark objects) 2024-09-15T12:20:25.131 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:20:25.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:25.279+0000 7f27ba351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:25.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:25.288+0000 7f27ba351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:26.479 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:20:26.479 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:20:26.479 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:20:26.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:26.632+0000 7f5da5f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:26.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:26.645+0000 7f5da5f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:26.936 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:20:26.936 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:20:26.950 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-09-15T12:20:25.722163+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":889520691,"num_objects":13568,"num_object_clones":0,"num_object_copies":40704,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":13645,"num_write_kb":869204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13619,"ondisk_log_size":13619,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":294376,"kb_used_data":162088,"kb_used_omap":0,"kb_used_meta":132224,"kb_avail":377192984,"statfs":{"total":386547056640,"available":386245615616,"internally_reserved":0,"allocated":165978112,"data_stored":2642710885,"data_compressed":125481691,"data_compressed_allocated":165167104,"data_compressed_original":2642427904,"omap_allocated":0,"internal_metadata":135397376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002413"},"pg_stats":[{"pgid":"3.f","version":"22'811","reported_seq":835,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.596667+0000","last_change":"2024-09-15T12:18:53.083350+0000","last_active":"2024-09-15T12:20:10.596667+0000","last_peered":"2024-09-15T12:20:10.596667+0000","last_clean":"2024-09-15T12:20:10.596667+0000","last_became_active":"2024-09-15T12:18:53.075051+0000","last_became_peered":"2024-09-15T12:18:53.075051+0000","last_unstale":"2024-09-15T12:20:10.596667+0000","last_undegraded":"2024-09-15T12:20:10.596667+0000","last_fullsized":"2024-09-15T12:20:10.596667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53149696,"num_objects":811,"num_object_clones":0,"num_object_copies":2433,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":811,"num_write_kb":51904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"22'796","reported_seq":820,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.560947+0000","last_change":"2024-09-15T12:18:53.139711+0000","last_active":"2024-09-15T12:20:10.560947+0000","last_peered":"2024-09-15T12:20:10.560947+0000","last_clean":"2024-09-15T12:20:10.560947+0000","last_became_active":"2024-09-15T12:18:53.130124+0000","last_became_peered":"2024-09-15T12:18:53.130124+0000","last_unstale":"2024-09-15T12:20:10.560947+0000","last_undegraded":"2024-09-15T12:20:10.560947+0000","last_fullsized":"2024-09-15T12:20:10.560947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":796,"log_dups_size":0,"ondisk_log_size":796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52166656,"num_objects":796,"num_object_clones":0,"num_object_copies":2388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":796,"num_write_kb":50944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'876","reported_seq":900,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.659893+0000","last_change":"2024-09-15T12:18:53.140327+0000","last_active":"2024-09-15T12:20:10.659893+0000","last_peered":"2024-09-15T12:20:10.659893+0000","last_clean":"2024-09-15T12:20:10.659893+0000","last_became_active":"2024-09-15T12:18:53.128935+0000","last_became_peered":"2024-09-15T12:18:53.128935+0000","last_unstale":"2024-09-15T12:20:10.659893+0000","last_undegraded":"2024-09-15T12:20:10.659893+0000","last_fullsized":"2024-09-15T12:20:10.659893+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":876,"log_dups_size":0,"ondisk_log_size":876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57409536,"num_objects":876,"num_object_clones":0,"num_object_copies":2628,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":876,"num_write_kb":56064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"22'857","reported_seq":881,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.646335+0000","last_change":"2024-09-15T12:18:53.138678+0000","last_active":"2024-09-15T12:20:10.646335+0000","last_peered":"2024-09-15T12:20:10.646335+0000","last_clean":"2024-09-15T12:20:10.646335+0000","last_became_active":"2024-09-15T12:18:53.129492+0000","last_became_peered":"2024-09-15T12:18:53.129492+0000","last_unstale":"2024-09-15T12:20:10.646335+0000","last_undegraded":"2024-09-15T12:20:10.646335+0000","last_fullsized":"2024-09-15T12:20:10.646335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56164352,"num_objects":857,"num_object_clones":0,"num_object_copies":2571,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":857,"num_write_kb":54848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'836","reported_seq":860,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:11.729081+0000","last_change":"2024-09-15T12:18:53.109204+0000","last_active":"2024-09-15T12:20:11.729081+0000","last_peered":"2024-09-15T12:20:11.729081+0000","last_clean":"2024-09-15T12:20:11.729081+0000","last_became_active":"2024-09-15T12:18:53.087134+0000","last_became_peered":"2024-09-15T12:18:53.087134+0000","last_unstale":"2024-09-15T12:20:11.729081+0000","last_undegraded":"2024-09-15T12:20:11.729081+0000","last_fullsized":"2024-09-15T12:20:11.729081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54788096,"num_objects":836,"num_object_clones":0,"num_object_copies":2508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":836,"num_write_kb":53504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"22'836","reported_seq":860,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.441343+0000","last_change":"2024-09-15T12:18:53.119675+0000","last_active":"2024-09-15T12:20:10.441343+0000","last_peered":"2024-09-15T12:20:10.441343+0000","last_clean":"2024-09-15T12:20:10.441343+0000","last_became_active":"2024-09-15T12:18:53.112010+0000","last_became_peered":"2024-09-15T12:18:53.112010+0000","last_unstale":"2024-09-15T12:20:10.441343+0000","last_undegraded":"2024-09-15T12:20:10.441343+0000","last_fullsized":"2024-09-15T12:20:10.441343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54788096,"num_objects":836,"num_object_clones":0,"num_object_copies":2508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":836,"num_write_kb":53504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"22'832","reported_seq":856,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.416212+0000","last_change":"2024-09-15T12:18:53.136381+0000","last_active":"2024-09-15T12:20:10.416212+0000","last_peered":"2024-09-15T12:20:10.416212+0000","last_clean":"2024-09-15T12:20:10.416212+0000","last_became_active":"2024-09-15T12:18:53.128765+0000","last_became_peered":"2024-09-15T12:18:53.128765+0000","last_unstale":"2024-09-15T12:20:10.416212+0000","last_undegraded":"2024-09-15T12:20:10.416212+0000","last_fullsized":"2024-09-15T12:20:10.416212+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":832,"num_object_clones":0,"num_object_copies":2496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":832,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"22'842","reported_seq":866,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.366734+0000","last_change":"2024-09-15T12:18:53.090984+0000","last_active":"2024-09-15T12:20:10.366734+0000","last_peered":"2024-09-15T12:20:10.366734+0000","last_clean":"2024-09-15T12:20:10.366734+0000","last_became_active":"2024-09-15T12:18:53.080676+0000","last_became_peered":"2024-09-15T12:18:53.080676+0000","last_unstale":"2024-09-15T12:20:10.366734+0000","last_undegraded":"2024-09-15T12:20:10.366734+0000","last_fullsized":"2024-09-15T12:20:10.366734+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":842,"log_dups_size":0,"ondisk_log_size":842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55181312,"num_objects":842,"num_object_clones":0,"num_object_copies":2526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":842,"num_write_kb":53888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":109,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.522583+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:20:03.522583+0000","last_peered":"2024-09-15T12:20:03.522583+0000","last_clean":"2024-09-15T12:20:03.522583+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:20:03.522583+0000","last_undegraded":"2024-09-15T12:20:03.522583+0000","last_fullsized":"2024-09-15T12:20:03.522583+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":38,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.545304+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:20:03.545304+0000","last_peered":"2024-09-15T12:20:03.545304+0000","last_clean":"2024-09-15T12:20:03.545304+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:20:03.545304+0000","last_undegraded":"2024-09-15T12:20:03.545304+0000","last_fullsized":"2024-09-15T12:20:03.545304+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"22'872","reported_seq":896,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.677176+0000","last_change":"2024-09-15T12:18:53.172532+0000","last_active":"2024-09-15T12:20:10.677176+0000","last_peered":"2024-09-15T12:20:10.677176+0000","last_clean":"2024-09-15T12:20:10.677176+0000","last_became_active":"2024-09-15T12:18:53.166197+0000","last_became_peered":"2024-09-15T12:18:53.166197+0000","last_unstale":"2024-09-15T12:20:10.677176+0000","last_undegraded":"2024-09-15T12:20:10.677176+0000","last_fullsized":"2024-09-15T12:20:10.677176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57147392,"num_objects":872,"num_object_clones":0,"num_object_copies":2616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":872,"num_write_kb":55808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.498796+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:20:03.498796+0000","last_peered":"2024-09-15T12:20:03.498796+0000","last_clean":"2024-09-15T12:20:03.498796+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:20:03.498796+0000","last_undegraded":"2024-09-15T12:20:03.498796+0000","last_fullsized":"2024-09-15T12:20:03.498796+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"22'823","reported_seq":847,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:11.541254+0000","last_change":"2024-09-15T12:18:53.161283+0000","last_active":"2024-09-15T12:20:11.541254+0000","last_peered":"2024-09-15T12:20:11.541254+0000","last_clean":"2024-09-15T12:20:11.541254+0000","last_became_active":"2024-09-15T12:18:53.149710+0000","last_became_peered":"2024-09-15T12:18:53.149710+0000","last_unstale":"2024-09-15T12:20:11.541254+0000","last_undegraded":"2024-09-15T12:20:11.541254+0000","last_fullsized":"2024-09-15T12:20:11.541254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53936128,"num_objects":823,"num_object_clones":0,"num_object_copies":2469,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":823,"num_write_kb":52672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.541630+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:20:03.541630+0000","last_peered":"2024-09-15T12:20:03.541630+0000","last_clean":"2024-09-15T12:20:03.541630+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:20:03.541630+0000","last_undegraded":"2024-09-15T12:20:03.541630+0000","last_fullsized":"2024-09-15T12:20:03.541630+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"22'869","reported_seq":893,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:11.664363+0000","last_change":"2024-09-15T12:18:53.169843+0000","last_active":"2024-09-15T12:20:11.664363+0000","last_peered":"2024-09-15T12:20:11.664363+0000","last_clean":"2024-09-15T12:20:11.664363+0000","last_became_active":"2024-09-15T12:18:53.161921+0000","last_became_peered":"2024-09-15T12:18:53.161921+0000","last_unstale":"2024-09-15T12:20:11.664363+0000","last_undegraded":"2024-09-15T12:20:11.664363+0000","last_fullsized":"2024-09-15T12:20:11.664363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56950784,"num_objects":869,"num_object_clones":0,"num_object_copies":2607,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":869,"num_write_kb":55616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":39,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.493324+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:20:03.493324+0000","last_peered":"2024-09-15T12:20:03.493324+0000","last_clean":"2024-09-15T12:20:03.493324+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:20:03.493324+0000","last_undegraded":"2024-09-15T12:20:03.493324+0000","last_fullsized":"2024-09-15T12:20:03.493324+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"22'859","reported_seq":883,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.634318+0000","last_change":"2024-09-15T12:18:53.100005+0000","last_active":"2024-09-15T12:20:10.634318+0000","last_peered":"2024-09-15T12:20:10.634318+0000","last_clean":"2024-09-15T12:20:10.634318+0000","last_became_active":"2024-09-15T12:18:53.080705+0000","last_became_peered":"2024-09-15T12:18:53.080705+0000","last_unstale":"2024-09-15T12:20:10.634318+0000","last_undegraded":"2024-09-15T12:20:10.634318+0000","last_fullsized":"2024-09-15T12:20:10.634318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":859,"log_dups_size":0,"ondisk_log_size":859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56295424,"num_objects":859,"num_object_clones":0,"num_object_copies":2577,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":859,"num_write_kb":54976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"22'856","reported_seq":880,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.340847+0000","last_change":"2024-09-15T12:18:53.122880+0000","last_active":"2024-09-15T12:20:10.340847+0000","last_peered":"2024-09-15T12:20:10.340847+0000","last_clean":"2024-09-15T12:20:10.340847+0000","last_became_active":"2024-09-15T12:18:53.111647+0000","last_became_peered":"2024-09-15T12:18:53.111647+0000","last_unstale":"2024-09-15T12:20:10.340847+0000","last_undegraded":"2024-09-15T12:20:10.340847+0000","last_fullsized":"2024-09-15T12:20:10.340847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":856,"log_dups_size":0,"ondisk_log_size":856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56098816,"num_objects":856,"num_object_clones":0,"num_object_copies":2568,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":54784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.523562+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:20:03.523562+0000","last_peered":"2024-09-15T12:20:03.523562+0000","last_clean":"2024-09-15T12:20:03.523562+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:20:03.523562+0000","last_undegraded":"2024-09-15T12:20:03.523562+0000","last_fullsized":"2024-09-15T12:20:03.523562+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"22'871","reported_seq":895,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.658348+0000","last_change":"2024-09-15T12:18:53.133542+0000","last_active":"2024-09-15T12:20:10.658348+0000","last_peered":"2024-09-15T12:20:10.658348+0000","last_clean":"2024-09-15T12:20:10.658348+0000","last_became_active":"2024-09-15T12:18:53.125716+0000","last_became_peered":"2024-09-15T12:18:53.125716+0000","last_unstale":"2024-09-15T12:20:10.658348+0000","last_undegraded":"2024-09-15T12:20:10.658348+0000","last_fullsized":"2024-09-15T12:20:10.658348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":871,"log_dups_size":0,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57081856,"num_objects":871,"num_object_clones":0,"num_object_copies":2613,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":871,"num_write_kb":55744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.527734+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:20:03.527734+0000","last_peered":"2024-09-15T12:20:03.527734+0000","last_clean":"2024-09-15T12:20:03.527734+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:20:03.527734+0000","last_undegraded":"2024-09-15T12:20:03.527734+0000","last_fullsized":"2024-09-15T12:20:03.527734+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"22'855","reported_seq":879,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:11.712022+0000","last_change":"2024-09-15T12:18:53.133963+0000","last_active":"2024-09-15T12:20:11.712022+0000","last_peered":"2024-09-15T12:20:11.712022+0000","last_clean":"2024-09-15T12:20:11.712022+0000","last_became_active":"2024-09-15T12:18:53.122383+0000","last_became_peered":"2024-09-15T12:18:53.122383+0000","last_unstale":"2024-09-15T12:20:11.712022+0000","last_undegraded":"2024-09-15T12:20:11.712022+0000","last_fullsized":"2024-09-15T12:20:11.712022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":855,"log_dups_size":0,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56033280,"num_objects":855,"num_object_clones":0,"num_object_copies":2565,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":855,"num_write_kb":54720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.528751+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:20:03.528751+0000","last_peered":"2024-09-15T12:20:03.528751+0000","last_clean":"2024-09-15T12:20:03.528751+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:20:03.528751+0000","last_undegraded":"2024-09-15T12:20:03.528751+0000","last_fullsized":"2024-09-15T12:20:03.528751+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"22'873","reported_seq":897,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.410772+0000","last_change":"2024-09-15T12:18:53.102960+0000","last_active":"2024-09-15T12:20:10.410772+0000","last_peered":"2024-09-15T12:20:10.410772+0000","last_clean":"2024-09-15T12:20:10.410772+0000","last_became_active":"2024-09-15T12:18:53.088807+0000","last_became_peered":"2024-09-15T12:18:53.088807+0000","last_unstale":"2024-09-15T12:20:10.410772+0000","last_undegraded":"2024-09-15T12:20:10.410772+0000","last_fullsized":"2024-09-15T12:20:10.410772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":873,"log_dups_size":0,"ondisk_log_size":873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57212928,"num_objects":873,"num_object_clones":0,"num_object_copies":2619,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":873,"num_write_kb":55872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.547011+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:20:03.547011+0000","last_peered":"2024-09-15T12:20:03.547011+0000","last_clean":"2024-09-15T12:20:03.547011+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:20:03.547011+0000","last_undegraded":"2024-09-15T12:20:03.547011+0000","last_fullsized":"2024-09-15T12:20:03.547011+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":888930304,"num_objects":13564,"num_object_clones":0,"num_object_copies":40692,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13564,"num_write_kb":868096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":166776832,"data_stored":2668429312,"data_compressed":126707971,"data_compressed_allocated":166776832,"data_compressed_original":2668429312,"omap_allocated":0,"internal_metadata":0},"log_size":13564,"ondisk_log_size":13564,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673049,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":87068,"kb_used_data":47756,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94284772,"statfs":{"total":96636764160,"available":96547606528,"internally_reserved":0,"allocated":48902144,"data_stored":779150547,"data_compressed":36996487,"data_compressed_allocated":48697344,"data_compressed_original":779075584,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68096,"kb_used_data":37104,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94303744,"statfs":{"total":96636764160,"available":96567033856,"internally_reserved":0,"allocated":37994496,"data_stored":604562662,"data_compressed":28706357,"data_compressed_allocated":37785600,"data_compressed_original":604487680,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71232,"kb_used_data":40240,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94300608,"statfs":{"total":96636764160,"available":96563822592,"internally_reserved":0,"allocated":41205760,"data_stored":656335558,"data_compressed":31162745,"data_compressed_allocated":41017344,"data_compressed_original":656277504,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":67980,"kb_used_data":36988,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94303860,"statfs":{"total":96636764160,"available":96567152640,"internally_reserved":0,"allocated":37875712,"data_stored":602662118,"data_compressed":28616102,"data_compressed_allocated":37666816,"data_compressed_original":602587136,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38080512,"data_stored":609288192,"data_compressed":28931502,"data_compressed_allocated":38080512,"data_compressed_original":609288192,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41414656,"data_stored":662634496,"data_compressed":31464609,"data_compressed_allocated":41414656,"data_compressed_original":662634496,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":38129664,"data_stored":610074624,"data_compressed":28968853,"data_compressed_allocated":38129664,"data_compressed_original":610074624,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152000,"data_stored":786432000,"data_compressed":37343007,"data_compressed_allocated":49152000,"data_compressed_original":786432000,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:20:27.824 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:20:27.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:27.982+0000 7fef6f8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:27.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:27.994+0000 7fef6f8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:30.346 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:20:30.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:30.505+0000 7fe8e1646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:30.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:30.511+0000 7fe8e1646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:31.952 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:20:31.952 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-15T12:20:32.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:32.090+0000 7fd3398d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:32.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:32.110+0000 7fd3398d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:32.864 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:20:33.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:33.024+0000 7fab24991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:33.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:33.032+0000 7fab24991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:33.222 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.0 to 1 (10000) 2024-09-15T12:20:33.241 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-15T12:20:33.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:33.388+0000 7fb0ddd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:33.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:33.402+0000 7fb0ddd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:34.230 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.1 to 1 (10000) 2024-09-15T12:20:34.252 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-15T12:20:34.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:34.408+0000 7f1de1151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:34.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:34.419+0000 7f1de1151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:35.235 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.2 to 1 (10000) 2024-09-15T12:20:35.257 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-15T12:20:35.423 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:20:35.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:35.409+0000 7fb54ccfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:35.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:35.430+0000 7fb54ccfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:35.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:35.571+0000 7fedca6a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:35.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:35.578+0000 7fedca6a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:36.246 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.3 to 1 (10000) 2024-09-15T12:20:36.274 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-15T12:20:36.274 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:20:36.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:36.436+0000 7feee84bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:36.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:36.449+0000 7feee84bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:36.735 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:20:36.735 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:20:36.751 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2024-09-15T12:20:36.248759+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":889520691,"num_objects":13568,"num_object_clones":0,"num_object_copies":40704,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":13645,"num_write_kb":869204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13619,"ondisk_log_size":13619,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":294376,"kb_used_data":162088,"kb_used_omap":0,"kb_used_meta":132224,"kb_avail":377192984,"statfs":{"total":386547056640,"available":386245615616,"internally_reserved":0,"allocated":165978112,"data_stored":2642710885,"data_compressed":125481691,"data_compressed_allocated":165167104,"data_compressed_original":2642427904,"omap_allocated":0,"internal_metadata":135397376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.525380"},"pg_stats":[{"pgid":"3.f","version":"22'811","reported_seq":835,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.596667+0000","last_change":"2024-09-15T12:18:53.083350+0000","last_active":"2024-09-15T12:20:10.596667+0000","last_peered":"2024-09-15T12:20:10.596667+0000","last_clean":"2024-09-15T12:20:10.596667+0000","last_became_active":"2024-09-15T12:18:53.075051+0000","last_became_peered":"2024-09-15T12:18:53.075051+0000","last_unstale":"2024-09-15T12:20:10.596667+0000","last_undegraded":"2024-09-15T12:20:10.596667+0000","last_fullsized":"2024-09-15T12:20:10.596667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53149696,"num_objects":811,"num_object_clones":0,"num_object_copies":2433,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":811,"num_write_kb":51904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"22'796","reported_seq":820,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.560947+0000","last_change":"2024-09-15T12:18:53.139711+0000","last_active":"2024-09-15T12:20:10.560947+0000","last_peered":"2024-09-15T12:20:10.560947+0000","last_clean":"2024-09-15T12:20:10.560947+0000","last_became_active":"2024-09-15T12:18:53.130124+0000","last_became_peered":"2024-09-15T12:18:53.130124+0000","last_unstale":"2024-09-15T12:20:10.560947+0000","last_undegraded":"2024-09-15T12:20:10.560947+0000","last_fullsized":"2024-09-15T12:20:10.560947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":796,"log_dups_size":0,"ondisk_log_size":796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52166656,"num_objects":796,"num_object_clones":0,"num_object_copies":2388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":796,"num_write_kb":50944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'876","reported_seq":900,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.659893+0000","last_change":"2024-09-15T12:18:53.140327+0000","last_active":"2024-09-15T12:20:10.659893+0000","last_peered":"2024-09-15T12:20:10.659893+0000","last_clean":"2024-09-15T12:20:10.659893+0000","last_became_active":"2024-09-15T12:18:53.128935+0000","last_became_peered":"2024-09-15T12:18:53.128935+0000","last_unstale":"2024-09-15T12:20:10.659893+0000","last_undegraded":"2024-09-15T12:20:10.659893+0000","last_fullsized":"2024-09-15T12:20:10.659893+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":876,"log_dups_size":0,"ondisk_log_size":876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57409536,"num_objects":876,"num_object_clones":0,"num_object_copies":2628,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":876,"num_write_kb":56064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"22'857","reported_seq":881,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.646335+0000","last_change":"2024-09-15T12:18:53.138678+0000","last_active":"2024-09-15T12:20:10.646335+0000","last_peered":"2024-09-15T12:20:10.646335+0000","last_clean":"2024-09-15T12:20:10.646335+0000","last_became_active":"2024-09-15T12:18:53.129492+0000","last_became_peered":"2024-09-15T12:18:53.129492+0000","last_unstale":"2024-09-15T12:20:10.646335+0000","last_undegraded":"2024-09-15T12:20:10.646335+0000","last_fullsized":"2024-09-15T12:20:10.646335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56164352,"num_objects":857,"num_object_clones":0,"num_object_copies":2571,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":857,"num_write_kb":54848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'836","reported_seq":860,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:11.729081+0000","last_change":"2024-09-15T12:18:53.109204+0000","last_active":"2024-09-15T12:20:11.729081+0000","last_peered":"2024-09-15T12:20:11.729081+0000","last_clean":"2024-09-15T12:20:11.729081+0000","last_became_active":"2024-09-15T12:18:53.087134+0000","last_became_peered":"2024-09-15T12:18:53.087134+0000","last_unstale":"2024-09-15T12:20:11.729081+0000","last_undegraded":"2024-09-15T12:20:11.729081+0000","last_fullsized":"2024-09-15T12:20:11.729081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54788096,"num_objects":836,"num_object_clones":0,"num_object_copies":2508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":836,"num_write_kb":53504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"22'836","reported_seq":860,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.441343+0000","last_change":"2024-09-15T12:18:53.119675+0000","last_active":"2024-09-15T12:20:10.441343+0000","last_peered":"2024-09-15T12:20:10.441343+0000","last_clean":"2024-09-15T12:20:10.441343+0000","last_became_active":"2024-09-15T12:18:53.112010+0000","last_became_peered":"2024-09-15T12:18:53.112010+0000","last_unstale":"2024-09-15T12:20:10.441343+0000","last_undegraded":"2024-09-15T12:20:10.441343+0000","last_fullsized":"2024-09-15T12:20:10.441343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54788096,"num_objects":836,"num_object_clones":0,"num_object_copies":2508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":836,"num_write_kb":53504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"22'832","reported_seq":856,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.416212+0000","last_change":"2024-09-15T12:18:53.136381+0000","last_active":"2024-09-15T12:20:10.416212+0000","last_peered":"2024-09-15T12:20:10.416212+0000","last_clean":"2024-09-15T12:20:10.416212+0000","last_became_active":"2024-09-15T12:18:53.128765+0000","last_became_peered":"2024-09-15T12:18:53.128765+0000","last_unstale":"2024-09-15T12:20:10.416212+0000","last_undegraded":"2024-09-15T12:20:10.416212+0000","last_fullsized":"2024-09-15T12:20:10.416212+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":832,"num_object_clones":0,"num_object_copies":2496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":832,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"22'842","reported_seq":866,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.366734+0000","last_change":"2024-09-15T12:18:53.090984+0000","last_active":"2024-09-15T12:20:10.366734+0000","last_peered":"2024-09-15T12:20:10.366734+0000","last_clean":"2024-09-15T12:20:10.366734+0000","last_became_active":"2024-09-15T12:18:53.080676+0000","last_became_peered":"2024-09-15T12:18:53.080676+0000","last_unstale":"2024-09-15T12:20:10.366734+0000","last_undegraded":"2024-09-15T12:20:10.366734+0000","last_fullsized":"2024-09-15T12:20:10.366734+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":842,"log_dups_size":0,"ondisk_log_size":842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55181312,"num_objects":842,"num_object_clones":0,"num_object_copies":2526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":842,"num_write_kb":53888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":109,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.522583+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:20:03.522583+0000","last_peered":"2024-09-15T12:20:03.522583+0000","last_clean":"2024-09-15T12:20:03.522583+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:20:03.522583+0000","last_undegraded":"2024-09-15T12:20:03.522583+0000","last_fullsized":"2024-09-15T12:20:03.522583+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":38,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.545304+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:20:03.545304+0000","last_peered":"2024-09-15T12:20:03.545304+0000","last_clean":"2024-09-15T12:20:03.545304+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:20:03.545304+0000","last_undegraded":"2024-09-15T12:20:03.545304+0000","last_fullsized":"2024-09-15T12:20:03.545304+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"22'872","reported_seq":896,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.677176+0000","last_change":"2024-09-15T12:18:53.172532+0000","last_active":"2024-09-15T12:20:10.677176+0000","last_peered":"2024-09-15T12:20:10.677176+0000","last_clean":"2024-09-15T12:20:10.677176+0000","last_became_active":"2024-09-15T12:18:53.166197+0000","last_became_peered":"2024-09-15T12:18:53.166197+0000","last_unstale":"2024-09-15T12:20:10.677176+0000","last_undegraded":"2024-09-15T12:20:10.677176+0000","last_fullsized":"2024-09-15T12:20:10.677176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57147392,"num_objects":872,"num_object_clones":0,"num_object_copies":2616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":872,"num_write_kb":55808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.498796+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:20:03.498796+0000","last_peered":"2024-09-15T12:20:03.498796+0000","last_clean":"2024-09-15T12:20:03.498796+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:20:03.498796+0000","last_undegraded":"2024-09-15T12:20:03.498796+0000","last_fullsized":"2024-09-15T12:20:03.498796+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"22'823","reported_seq":847,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:11.541254+0000","last_change":"2024-09-15T12:18:53.161283+0000","last_active":"2024-09-15T12:20:11.541254+0000","last_peered":"2024-09-15T12:20:11.541254+0000","last_clean":"2024-09-15T12:20:11.541254+0000","last_became_active":"2024-09-15T12:18:53.149710+0000","last_became_peered":"2024-09-15T12:18:53.149710+0000","last_unstale":"2024-09-15T12:20:11.541254+0000","last_undegraded":"2024-09-15T12:20:11.541254+0000","last_fullsized":"2024-09-15T12:20:11.541254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53936128,"num_objects":823,"num_object_clones":0,"num_object_copies":2469,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":823,"num_write_kb":52672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.541630+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:20:03.541630+0000","last_peered":"2024-09-15T12:20:03.541630+0000","last_clean":"2024-09-15T12:20:03.541630+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:20:03.541630+0000","last_undegraded":"2024-09-15T12:20:03.541630+0000","last_fullsized":"2024-09-15T12:20:03.541630+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"22'869","reported_seq":893,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:11.664363+0000","last_change":"2024-09-15T12:18:53.169843+0000","last_active":"2024-09-15T12:20:11.664363+0000","last_peered":"2024-09-15T12:20:11.664363+0000","last_clean":"2024-09-15T12:20:11.664363+0000","last_became_active":"2024-09-15T12:18:53.161921+0000","last_became_peered":"2024-09-15T12:18:53.161921+0000","last_unstale":"2024-09-15T12:20:11.664363+0000","last_undegraded":"2024-09-15T12:20:11.664363+0000","last_fullsized":"2024-09-15T12:20:11.664363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56950784,"num_objects":869,"num_object_clones":0,"num_object_copies":2607,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":869,"num_write_kb":55616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":39,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.493324+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:20:03.493324+0000","last_peered":"2024-09-15T12:20:03.493324+0000","last_clean":"2024-09-15T12:20:03.493324+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:20:03.493324+0000","last_undegraded":"2024-09-15T12:20:03.493324+0000","last_fullsized":"2024-09-15T12:20:03.493324+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"22'859","reported_seq":883,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.634318+0000","last_change":"2024-09-15T12:18:53.100005+0000","last_active":"2024-09-15T12:20:10.634318+0000","last_peered":"2024-09-15T12:20:10.634318+0000","last_clean":"2024-09-15T12:20:10.634318+0000","last_became_active":"2024-09-15T12:18:53.080705+0000","last_became_peered":"2024-09-15T12:18:53.080705+0000","last_unstale":"2024-09-15T12:20:10.634318+0000","last_undegraded":"2024-09-15T12:20:10.634318+0000","last_fullsized":"2024-09-15T12:20:10.634318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":859,"log_dups_size":0,"ondisk_log_size":859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56295424,"num_objects":859,"num_object_clones":0,"num_object_copies":2577,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":859,"num_write_kb":54976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"22'856","reported_seq":880,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.340847+0000","last_change":"2024-09-15T12:18:53.122880+0000","last_active":"2024-09-15T12:20:10.340847+0000","last_peered":"2024-09-15T12:20:10.340847+0000","last_clean":"2024-09-15T12:20:10.340847+0000","last_became_active":"2024-09-15T12:18:53.111647+0000","last_became_peered":"2024-09-15T12:18:53.111647+0000","last_unstale":"2024-09-15T12:20:10.340847+0000","last_undegraded":"2024-09-15T12:20:10.340847+0000","last_fullsized":"2024-09-15T12:20:10.340847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":856,"log_dups_size":0,"ondisk_log_size":856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56098816,"num_objects":856,"num_object_clones":0,"num_object_copies":2568,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":54784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.523562+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:20:03.523562+0000","last_peered":"2024-09-15T12:20:03.523562+0000","last_clean":"2024-09-15T12:20:03.523562+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:20:03.523562+0000","last_undegraded":"2024-09-15T12:20:03.523562+0000","last_fullsized":"2024-09-15T12:20:03.523562+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"22'871","reported_seq":895,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.658348+0000","last_change":"2024-09-15T12:18:53.133542+0000","last_active":"2024-09-15T12:20:10.658348+0000","last_peered":"2024-09-15T12:20:10.658348+0000","last_clean":"2024-09-15T12:20:10.658348+0000","last_became_active":"2024-09-15T12:18:53.125716+0000","last_became_peered":"2024-09-15T12:18:53.125716+0000","last_unstale":"2024-09-15T12:20:10.658348+0000","last_undegraded":"2024-09-15T12:20:10.658348+0000","last_fullsized":"2024-09-15T12:20:10.658348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":871,"log_dups_size":0,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57081856,"num_objects":871,"num_object_clones":0,"num_object_copies":2613,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":871,"num_write_kb":55744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.527734+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:20:03.527734+0000","last_peered":"2024-09-15T12:20:03.527734+0000","last_clean":"2024-09-15T12:20:03.527734+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:20:03.527734+0000","last_undegraded":"2024-09-15T12:20:03.527734+0000","last_fullsized":"2024-09-15T12:20:03.527734+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"22'855","reported_seq":879,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:11.712022+0000","last_change":"2024-09-15T12:18:53.133963+0000","last_active":"2024-09-15T12:20:11.712022+0000","last_peered":"2024-09-15T12:20:11.712022+0000","last_clean":"2024-09-15T12:20:11.712022+0000","last_became_active":"2024-09-15T12:18:53.122383+0000","last_became_peered":"2024-09-15T12:18:53.122383+0000","last_unstale":"2024-09-15T12:20:11.712022+0000","last_undegraded":"2024-09-15T12:20:11.712022+0000","last_fullsized":"2024-09-15T12:20:11.712022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":855,"log_dups_size":0,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56033280,"num_objects":855,"num_object_clones":0,"num_object_copies":2565,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":855,"num_write_kb":54720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.528751+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:20:03.528751+0000","last_peered":"2024-09-15T12:20:03.528751+0000","last_clean":"2024-09-15T12:20:03.528751+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:20:03.528751+0000","last_undegraded":"2024-09-15T12:20:03.528751+0000","last_fullsized":"2024-09-15T12:20:03.528751+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"22'873","reported_seq":897,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.410772+0000","last_change":"2024-09-15T12:18:53.102960+0000","last_active":"2024-09-15T12:20:10.410772+0000","last_peered":"2024-09-15T12:20:10.410772+0000","last_clean":"2024-09-15T12:20:10.410772+0000","last_became_active":"2024-09-15T12:18:53.088807+0000","last_became_peered":"2024-09-15T12:18:53.088807+0000","last_unstale":"2024-09-15T12:20:10.410772+0000","last_undegraded":"2024-09-15T12:20:10.410772+0000","last_fullsized":"2024-09-15T12:20:10.410772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":873,"log_dups_size":0,"ondisk_log_size":873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57212928,"num_objects":873,"num_object_clones":0,"num_object_copies":2619,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":873,"num_write_kb":55872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.547011+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:20:03.547011+0000","last_peered":"2024-09-15T12:20:03.547011+0000","last_clean":"2024-09-15T12:20:03.547011+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:20:03.547011+0000","last_undegraded":"2024-09-15T12:20:03.547011+0000","last_fullsized":"2024-09-15T12:20:03.547011+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":888930304,"num_objects":13564,"num_object_clones":0,"num_object_copies":40692,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13564,"num_write_kb":868096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":166776832,"data_stored":2668429312,"data_compressed":126707971,"data_compressed_allocated":166776832,"data_compressed_original":2668429312,"omap_allocated":0,"internal_metadata":0},"log_size":13564,"ondisk_log_size":13564,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673049,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":87068,"kb_used_data":47756,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94284772,"statfs":{"total":96636764160,"available":96547606528,"internally_reserved":0,"allocated":48902144,"data_stored":779150547,"data_compressed":36996487,"data_compressed_allocated":48697344,"data_compressed_original":779075584,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68096,"kb_used_data":37104,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94303744,"statfs":{"total":96636764160,"available":96567033856,"internally_reserved":0,"allocated":37994496,"data_stored":604562662,"data_compressed":28706357,"data_compressed_allocated":37785600,"data_compressed_original":604487680,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71232,"kb_used_data":40240,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94300608,"statfs":{"total":96636764160,"available":96563822592,"internally_reserved":0,"allocated":41205760,"data_stored":656335558,"data_compressed":31162745,"data_compressed_allocated":41017344,"data_compressed_original":656277504,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":67980,"kb_used_data":36988,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94303860,"statfs":{"total":96636764160,"available":96567152640,"internally_reserved":0,"allocated":37875712,"data_stored":602662118,"data_compressed":28616102,"data_compressed_allocated":37666816,"data_compressed_original":602587136,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38080512,"data_stored":609288192,"data_compressed":28931502,"data_compressed_allocated":38080512,"data_compressed_original":609288192,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41414656,"data_stored":662634496,"data_compressed":31464609,"data_compressed_allocated":41414656,"data_compressed_original":662634496,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":38129664,"data_stored":610074624,"data_compressed":28968853,"data_compressed_allocated":38129664,"data_compressed_original":610074624,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152000,"data_stored":786432000,"data_compressed":37343007,"data_compressed_allocated":49152000,"data_compressed_original":786432000,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:20:36.752 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:20:36.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:36.898+0000 7f7f726bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:36.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:36.909+0000 7f7f726bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:37.182 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:20:37.183 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:20:37.201 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2024-09-15T12:20:36.248759+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":889520691,"num_objects":13568,"num_object_clones":0,"num_object_copies":40704,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":13645,"num_write_kb":869204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13619,"ondisk_log_size":13619,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":294376,"kb_used_data":162088,"kb_used_omap":0,"kb_used_meta":132224,"kb_avail":377192984,"statfs":{"total":386547056640,"available":386245615616,"internally_reserved":0,"allocated":165978112,"data_stored":2642710885,"data_compressed":125481691,"data_compressed_allocated":165167104,"data_compressed_original":2642427904,"omap_allocated":0,"internal_metadata":135397376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.525380"},"pg_stats":[{"pgid":"3.f","version":"22'811","reported_seq":835,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.596667+0000","last_change":"2024-09-15T12:18:53.083350+0000","last_active":"2024-09-15T12:20:10.596667+0000","last_peered":"2024-09-15T12:20:10.596667+0000","last_clean":"2024-09-15T12:20:10.596667+0000","last_became_active":"2024-09-15T12:18:53.075051+0000","last_became_peered":"2024-09-15T12:18:53.075051+0000","last_unstale":"2024-09-15T12:20:10.596667+0000","last_undegraded":"2024-09-15T12:20:10.596667+0000","last_fullsized":"2024-09-15T12:20:10.596667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53149696,"num_objects":811,"num_object_clones":0,"num_object_copies":2433,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":811,"num_write_kb":51904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"22'796","reported_seq":820,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.560947+0000","last_change":"2024-09-15T12:18:53.139711+0000","last_active":"2024-09-15T12:20:10.560947+0000","last_peered":"2024-09-15T12:20:10.560947+0000","last_clean":"2024-09-15T12:20:10.560947+0000","last_became_active":"2024-09-15T12:18:53.130124+0000","last_became_peered":"2024-09-15T12:18:53.130124+0000","last_unstale":"2024-09-15T12:20:10.560947+0000","last_undegraded":"2024-09-15T12:20:10.560947+0000","last_fullsized":"2024-09-15T12:20:10.560947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":796,"log_dups_size":0,"ondisk_log_size":796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52166656,"num_objects":796,"num_object_clones":0,"num_object_copies":2388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":796,"num_write_kb":50944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'876","reported_seq":900,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.659893+0000","last_change":"2024-09-15T12:18:53.140327+0000","last_active":"2024-09-15T12:20:10.659893+0000","last_peered":"2024-09-15T12:20:10.659893+0000","last_clean":"2024-09-15T12:20:10.659893+0000","last_became_active":"2024-09-15T12:18:53.128935+0000","last_became_peered":"2024-09-15T12:18:53.128935+0000","last_unstale":"2024-09-15T12:20:10.659893+0000","last_undegraded":"2024-09-15T12:20:10.659893+0000","last_fullsized":"2024-09-15T12:20:10.659893+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":876,"log_dups_size":0,"ondisk_log_size":876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57409536,"num_objects":876,"num_object_clones":0,"num_object_copies":2628,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":876,"num_write_kb":56064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"22'857","reported_seq":881,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.646335+0000","last_change":"2024-09-15T12:18:53.138678+0000","last_active":"2024-09-15T12:20:10.646335+0000","last_peered":"2024-09-15T12:20:10.646335+0000","last_clean":"2024-09-15T12:20:10.646335+0000","last_became_active":"2024-09-15T12:18:53.129492+0000","last_became_peered":"2024-09-15T12:18:53.129492+0000","last_unstale":"2024-09-15T12:20:10.646335+0000","last_undegraded":"2024-09-15T12:20:10.646335+0000","last_fullsized":"2024-09-15T12:20:10.646335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56164352,"num_objects":857,"num_object_clones":0,"num_object_copies":2571,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":857,"num_write_kb":54848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'836","reported_seq":860,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:11.729081+0000","last_change":"2024-09-15T12:18:53.109204+0000","last_active":"2024-09-15T12:20:11.729081+0000","last_peered":"2024-09-15T12:20:11.729081+0000","last_clean":"2024-09-15T12:20:11.729081+0000","last_became_active":"2024-09-15T12:18:53.087134+0000","last_became_peered":"2024-09-15T12:18:53.087134+0000","last_unstale":"2024-09-15T12:20:11.729081+0000","last_undegraded":"2024-09-15T12:20:11.729081+0000","last_fullsized":"2024-09-15T12:20:11.729081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54788096,"num_objects":836,"num_object_clones":0,"num_object_copies":2508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":836,"num_write_kb":53504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"22'836","reported_seq":860,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.441343+0000","last_change":"2024-09-15T12:18:53.119675+0000","last_active":"2024-09-15T12:20:10.441343+0000","last_peered":"2024-09-15T12:20:10.441343+0000","last_clean":"2024-09-15T12:20:10.441343+0000","last_became_active":"2024-09-15T12:18:53.112010+0000","last_became_peered":"2024-09-15T12:18:53.112010+0000","last_unstale":"2024-09-15T12:20:10.441343+0000","last_undegraded":"2024-09-15T12:20:10.441343+0000","last_fullsized":"2024-09-15T12:20:10.441343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54788096,"num_objects":836,"num_object_clones":0,"num_object_copies":2508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":836,"num_write_kb":53504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"22'832","reported_seq":856,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.416212+0000","last_change":"2024-09-15T12:18:53.136381+0000","last_active":"2024-09-15T12:20:10.416212+0000","last_peered":"2024-09-15T12:20:10.416212+0000","last_clean":"2024-09-15T12:20:10.416212+0000","last_became_active":"2024-09-15T12:18:53.128765+0000","last_became_peered":"2024-09-15T12:18:53.128765+0000","last_unstale":"2024-09-15T12:20:10.416212+0000","last_undegraded":"2024-09-15T12:20:10.416212+0000","last_fullsized":"2024-09-15T12:20:10.416212+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":832,"num_object_clones":0,"num_object_copies":2496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":832,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"22'842","reported_seq":866,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.366734+0000","last_change":"2024-09-15T12:18:53.090984+0000","last_active":"2024-09-15T12:20:10.366734+0000","last_peered":"2024-09-15T12:20:10.366734+0000","last_clean":"2024-09-15T12:20:10.366734+0000","last_became_active":"2024-09-15T12:18:53.080676+0000","last_became_peered":"2024-09-15T12:18:53.080676+0000","last_unstale":"2024-09-15T12:20:10.366734+0000","last_undegraded":"2024-09-15T12:20:10.366734+0000","last_fullsized":"2024-09-15T12:20:10.366734+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":842,"log_dups_size":0,"ondisk_log_size":842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55181312,"num_objects":842,"num_object_clones":0,"num_object_copies":2526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":842,"num_write_kb":53888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":109,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.522583+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:20:03.522583+0000","last_peered":"2024-09-15T12:20:03.522583+0000","last_clean":"2024-09-15T12:20:03.522583+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:20:03.522583+0000","last_undegraded":"2024-09-15T12:20:03.522583+0000","last_fullsized":"2024-09-15T12:20:03.522583+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":38,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.545304+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:20:03.545304+0000","last_peered":"2024-09-15T12:20:03.545304+0000","last_clean":"2024-09-15T12:20:03.545304+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:20:03.545304+0000","last_undegraded":"2024-09-15T12:20:03.545304+0000","last_fullsized":"2024-09-15T12:20:03.545304+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"22'872","reported_seq":896,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.677176+0000","last_change":"2024-09-15T12:18:53.172532+0000","last_active":"2024-09-15T12:20:10.677176+0000","last_peered":"2024-09-15T12:20:10.677176+0000","last_clean":"2024-09-15T12:20:10.677176+0000","last_became_active":"2024-09-15T12:18:53.166197+0000","last_became_peered":"2024-09-15T12:18:53.166197+0000","last_unstale":"2024-09-15T12:20:10.677176+0000","last_undegraded":"2024-09-15T12:20:10.677176+0000","last_fullsized":"2024-09-15T12:20:10.677176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57147392,"num_objects":872,"num_object_clones":0,"num_object_copies":2616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":872,"num_write_kb":55808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.498796+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:20:03.498796+0000","last_peered":"2024-09-15T12:20:03.498796+0000","last_clean":"2024-09-15T12:20:03.498796+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:20:03.498796+0000","last_undegraded":"2024-09-15T12:20:03.498796+0000","last_fullsized":"2024-09-15T12:20:03.498796+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"22'823","reported_seq":847,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:11.541254+0000","last_change":"2024-09-15T12:18:53.161283+0000","last_active":"2024-09-15T12:20:11.541254+0000","last_peered":"2024-09-15T12:20:11.541254+0000","last_clean":"2024-09-15T12:20:11.541254+0000","last_became_active":"2024-09-15T12:18:53.149710+0000","last_became_peered":"2024-09-15T12:18:53.149710+0000","last_unstale":"2024-09-15T12:20:11.541254+0000","last_undegraded":"2024-09-15T12:20:11.541254+0000","last_fullsized":"2024-09-15T12:20:11.541254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53936128,"num_objects":823,"num_object_clones":0,"num_object_copies":2469,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":823,"num_write_kb":52672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.541630+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:20:03.541630+0000","last_peered":"2024-09-15T12:20:03.541630+0000","last_clean":"2024-09-15T12:20:03.541630+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:20:03.541630+0000","last_undegraded":"2024-09-15T12:20:03.541630+0000","last_fullsized":"2024-09-15T12:20:03.541630+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"22'869","reported_seq":893,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:11.664363+0000","last_change":"2024-09-15T12:18:53.169843+0000","last_active":"2024-09-15T12:20:11.664363+0000","last_peered":"2024-09-15T12:20:11.664363+0000","last_clean":"2024-09-15T12:20:11.664363+0000","last_became_active":"2024-09-15T12:18:53.161921+0000","last_became_peered":"2024-09-15T12:18:53.161921+0000","last_unstale":"2024-09-15T12:20:11.664363+0000","last_undegraded":"2024-09-15T12:20:11.664363+0000","last_fullsized":"2024-09-15T12:20:11.664363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56950784,"num_objects":869,"num_object_clones":0,"num_object_copies":2607,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":869,"num_write_kb":55616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":39,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.493324+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:20:03.493324+0000","last_peered":"2024-09-15T12:20:03.493324+0000","last_clean":"2024-09-15T12:20:03.493324+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:20:03.493324+0000","last_undegraded":"2024-09-15T12:20:03.493324+0000","last_fullsized":"2024-09-15T12:20:03.493324+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"22'859","reported_seq":883,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.634318+0000","last_change":"2024-09-15T12:18:53.100005+0000","last_active":"2024-09-15T12:20:10.634318+0000","last_peered":"2024-09-15T12:20:10.634318+0000","last_clean":"2024-09-15T12:20:10.634318+0000","last_became_active":"2024-09-15T12:18:53.080705+0000","last_became_peered":"2024-09-15T12:18:53.080705+0000","last_unstale":"2024-09-15T12:20:10.634318+0000","last_undegraded":"2024-09-15T12:20:10.634318+0000","last_fullsized":"2024-09-15T12:20:10.634318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":859,"log_dups_size":0,"ondisk_log_size":859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56295424,"num_objects":859,"num_object_clones":0,"num_object_copies":2577,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":859,"num_write_kb":54976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"22'856","reported_seq":880,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.340847+0000","last_change":"2024-09-15T12:18:53.122880+0000","last_active":"2024-09-15T12:20:10.340847+0000","last_peered":"2024-09-15T12:20:10.340847+0000","last_clean":"2024-09-15T12:20:10.340847+0000","last_became_active":"2024-09-15T12:18:53.111647+0000","last_became_peered":"2024-09-15T12:18:53.111647+0000","last_unstale":"2024-09-15T12:20:10.340847+0000","last_undegraded":"2024-09-15T12:20:10.340847+0000","last_fullsized":"2024-09-15T12:20:10.340847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":856,"log_dups_size":0,"ondisk_log_size":856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56098816,"num_objects":856,"num_object_clones":0,"num_object_copies":2568,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":54784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.523562+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:20:03.523562+0000","last_peered":"2024-09-15T12:20:03.523562+0000","last_clean":"2024-09-15T12:20:03.523562+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:20:03.523562+0000","last_undegraded":"2024-09-15T12:20:03.523562+0000","last_fullsized":"2024-09-15T12:20:03.523562+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"22'871","reported_seq":895,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.658348+0000","last_change":"2024-09-15T12:18:53.133542+0000","last_active":"2024-09-15T12:20:10.658348+0000","last_peered":"2024-09-15T12:20:10.658348+0000","last_clean":"2024-09-15T12:20:10.658348+0000","last_became_active":"2024-09-15T12:18:53.125716+0000","last_became_peered":"2024-09-15T12:18:53.125716+0000","last_unstale":"2024-09-15T12:20:10.658348+0000","last_undegraded":"2024-09-15T12:20:10.658348+0000","last_fullsized":"2024-09-15T12:20:10.658348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":871,"log_dups_size":0,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57081856,"num_objects":871,"num_object_clones":0,"num_object_copies":2613,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":871,"num_write_kb":55744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.527734+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:20:03.527734+0000","last_peered":"2024-09-15T12:20:03.527734+0000","last_clean":"2024-09-15T12:20:03.527734+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:20:03.527734+0000","last_undegraded":"2024-09-15T12:20:03.527734+0000","last_fullsized":"2024-09-15T12:20:03.527734+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"22'855","reported_seq":879,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:11.712022+0000","last_change":"2024-09-15T12:18:53.133963+0000","last_active":"2024-09-15T12:20:11.712022+0000","last_peered":"2024-09-15T12:20:11.712022+0000","last_clean":"2024-09-15T12:20:11.712022+0000","last_became_active":"2024-09-15T12:18:53.122383+0000","last_became_peered":"2024-09-15T12:18:53.122383+0000","last_unstale":"2024-09-15T12:20:11.712022+0000","last_undegraded":"2024-09-15T12:20:11.712022+0000","last_fullsized":"2024-09-15T12:20:11.712022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":855,"log_dups_size":0,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56033280,"num_objects":855,"num_object_clones":0,"num_object_copies":2565,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":855,"num_write_kb":54720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.528751+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:20:03.528751+0000","last_peered":"2024-09-15T12:20:03.528751+0000","last_clean":"2024-09-15T12:20:03.528751+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:20:03.528751+0000","last_undegraded":"2024-09-15T12:20:03.528751+0000","last_fullsized":"2024-09-15T12:20:03.528751+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"22'873","reported_seq":897,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.410772+0000","last_change":"2024-09-15T12:18:53.102960+0000","last_active":"2024-09-15T12:20:10.410772+0000","last_peered":"2024-09-15T12:20:10.410772+0000","last_clean":"2024-09-15T12:20:10.410772+0000","last_became_active":"2024-09-15T12:18:53.088807+0000","last_became_peered":"2024-09-15T12:18:53.088807+0000","last_unstale":"2024-09-15T12:20:10.410772+0000","last_undegraded":"2024-09-15T12:20:10.410772+0000","last_fullsized":"2024-09-15T12:20:10.410772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":873,"log_dups_size":0,"ondisk_log_size":873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57212928,"num_objects":873,"num_object_clones":0,"num_object_copies":2619,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":873,"num_write_kb":55872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.547011+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:20:03.547011+0000","last_peered":"2024-09-15T12:20:03.547011+0000","last_clean":"2024-09-15T12:20:03.547011+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:20:03.547011+0000","last_undegraded":"2024-09-15T12:20:03.547011+0000","last_fullsized":"2024-09-15T12:20:03.547011+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":888930304,"num_objects":13564,"num_object_clones":0,"num_object_copies":40692,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13564,"num_write_kb":868096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":166776832,"data_stored":2668429312,"data_compressed":126707971,"data_compressed_allocated":166776832,"data_compressed_original":2668429312,"omap_allocated":0,"internal_metadata":0},"log_size":13564,"ondisk_log_size":13564,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673049,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":87068,"kb_used_data":47756,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94284772,"statfs":{"total":96636764160,"available":96547606528,"internally_reserved":0,"allocated":48902144,"data_stored":779150547,"data_compressed":36996487,"data_compressed_allocated":48697344,"data_compressed_original":779075584,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68096,"kb_used_data":37104,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94303744,"statfs":{"total":96636764160,"available":96567033856,"internally_reserved":0,"allocated":37994496,"data_stored":604562662,"data_compressed":28706357,"data_compressed_allocated":37785600,"data_compressed_original":604487680,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71232,"kb_used_data":40240,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94300608,"statfs":{"total":96636764160,"available":96563822592,"internally_reserved":0,"allocated":41205760,"data_stored":656335558,"data_compressed":31162745,"data_compressed_allocated":41017344,"data_compressed_original":656277504,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":67980,"kb_used_data":36988,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94303860,"statfs":{"total":96636764160,"available":96567152640,"internally_reserved":0,"allocated":37875712,"data_stored":602662118,"data_compressed":28616102,"data_compressed_allocated":37666816,"data_compressed_original":602587136,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38080512,"data_stored":609288192,"data_compressed":28931502,"data_compressed_allocated":38080512,"data_compressed_original":609288192,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41414656,"data_stored":662634496,"data_compressed":31464609,"data_compressed_allocated":41414656,"data_compressed_original":662634496,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":38129664,"data_stored":610074624,"data_compressed":28968853,"data_compressed_allocated":38129664,"data_compressed_original":610074624,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152000,"data_stored":786432000,"data_compressed":37343007,"data_compressed_allocated":49152000,"data_compressed_original":786432000,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:20:37.202 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-15T12:20:37.203 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:20:37.203 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:20:37.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:37.348+0000 7f262bea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:37.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:37.362+0000 7f262bea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:37.668 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:20:37.668 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:20:37.684 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2024-09-15T12:20:36.248759+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":889520691,"num_objects":13568,"num_object_clones":0,"num_object_copies":40704,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":13645,"num_write_kb":869204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13619,"ondisk_log_size":13619,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":294376,"kb_used_data":162088,"kb_used_omap":0,"kb_used_meta":132224,"kb_avail":377192984,"statfs":{"total":386547056640,"available":386245615616,"internally_reserved":0,"allocated":165978112,"data_stored":2642710885,"data_compressed":125481691,"data_compressed_allocated":165167104,"data_compressed_original":2642427904,"omap_allocated":0,"internal_metadata":135397376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.525380"},"pg_stats":[{"pgid":"3.f","version":"22'811","reported_seq":835,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.596667+0000","last_change":"2024-09-15T12:18:53.083350+0000","last_active":"2024-09-15T12:20:10.596667+0000","last_peered":"2024-09-15T12:20:10.596667+0000","last_clean":"2024-09-15T12:20:10.596667+0000","last_became_active":"2024-09-15T12:18:53.075051+0000","last_became_peered":"2024-09-15T12:18:53.075051+0000","last_unstale":"2024-09-15T12:20:10.596667+0000","last_undegraded":"2024-09-15T12:20:10.596667+0000","last_fullsized":"2024-09-15T12:20:10.596667+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53149696,"num_objects":811,"num_object_clones":0,"num_object_copies":2433,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":811,"num_write_kb":51904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"22'796","reported_seq":820,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.560947+0000","last_change":"2024-09-15T12:18:53.139711+0000","last_active":"2024-09-15T12:20:10.560947+0000","last_peered":"2024-09-15T12:20:10.560947+0000","last_clean":"2024-09-15T12:20:10.560947+0000","last_became_active":"2024-09-15T12:18:53.130124+0000","last_became_peered":"2024-09-15T12:18:53.130124+0000","last_unstale":"2024-09-15T12:20:10.560947+0000","last_undegraded":"2024-09-15T12:20:10.560947+0000","last_fullsized":"2024-09-15T12:20:10.560947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":796,"log_dups_size":0,"ondisk_log_size":796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52166656,"num_objects":796,"num_object_clones":0,"num_object_copies":2388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":796,"num_write_kb":50944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'876","reported_seq":900,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.659893+0000","last_change":"2024-09-15T12:18:53.140327+0000","last_active":"2024-09-15T12:20:10.659893+0000","last_peered":"2024-09-15T12:20:10.659893+0000","last_clean":"2024-09-15T12:20:10.659893+0000","last_became_active":"2024-09-15T12:18:53.128935+0000","last_became_peered":"2024-09-15T12:18:53.128935+0000","last_unstale":"2024-09-15T12:20:10.659893+0000","last_undegraded":"2024-09-15T12:20:10.659893+0000","last_fullsized":"2024-09-15T12:20:10.659893+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":876,"log_dups_size":0,"ondisk_log_size":876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57409536,"num_objects":876,"num_object_clones":0,"num_object_copies":2628,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":876,"num_write_kb":56064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"22'857","reported_seq":881,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.646335+0000","last_change":"2024-09-15T12:18:53.138678+0000","last_active":"2024-09-15T12:20:10.646335+0000","last_peered":"2024-09-15T12:20:10.646335+0000","last_clean":"2024-09-15T12:20:10.646335+0000","last_became_active":"2024-09-15T12:18:53.129492+0000","last_became_peered":"2024-09-15T12:18:53.129492+0000","last_unstale":"2024-09-15T12:20:10.646335+0000","last_undegraded":"2024-09-15T12:20:10.646335+0000","last_fullsized":"2024-09-15T12:20:10.646335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":857,"log_dups_size":0,"ondisk_log_size":857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56164352,"num_objects":857,"num_object_clones":0,"num_object_copies":2571,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":857,"num_write_kb":54848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'836","reported_seq":860,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:11.729081+0000","last_change":"2024-09-15T12:18:53.109204+0000","last_active":"2024-09-15T12:20:11.729081+0000","last_peered":"2024-09-15T12:20:11.729081+0000","last_clean":"2024-09-15T12:20:11.729081+0000","last_became_active":"2024-09-15T12:18:53.087134+0000","last_became_peered":"2024-09-15T12:18:53.087134+0000","last_unstale":"2024-09-15T12:20:11.729081+0000","last_undegraded":"2024-09-15T12:20:11.729081+0000","last_fullsized":"2024-09-15T12:20:11.729081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54788096,"num_objects":836,"num_object_clones":0,"num_object_copies":2508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":836,"num_write_kb":53504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"22'836","reported_seq":860,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.441343+0000","last_change":"2024-09-15T12:18:53.119675+0000","last_active":"2024-09-15T12:20:10.441343+0000","last_peered":"2024-09-15T12:20:10.441343+0000","last_clean":"2024-09-15T12:20:10.441343+0000","last_became_active":"2024-09-15T12:18:53.112010+0000","last_became_peered":"2024-09-15T12:18:53.112010+0000","last_unstale":"2024-09-15T12:20:10.441343+0000","last_undegraded":"2024-09-15T12:20:10.441343+0000","last_fullsized":"2024-09-15T12:20:10.441343+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54788096,"num_objects":836,"num_object_clones":0,"num_object_copies":2508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":836,"num_write_kb":53504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"22'832","reported_seq":856,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.416212+0000","last_change":"2024-09-15T12:18:53.136381+0000","last_active":"2024-09-15T12:20:10.416212+0000","last_peered":"2024-09-15T12:20:10.416212+0000","last_clean":"2024-09-15T12:20:10.416212+0000","last_became_active":"2024-09-15T12:18:53.128765+0000","last_became_peered":"2024-09-15T12:18:53.128765+0000","last_unstale":"2024-09-15T12:20:10.416212+0000","last_undegraded":"2024-09-15T12:20:10.416212+0000","last_fullsized":"2024-09-15T12:20:10.416212+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":832,"num_object_clones":0,"num_object_copies":2496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":832,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"22'842","reported_seq":866,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.366734+0000","last_change":"2024-09-15T12:18:53.090984+0000","last_active":"2024-09-15T12:20:10.366734+0000","last_peered":"2024-09-15T12:20:10.366734+0000","last_clean":"2024-09-15T12:20:10.366734+0000","last_became_active":"2024-09-15T12:18:53.080676+0000","last_became_peered":"2024-09-15T12:18:53.080676+0000","last_unstale":"2024-09-15T12:20:10.366734+0000","last_undegraded":"2024-09-15T12:20:10.366734+0000","last_fullsized":"2024-09-15T12:20:10.366734+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":842,"log_dups_size":0,"ondisk_log_size":842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55181312,"num_objects":842,"num_object_clones":0,"num_object_copies":2526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":842,"num_write_kb":53888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":109,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.522583+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:20:03.522583+0000","last_peered":"2024-09-15T12:20:03.522583+0000","last_clean":"2024-09-15T12:20:03.522583+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:20:03.522583+0000","last_undegraded":"2024-09-15T12:20:03.522583+0000","last_fullsized":"2024-09-15T12:20:03.522583+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":38,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.545304+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:20:03.545304+0000","last_peered":"2024-09-15T12:20:03.545304+0000","last_clean":"2024-09-15T12:20:03.545304+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:20:03.545304+0000","last_undegraded":"2024-09-15T12:20:03.545304+0000","last_fullsized":"2024-09-15T12:20:03.545304+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"22'872","reported_seq":896,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.677176+0000","last_change":"2024-09-15T12:18:53.172532+0000","last_active":"2024-09-15T12:20:10.677176+0000","last_peered":"2024-09-15T12:20:10.677176+0000","last_clean":"2024-09-15T12:20:10.677176+0000","last_became_active":"2024-09-15T12:18:53.166197+0000","last_became_peered":"2024-09-15T12:18:53.166197+0000","last_unstale":"2024-09-15T12:20:10.677176+0000","last_undegraded":"2024-09-15T12:20:10.677176+0000","last_fullsized":"2024-09-15T12:20:10.677176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":872,"log_dups_size":0,"ondisk_log_size":872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57147392,"num_objects":872,"num_object_clones":0,"num_object_copies":2616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":872,"num_write_kb":55808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.498796+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:20:03.498796+0000","last_peered":"2024-09-15T12:20:03.498796+0000","last_clean":"2024-09-15T12:20:03.498796+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:20:03.498796+0000","last_undegraded":"2024-09-15T12:20:03.498796+0000","last_fullsized":"2024-09-15T12:20:03.498796+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"22'823","reported_seq":847,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:11.541254+0000","last_change":"2024-09-15T12:18:53.161283+0000","last_active":"2024-09-15T12:20:11.541254+0000","last_peered":"2024-09-15T12:20:11.541254+0000","last_clean":"2024-09-15T12:20:11.541254+0000","last_became_active":"2024-09-15T12:18:53.149710+0000","last_became_peered":"2024-09-15T12:18:53.149710+0000","last_unstale":"2024-09-15T12:20:11.541254+0000","last_undegraded":"2024-09-15T12:20:11.541254+0000","last_fullsized":"2024-09-15T12:20:11.541254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53936128,"num_objects":823,"num_object_clones":0,"num_object_copies":2469,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":823,"num_write_kb":52672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.541630+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:20:03.541630+0000","last_peered":"2024-09-15T12:20:03.541630+0000","last_clean":"2024-09-15T12:20:03.541630+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:20:03.541630+0000","last_undegraded":"2024-09-15T12:20:03.541630+0000","last_fullsized":"2024-09-15T12:20:03.541630+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"22'869","reported_seq":893,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:11.664363+0000","last_change":"2024-09-15T12:18:53.169843+0000","last_active":"2024-09-15T12:20:11.664363+0000","last_peered":"2024-09-15T12:20:11.664363+0000","last_clean":"2024-09-15T12:20:11.664363+0000","last_became_active":"2024-09-15T12:18:53.161921+0000","last_became_peered":"2024-09-15T12:18:53.161921+0000","last_unstale":"2024-09-15T12:20:11.664363+0000","last_undegraded":"2024-09-15T12:20:11.664363+0000","last_fullsized":"2024-09-15T12:20:11.664363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56950784,"num_objects":869,"num_object_clones":0,"num_object_copies":2607,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":869,"num_write_kb":55616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":39,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.493324+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:20:03.493324+0000","last_peered":"2024-09-15T12:20:03.493324+0000","last_clean":"2024-09-15T12:20:03.493324+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:20:03.493324+0000","last_undegraded":"2024-09-15T12:20:03.493324+0000","last_fullsized":"2024-09-15T12:20:03.493324+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"22'859","reported_seq":883,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.634318+0000","last_change":"2024-09-15T12:18:53.100005+0000","last_active":"2024-09-15T12:20:10.634318+0000","last_peered":"2024-09-15T12:20:10.634318+0000","last_clean":"2024-09-15T12:20:10.634318+0000","last_became_active":"2024-09-15T12:18:53.080705+0000","last_became_peered":"2024-09-15T12:18:53.080705+0000","last_unstale":"2024-09-15T12:20:10.634318+0000","last_undegraded":"2024-09-15T12:20:10.634318+0000","last_fullsized":"2024-09-15T12:20:10.634318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":859,"log_dups_size":0,"ondisk_log_size":859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56295424,"num_objects":859,"num_object_clones":0,"num_object_copies":2577,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":859,"num_write_kb":54976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"22'856","reported_seq":880,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.340847+0000","last_change":"2024-09-15T12:18:53.122880+0000","last_active":"2024-09-15T12:20:10.340847+0000","last_peered":"2024-09-15T12:20:10.340847+0000","last_clean":"2024-09-15T12:20:10.340847+0000","last_became_active":"2024-09-15T12:18:53.111647+0000","last_became_peered":"2024-09-15T12:18:53.111647+0000","last_unstale":"2024-09-15T12:20:10.340847+0000","last_undegraded":"2024-09-15T12:20:10.340847+0000","last_fullsized":"2024-09-15T12:20:10.340847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":856,"log_dups_size":0,"ondisk_log_size":856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56098816,"num_objects":856,"num_object_clones":0,"num_object_copies":2568,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":856,"num_write_kb":54784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.523562+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:20:03.523562+0000","last_peered":"2024-09-15T12:20:03.523562+0000","last_clean":"2024-09-15T12:20:03.523562+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:20:03.523562+0000","last_undegraded":"2024-09-15T12:20:03.523562+0000","last_fullsized":"2024-09-15T12:20:03.523562+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"22'871","reported_seq":895,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.658348+0000","last_change":"2024-09-15T12:18:53.133542+0000","last_active":"2024-09-15T12:20:10.658348+0000","last_peered":"2024-09-15T12:20:10.658348+0000","last_clean":"2024-09-15T12:20:10.658348+0000","last_became_active":"2024-09-15T12:18:53.125716+0000","last_became_peered":"2024-09-15T12:18:53.125716+0000","last_unstale":"2024-09-15T12:20:10.658348+0000","last_undegraded":"2024-09-15T12:20:10.658348+0000","last_fullsized":"2024-09-15T12:20:10.658348+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":871,"log_dups_size":0,"ondisk_log_size":871,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57081856,"num_objects":871,"num_object_clones":0,"num_object_copies":2613,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":871,"num_write_kb":55744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.527734+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:20:03.527734+0000","last_peered":"2024-09-15T12:20:03.527734+0000","last_clean":"2024-09-15T12:20:03.527734+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:20:03.527734+0000","last_undegraded":"2024-09-15T12:20:03.527734+0000","last_fullsized":"2024-09-15T12:20:03.527734+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"22'855","reported_seq":879,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:11.712022+0000","last_change":"2024-09-15T12:18:53.133963+0000","last_active":"2024-09-15T12:20:11.712022+0000","last_peered":"2024-09-15T12:20:11.712022+0000","last_clean":"2024-09-15T12:20:11.712022+0000","last_became_active":"2024-09-15T12:18:53.122383+0000","last_became_peered":"2024-09-15T12:18:53.122383+0000","last_unstale":"2024-09-15T12:20:11.712022+0000","last_undegraded":"2024-09-15T12:20:11.712022+0000","last_fullsized":"2024-09-15T12:20:11.712022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":855,"log_dups_size":0,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56033280,"num_objects":855,"num_object_clones":0,"num_object_copies":2565,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":855,"num_write_kb":54720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.528751+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:20:03.528751+0000","last_peered":"2024-09-15T12:20:03.528751+0000","last_clean":"2024-09-15T12:20:03.528751+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:20:03.528751+0000","last_undegraded":"2024-09-15T12:20:03.528751+0000","last_fullsized":"2024-09-15T12:20:03.528751+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"22'873","reported_seq":897,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:10.410772+0000","last_change":"2024-09-15T12:18:53.102960+0000","last_active":"2024-09-15T12:20:10.410772+0000","last_peered":"2024-09-15T12:20:10.410772+0000","last_clean":"2024-09-15T12:20:10.410772+0000","last_became_active":"2024-09-15T12:18:53.088807+0000","last_became_peered":"2024-09-15T12:18:53.088807+0000","last_unstale":"2024-09-15T12:20:10.410772+0000","last_undegraded":"2024-09-15T12:20:10.410772+0000","last_fullsized":"2024-09-15T12:20:10.410772+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":873,"log_dups_size":0,"ondisk_log_size":873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57212928,"num_objects":873,"num_object_clones":0,"num_object_copies":2619,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":873,"num_write_kb":55872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.547011+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:20:03.547011+0000","last_peered":"2024-09-15T12:20:03.547011+0000","last_clean":"2024-09-15T12:20:03.547011+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:20:03.547011+0000","last_undegraded":"2024-09-15T12:20:03.547011+0000","last_fullsized":"2024-09-15T12:20:03.547011+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":888930304,"num_objects":13564,"num_object_clones":0,"num_object_copies":40692,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13564,"num_write_kb":868096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":166776832,"data_stored":2668429312,"data_compressed":126707971,"data_compressed_allocated":166776832,"data_compressed_original":2668429312,"omap_allocated":0,"internal_metadata":0},"log_size":13564,"ondisk_log_size":13564,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673049,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":87068,"kb_used_data":47756,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94284772,"statfs":{"total":96636764160,"available":96547606528,"internally_reserved":0,"allocated":48902144,"data_stored":779150547,"data_compressed":36996487,"data_compressed_allocated":48697344,"data_compressed_original":779075584,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68096,"kb_used_data":37104,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94303744,"statfs":{"total":96636764160,"available":96567033856,"internally_reserved":0,"allocated":37994496,"data_stored":604562662,"data_compressed":28706357,"data_compressed_allocated":37785600,"data_compressed_original":604487680,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":71232,"kb_used_data":40240,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94300608,"statfs":{"total":96636764160,"available":96563822592,"internally_reserved":0,"allocated":41205760,"data_stored":656335558,"data_compressed":31162745,"data_compressed_allocated":41017344,"data_compressed_original":656277504,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":67980,"kb_used_data":36988,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94303860,"statfs":{"total":96636764160,"available":96567152640,"internally_reserved":0,"allocated":37875712,"data_stored":602662118,"data_compressed":28616102,"data_compressed_allocated":37666816,"data_compressed_original":602587136,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38080512,"data_stored":609288192,"data_compressed":28931502,"data_compressed_allocated":38080512,"data_compressed_original":609288192,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41414656,"data_stored":662634496,"data_compressed":31464609,"data_compressed_allocated":41414656,"data_compressed_original":662634496,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":38129664,"data_stored":610074624,"data_compressed":28968853,"data_compressed_allocated":38129664,"data_compressed_original":610074624,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152000,"data_stored":786432000,"data_compressed":37343007,"data_compressed_allocated":49152000,"data_compressed_original":786432000,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:20:37.973 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:20:38.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:38.131+0000 7fb68c311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:38.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:38.138+0000 7fb68c311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:40.349 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:20:40.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:40.511+0000 7f49d2274640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:40.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:40.520+0000 7f49d2274640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:42.687 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:20:42.725 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:20:42.725 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:20:42.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:42.877+0000 7f8d6b074640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:42.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:42.888+0000 7f8d6b074640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:43.070 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:20:43.179 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:20:43.180 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:20:43.203 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-09-15T12:20:41.725100+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":854655563,"num_objects":13037,"num_object_clones":0,"num_object_copies":39111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":17522,"num_write_kb":976213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17496,"ondisk_log_size":17496,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":282520,"kb_used_data":158552,"kb_used_omap":0,"kb_used_meta":123904,"kb_avail":377204840,"statfs":{"total":386547056640,"available":386257756160,"internally_reserved":0,"allocated":162357248,"data_stored":2583112449,"data_compressed":122652109,"data_compressed_allocated":161439744,"data_compressed_original":2582790144,"omap_allocated":0,"internal_metadata":126877696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-34865128,"num_objects":-531,"num_object_clones":0,"num_object_copies":-1593,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3877,"num_write_kb":107009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.494994"},"pg_stats":[{"pgid":"3.f","version":"26'1140","reported_seq":1176,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:40.610817+0000","last_change":"2024-09-15T12:18:53.083350+0000","last_active":"2024-09-15T12:20:40.610817+0000","last_peered":"2024-09-15T12:20:40.610817+0000","last_clean":"2024-09-15T12:20:40.610817+0000","last_became_active":"2024-09-15T12:18:53.075051+0000","last_became_peered":"2024-09-15T12:18:53.075051+0000","last_unstale":"2024-09-15T12:20:40.610817+0000","last_undegraded":"2024-09-15T12:20:40.610817+0000","last_fullsized":"2024-09-15T12:20:40.610817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1140,"log_dups_size":0,"ondisk_log_size":1140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51773440,"num_objects":790,"num_object_clones":0,"num_object_copies":2370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":61760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"26'1093","reported_seq":1129,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:40.592924+0000","last_change":"2024-09-15T12:18:53.139711+0000","last_active":"2024-09-15T12:20:40.592924+0000","last_peered":"2024-09-15T12:20:40.592924+0000","last_clean":"2024-09-15T12:20:40.592924+0000","last_became_active":"2024-09-15T12:18:53.130124+0000","last_became_peered":"2024-09-15T12:18:53.130124+0000","last_unstale":"2024-09-15T12:20:40.592924+0000","last_undegraded":"2024-09-15T12:20:40.592924+0000","last_fullsized":"2024-09-15T12:20:40.592924+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1093,"log_dups_size":0,"ondisk_log_size":1093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50921472,"num_objects":777,"num_object_clones":0,"num_object_copies":2331,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1093,"num_write_kb":59840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"26'1204","reported_seq":1241,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:40.671542+0000","last_change":"2024-09-15T12:18:53.140327+0000","last_active":"2024-09-15T12:20:40.671542+0000","last_peered":"2024-09-15T12:20:40.671542+0000","last_clean":"2024-09-15T12:20:40.671542+0000","last_became_active":"2024-09-15T12:18:53.128935+0000","last_became_peered":"2024-09-15T12:18:53.128935+0000","last_unstale":"2024-09-15T12:20:40.671542+0000","last_undegraded":"2024-09-15T12:20:40.671542+0000","last_fullsized":"2024-09-15T12:20:40.671542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1204,"log_dups_size":0,"ondisk_log_size":1204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53805080,"num_objects":822,"num_object_clones":0,"num_object_copies":2466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1204,"num_write_kb":64769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"26'1160","reported_seq":1196,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:40.509900+0000","last_change":"2024-09-15T12:18:53.138678+0000","last_active":"2024-09-15T12:20:40.509900+0000","last_peered":"2024-09-15T12:20:40.509900+0000","last_clean":"2024-09-15T12:20:40.509900+0000","last_became_active":"2024-09-15T12:18:53.129492+0000","last_became_peered":"2024-09-15T12:18:53.129492+0000","last_unstale":"2024-09-15T12:20:40.509900+0000","last_undegraded":"2024-09-15T12:20:40.509900+0000","last_fullsized":"2024-09-15T12:20:40.509900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1160,"log_dups_size":0,"ondisk_log_size":1160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52559872,"num_objects":802,"num_object_clones":0,"num_object_copies":2406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1160,"num_write_kb":62784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'836","reported_seq":860,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:11.729081+0000","last_change":"2024-09-15T12:18:53.109204+0000","last_active":"2024-09-15T12:20:11.729081+0000","last_peered":"2024-09-15T12:20:11.729081+0000","last_clean":"2024-09-15T12:20:11.729081+0000","last_became_active":"2024-09-15T12:18:53.087134+0000","last_became_peered":"2024-09-15T12:18:53.087134+0000","last_unstale":"2024-09-15T12:20:11.729081+0000","last_undegraded":"2024-09-15T12:20:11.729081+0000","last_fullsized":"2024-09-15T12:20:11.729081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":836,"log_dups_size":0,"ondisk_log_size":836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54788096,"num_objects":836,"num_object_clones":0,"num_object_copies":2508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":836,"num_write_kb":53504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"26'1127","reported_seq":1163,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:40.592046+0000","last_change":"2024-09-15T12:18:53.119675+0000","last_active":"2024-09-15T12:20:40.592046+0000","last_peered":"2024-09-15T12:20:40.592046+0000","last_clean":"2024-09-15T12:20:40.592046+0000","last_became_active":"2024-09-15T12:18:53.112010+0000","last_became_peered":"2024-09-15T12:18:53.112010+0000","last_unstale":"2024-09-15T12:20:40.592046+0000","last_undegraded":"2024-09-15T12:20:40.592046+0000","last_fullsized":"2024-09-15T12:20:40.592046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1127,"log_dups_size":0,"ondisk_log_size":1127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51970048,"num_objects":793,"num_object_clones":0,"num_object_copies":2379,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1127,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"26'1145","reported_seq":1181,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:40.614506+0000","last_change":"2024-09-15T12:18:53.136381+0000","last_active":"2024-09-15T12:20:40.614506+0000","last_peered":"2024-09-15T12:20:40.614506+0000","last_clean":"2024-09-15T12:20:40.614506+0000","last_became_active":"2024-09-15T12:18:53.128765+0000","last_became_peered":"2024-09-15T12:18:53.128765+0000","last_unstale":"2024-09-15T12:20:40.614506+0000","last_undegraded":"2024-09-15T12:20:40.614506+0000","last_fullsized":"2024-09-15T12:20:40.614506+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1145,"log_dups_size":0,"ondisk_log_size":1145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51838976,"num_objects":791,"num_object_clones":0,"num_object_copies":2373,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1145,"num_write_kb":61952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"26'1185","reported_seq":1221,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:40.646701+0000","last_change":"2024-09-15T12:18:53.090984+0000","last_active":"2024-09-15T12:20:40.646701+0000","last_peered":"2024-09-15T12:20:40.646701+0000","last_clean":"2024-09-15T12:20:40.646701+0000","last_became_active":"2024-09-15T12:18:53.080676+0000","last_became_peered":"2024-09-15T12:18:53.080676+0000","last_unstale":"2024-09-15T12:20:40.646701+0000","last_undegraded":"2024-09-15T12:20:40.646701+0000","last_fullsized":"2024-09-15T12:20:40.646701+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1185,"log_dups_size":0,"ondisk_log_size":1185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53673984,"num_objects":819,"num_object_clones":0,"num_object_copies":2457,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":64128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":109,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.522583+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:20:03.522583+0000","last_peered":"2024-09-15T12:20:03.522583+0000","last_clean":"2024-09-15T12:20:03.522583+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:20:03.522583+0000","last_undegraded":"2024-09-15T12:20:03.522583+0000","last_fullsized":"2024-09-15T12:20:03.522583+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":50,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.311568+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:20:36.311568+0000","last_peered":"2024-09-15T12:20:36.311568+0000","last_clean":"2024-09-15T12:20:36.311568+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:20:36.311568+0000","last_undegraded":"2024-09-15T12:20:36.311568+0000","last_fullsized":"2024-09-15T12:20:36.311568+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"26'1201","reported_seq":1237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:40.631869+0000","last_change":"2024-09-15T12:18:53.172532+0000","last_active":"2024-09-15T12:20:40.631869+0000","last_peered":"2024-09-15T12:20:40.631869+0000","last_clean":"2024-09-15T12:20:40.631869+0000","last_became_active":"2024-09-15T12:18:53.166197+0000","last_became_peered":"2024-09-15T12:18:53.166197+0000","last_unstale":"2024-09-15T12:20:40.631869+0000","last_undegraded":"2024-09-15T12:20:40.631869+0000","last_fullsized":"2024-09-15T12:20:40.631869+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1201,"log_dups_size":0,"ondisk_log_size":1201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53149696,"num_objects":811,"num_object_clones":0,"num_object_copies":2433,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1201,"num_write_kb":64384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.288506+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:20:36.288506+0000","last_peered":"2024-09-15T12:20:36.288506+0000","last_clean":"2024-09-15T12:20:36.288506+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:20:36.288506+0000","last_undegraded":"2024-09-15T12:20:36.288506+0000","last_fullsized":"2024-09-15T12:20:36.288506+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"22'823","reported_seq":847,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:11.541254+0000","last_change":"2024-09-15T12:18:53.161283+0000","last_active":"2024-09-15T12:20:11.541254+0000","last_peered":"2024-09-15T12:20:11.541254+0000","last_clean":"2024-09-15T12:20:11.541254+0000","last_became_active":"2024-09-15T12:18:53.149710+0000","last_became_peered":"2024-09-15T12:18:53.149710+0000","last_unstale":"2024-09-15T12:20:11.541254+0000","last_undegraded":"2024-09-15T12:20:11.541254+0000","last_fullsized":"2024-09-15T12:20:11.541254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":823,"log_dups_size":0,"ondisk_log_size":823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53936128,"num_objects":823,"num_object_clones":0,"num_object_copies":2469,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":823,"num_write_kb":52672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.308887+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:20:36.308887+0000","last_peered":"2024-09-15T12:20:36.308887+0000","last_clean":"2024-09-15T12:20:36.308887+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:20:36.308887+0000","last_undegraded":"2024-09-15T12:20:36.308887+0000","last_fullsized":"2024-09-15T12:20:36.308887+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"22'869","reported_seq":893,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:11.664363+0000","last_change":"2024-09-15T12:18:53.169843+0000","last_active":"2024-09-15T12:20:11.664363+0000","last_peered":"2024-09-15T12:20:11.664363+0000","last_clean":"2024-09-15T12:20:11.664363+0000","last_became_active":"2024-09-15T12:18:53.161921+0000","last_became_peered":"2024-09-15T12:18:53.161921+0000","last_unstale":"2024-09-15T12:20:11.664363+0000","last_undegraded":"2024-09-15T12:20:11.664363+0000","last_fullsized":"2024-09-15T12:20:11.664363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56950784,"num_objects":869,"num_object_clones":0,"num_object_copies":2607,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":869,"num_write_kb":55616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":51,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.284665+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:20:36.284665+0000","last_peered":"2024-09-15T12:20:36.284665+0000","last_clean":"2024-09-15T12:20:36.284665+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:20:36.284665+0000","last_undegraded":"2024-09-15T12:20:36.284665+0000","last_fullsized":"2024-09-15T12:20:36.284665+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"26'1198","reported_seq":1234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:40.602228+0000","last_change":"2024-09-15T12:18:53.100005+0000","last_active":"2024-09-15T12:20:40.602228+0000","last_peered":"2024-09-15T12:20:40.602228+0000","last_clean":"2024-09-15T12:20:40.602228+0000","last_became_active":"2024-09-15T12:18:53.080705+0000","last_became_peered":"2024-09-15T12:18:53.080705+0000","last_unstale":"2024-09-15T12:20:40.602228+0000","last_undegraded":"2024-09-15T12:20:40.602228+0000","last_fullsized":"2024-09-15T12:20:40.602228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1198,"log_dups_size":0,"ondisk_log_size":1198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51904512,"num_objects":792,"num_object_clones":0,"num_object_copies":2376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1198,"num_write_kb":63680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"26'1190","reported_seq":1226,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:40.708493+0000","last_change":"2024-09-15T12:18:53.122880+0000","last_active":"2024-09-15T12:20:40.708493+0000","last_peered":"2024-09-15T12:20:40.708493+0000","last_clean":"2024-09-15T12:20:40.708493+0000","last_became_active":"2024-09-15T12:18:53.111647+0000","last_became_peered":"2024-09-15T12:18:53.111647+0000","last_unstale":"2024-09-15T12:20:40.708493+0000","last_undegraded":"2024-09-15T12:20:40.708493+0000","last_fullsized":"2024-09-15T12:20:40.708493+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1190,"log_dups_size":0,"ondisk_log_size":1190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55312384,"num_objects":844,"num_object_clones":0,"num_object_copies":2532,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1190,"num_write_kb":65088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.280090+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:20:36.280090+0000","last_peered":"2024-09-15T12:20:36.280090+0000","last_clean":"2024-09-15T12:20:36.280090+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:20:36.280090+0000","last_undegraded":"2024-09-15T12:20:36.280090+0000","last_fullsized":"2024-09-15T12:20:36.280090+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"26'1190","reported_seq":1226,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:40.511223+0000","last_change":"2024-09-15T12:18:53.133542+0000","last_active":"2024-09-15T12:20:40.511223+0000","last_peered":"2024-09-15T12:20:40.511223+0000","last_clean":"2024-09-15T12:20:40.511223+0000","last_became_active":"2024-09-15T12:18:53.125716+0000","last_became_peered":"2024-09-15T12:18:53.125716+0000","last_unstale":"2024-09-15T12:20:40.511223+0000","last_undegraded":"2024-09-15T12:20:40.511223+0000","last_fullsized":"2024-09-15T12:20:40.511223+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1190,"log_dups_size":0,"ondisk_log_size":1190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52953088,"num_objects":808,"num_object_clones":0,"num_object_copies":2424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1190,"num_write_kb":63936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:03.527734+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:20:03.527734+0000","last_peered":"2024-09-15T12:20:03.527734+0000","last_clean":"2024-09-15T12:20:03.527734+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:20:03.527734+0000","last_undegraded":"2024-09-15T12:20:03.527734+0000","last_fullsized":"2024-09-15T12:20:03.527734+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"22'855","reported_seq":879,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-15T12:20:11.712022+0000","last_change":"2024-09-15T12:18:53.133963+0000","last_active":"2024-09-15T12:20:11.712022+0000","last_peered":"2024-09-15T12:20:11.712022+0000","last_clean":"2024-09-15T12:20:11.712022+0000","last_became_active":"2024-09-15T12:18:53.122383+0000","last_became_peered":"2024-09-15T12:18:53.122383+0000","last_unstale":"2024-09-15T12:20:11.712022+0000","last_undegraded":"2024-09-15T12:20:11.712022+0000","last_fullsized":"2024-09-15T12:20:11.712022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":855,"log_dups_size":0,"ondisk_log_size":855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56033280,"num_objects":855,"num_object_clones":0,"num_object_copies":2565,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":855,"num_write_kb":54720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.280291+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:20:36.280291+0000","last_peered":"2024-09-15T12:20:36.280291+0000","last_clean":"2024-09-15T12:20:36.280291+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:20:36.280291+0000","last_undegraded":"2024-09-15T12:20:36.280291+0000","last_fullsized":"2024-09-15T12:20:36.280291+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"26'1225","reported_seq":1261,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:40.553561+0000","last_change":"2024-09-15T12:18:53.102960+0000","last_active":"2024-09-15T12:20:40.553561+0000","last_peered":"2024-09-15T12:20:40.553561+0000","last_clean":"2024-09-15T12:20:40.553561+0000","last_became_active":"2024-09-15T12:18:53.088807+0000","last_became_peered":"2024-09-15T12:18:53.088807+0000","last_unstale":"2024-09-15T12:20:40.553561+0000","last_undegraded":"2024-09-15T12:20:40.553561+0000","last_fullsized":"2024-09-15T12:20:40.553561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1225,"log_dups_size":0,"ondisk_log_size":1225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52494336,"num_objects":801,"num_object_clones":0,"num_object_copies":2403,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1225,"num_write_kb":64832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.312203+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:20:36.312203+0000","last_peered":"2024-09-15T12:20:36.312203+0000","last_clean":"2024-09-15T12:20:36.312203+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:20:36.312203+0000","last_undegraded":"2024-09-15T12:20:36.312203+0000","last_fullsized":"2024-09-15T12:20:36.312203+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":854065176,"num_objects":13033,"num_object_clones":0,"num_object_copies":39099,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":17441,"num_write_kb":975105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":160464896,"data_stored":2567307312,"data_compressed":121908493,"data_compressed_allocated":160456704,"data_compressed_original":2567307264,"omap_allocated":0,"internal_metadata":0},"log_size":17441,"ondisk_log_size":17441,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673049,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":87068,"kb_used_data":47756,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94284772,"statfs":{"total":96636764160,"available":96547606528,"internally_reserved":0,"allocated":48902144,"data_stored":779150547,"data_compressed":36996487,"data_compressed_allocated":48697344,"data_compressed_original":779075584,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":62884,"kb_used_data":36052,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94308956,"statfs":{"total":96636764160,"available":96572370944,"internally_reserved":0,"allocated":36917248,"data_stored":586815498,"data_compressed":27863760,"data_compressed_allocated":36675584,"data_compressed_original":586727424,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70044,"kb_used_data":39052,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94301796,"statfs":{"total":96636764160,"available":96565039104,"internally_reserved":0,"allocated":39989248,"data_stored":636294658,"data_compressed":30211295,"data_compressed_allocated":39763968,"data_compressed_original":636223488,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":62524,"kb_used_data":35692,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94309316,"statfs":{"total":96636764160,"available":96572739584,"internally_reserved":0,"allocated":36548608,"data_stored":580851746,"data_compressed":27580567,"data_compressed_allocated":36302848,"data_compressed_original":580763648,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":35815424,"data_stored":572981272,"data_compressed":27208215,"data_compressed_allocated":35811328,"data_compressed_original":572981248,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":39313408,"data_stored":628949016,"data_compressed":29865863,"data_compressed_allocated":39309312,"data_compressed_original":628948992,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36184064,"data_stored":578945024,"data_compressed":27491408,"data_compressed_allocated":36184064,"data_compressed_original":578945024,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152000,"data_stored":786432000,"data_compressed":37343007,"data_compressed_allocated":49152000,"data_compressed_original":786432000,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:20:43.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:43.224+0000 7f4236b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:43.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:43.234+0000 7f4236b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:45.603 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:20:45.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:45.739+0000 7fbc39f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:45.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:45.746+0000 7fbc39f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:48.206 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:20:48.206 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:20:48.206 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:20:48.206 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:20:48.219 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:20:48.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:48.361+0000 7f7e864d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:48.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:48.373+0000 7f7e864d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:48.417 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:20:48.417 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:20:48.417 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:20:48.417 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:20:48.417 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:20:48.417 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:20:48.418 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:20:48.418 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:20:48.418 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:20:48.418 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:20:48.418 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:20:48.418 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:20:48.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:48.418+0000 7f733cd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:48.422 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:20:48.422 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:20:48.423 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:20:48.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:48.427+0000 7f733cd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:48.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:48.560+0000 7f83e4d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:48.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:48.571+0000 7f83e4d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:48.700 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:20:48.700 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:20:48.701 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:20:48.701 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:20:48.701 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:20:48.701 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:20:48.701 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:20:48.701 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:20:48.701 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:20:48.701 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:20:48.701 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:20:48.701 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:20:48.705 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:20:48.705 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:20:48.705 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:20:48.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:48.886+0000 7fb4b4b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:48.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:48.899+0000 7fb4b4b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:48.929 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:20:48.929 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:20:48.929 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:20:48.929 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:20:48.929 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:20:48.930 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:20:48.930 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:20:48.930 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:20:48.930 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:20:48.930 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:20:48.930 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:20:48.930 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:20:48.933 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:20:48.933 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:20:48.934 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:20:49.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:49.094+0000 7f247c28e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:49.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:49.107+0000 7f247c28e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:49.252 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:20:49.252 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:20:49.252 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:20:49.252 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:20:49.252 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:20:49.252 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:20:49.252 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:20:49.252 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:20:49.252 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:20:49.252 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:20:49.252 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:20:49.253 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:20:49.256 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:20:49.256 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:20:51.007 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:20:51.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:51.162+0000 7f80850d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:51.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:51.169+0000 7f80850d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:53.769 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:20:53.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:53.924+0000 7ff62147f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:53.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:53.933+0000 7ff62147f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:54.257 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:20:54.257 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:20:54.257 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:20:54.258 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:20:54.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:54.399+0000 7f9f10b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:54.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:54.418+0000 7f9f10b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:54.630 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:20:54.630 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:20:54.630 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:20:54.630 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:20:54.630 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:20:54.630 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:20:54.630 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:20:54.631 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:20:54.631 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:20:54.631 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:20:54.631 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:20:54.631 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:20:54.635 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:20:54.635 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:20:54.635 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:20:54.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:54.786+0000 7f00fb151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:54.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:54.802+0000 7f00fb151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:54.901 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:20:54.902 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:20:54.902 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:20:54.902 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:20:54.902 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:20:54.902 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:20:54.902 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:20:54.902 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:20:54.902 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:20:54.902 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:20:54.902 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:20:54.902 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:20:54.905 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:20:54.905 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:20:54.905 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:20:55.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:55.046+0000 7f0853991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:55.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:55.064+0000 7f0853991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:55.290 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:20:55.290 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:20:55.290 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:20:55.290 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:20:55.290 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:20:55.290 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:20:55.290 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:20:55.290 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:20:55.290 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:20:55.290 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:20:55.290 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:20:55.290 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:20:55.293 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:20:55.294 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:20:55.294 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:20:55.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:55.449+0000 7f6b65d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:55.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:55.462+0000 7f6b65d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:55.632 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:20:55.632 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:20:55.632 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:20:55.632 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:20:55.632 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:20:55.632 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:20:55.632 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:20:55.632 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:20:55.632 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:20:55.632 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:20:55.632 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:20:55.633 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:20:55.635 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:20:55.636 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:20:56.555 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:20:56.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:56.711+0000 7f7e6e511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:56.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:56.718+0000 7f7e6e511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:59.317 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:20:59.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:59.460+0000 7fcc8b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:20:59.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:20:59.468+0000 7fcc8b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:00.636 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:21:00.636 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:21:00.636 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:21:00.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:00.772+0000 7f1675751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:00.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:00.784+0000 7f1675751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:01.065 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:21:01.066 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:21:01.083 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2024-09-15T12:20:59.728645+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":836239947,"num_objects":12756,"num_object_clones":0,"num_object_copies":38268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":18741,"num_write_kb":1006229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18715,"ondisk_log_size":18715,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":279728,"kb_used_data":155760,"kb_used_omap":0,"kb_used_meta":123904,"kb_avail":377207632,"statfs":{"total":386547056640,"available":386260615168,"internally_reserved":0,"allocated":159498240,"data_stored":2536791613,"data_compressed":120452917,"data_compressed_allocated":158543872,"data_compressed_original":2536456192,"omap_allocated":0,"internal_metadata":126877696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002208"},"pg_stats":[{"pgid":"3.f","version":"26'1140","reported_seq":1176,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:40.610817+0000","last_change":"2024-09-15T12:18:53.083350+0000","last_active":"2024-09-15T12:20:40.610817+0000","last_peered":"2024-09-15T12:20:40.610817+0000","last_clean":"2024-09-15T12:20:40.610817+0000","last_became_active":"2024-09-15T12:18:53.075051+0000","last_became_peered":"2024-09-15T12:18:53.075051+0000","last_unstale":"2024-09-15T12:20:40.610817+0000","last_undegraded":"2024-09-15T12:20:40.610817+0000","last_fullsized":"2024-09-15T12:20:40.610817+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1140,"log_dups_size":0,"ondisk_log_size":1140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51773440,"num_objects":790,"num_object_clones":0,"num_object_copies":2370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":61760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"26'1093","reported_seq":1129,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:40.592924+0000","last_change":"2024-09-15T12:18:53.139711+0000","last_active":"2024-09-15T12:20:40.592924+0000","last_peered":"2024-09-15T12:20:40.592924+0000","last_clean":"2024-09-15T12:20:40.592924+0000","last_became_active":"2024-09-15T12:18:53.130124+0000","last_became_peered":"2024-09-15T12:18:53.130124+0000","last_unstale":"2024-09-15T12:20:40.592924+0000","last_undegraded":"2024-09-15T12:20:40.592924+0000","last_fullsized":"2024-09-15T12:20:40.592924+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1093,"log_dups_size":0,"ondisk_log_size":1093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50921472,"num_objects":777,"num_object_clones":0,"num_object_copies":2331,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1093,"num_write_kb":59840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"26'1204","reported_seq":1241,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:40.671542+0000","last_change":"2024-09-15T12:18:53.140327+0000","last_active":"2024-09-15T12:20:40.671542+0000","last_peered":"2024-09-15T12:20:40.671542+0000","last_clean":"2024-09-15T12:20:40.671542+0000","last_became_active":"2024-09-15T12:18:53.128935+0000","last_became_peered":"2024-09-15T12:18:53.128935+0000","last_unstale":"2024-09-15T12:20:40.671542+0000","last_undegraded":"2024-09-15T12:20:40.671542+0000","last_fullsized":"2024-09-15T12:20:40.671542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1204,"log_dups_size":0,"ondisk_log_size":1204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53805080,"num_objects":822,"num_object_clones":0,"num_object_copies":2466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1204,"num_write_kb":64769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"26'1160","reported_seq":1196,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:40.509900+0000","last_change":"2024-09-15T12:18:53.138678+0000","last_active":"2024-09-15T12:20:40.509900+0000","last_peered":"2024-09-15T12:20:40.509900+0000","last_clean":"2024-09-15T12:20:40.509900+0000","last_became_active":"2024-09-15T12:18:53.129492+0000","last_became_peered":"2024-09-15T12:18:53.129492+0000","last_unstale":"2024-09-15T12:20:40.509900+0000","last_undegraded":"2024-09-15T12:20:40.509900+0000","last_fullsized":"2024-09-15T12:20:40.509900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1160,"log_dups_size":0,"ondisk_log_size":1160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52559872,"num_objects":802,"num_object_clones":0,"num_object_copies":2406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1160,"num_write_kb":62784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"26'1147","reported_seq":1183,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:41.714508+0000","last_change":"2024-09-15T12:18:53.109204+0000","last_active":"2024-09-15T12:20:41.714508+0000","last_peered":"2024-09-15T12:20:41.714508+0000","last_clean":"2024-09-15T12:20:41.714508+0000","last_became_active":"2024-09-15T12:18:53.087134+0000","last_became_peered":"2024-09-15T12:18:53.087134+0000","last_unstale":"2024-09-15T12:20:41.714508+0000","last_undegraded":"2024-09-15T12:20:41.714508+0000","last_fullsized":"2024-09-15T12:20:41.714508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1147,"log_dups_size":0,"ondisk_log_size":1147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51314688,"num_objects":783,"num_object_clones":0,"num_object_copies":2349,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1147,"num_write_kb":61760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"26'1127","reported_seq":1163,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:40.592046+0000","last_change":"2024-09-15T12:18:53.119675+0000","last_active":"2024-09-15T12:20:40.592046+0000","last_peered":"2024-09-15T12:20:40.592046+0000","last_clean":"2024-09-15T12:20:40.592046+0000","last_became_active":"2024-09-15T12:18:53.112010+0000","last_became_peered":"2024-09-15T12:18:53.112010+0000","last_unstale":"2024-09-15T12:20:40.592046+0000","last_undegraded":"2024-09-15T12:20:40.592046+0000","last_fullsized":"2024-09-15T12:20:40.592046+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1127,"log_dups_size":0,"ondisk_log_size":1127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51970048,"num_objects":793,"num_object_clones":0,"num_object_copies":2379,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1127,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"26'1145","reported_seq":1181,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:40.614506+0000","last_change":"2024-09-15T12:18:53.136381+0000","last_active":"2024-09-15T12:20:40.614506+0000","last_peered":"2024-09-15T12:20:40.614506+0000","last_clean":"2024-09-15T12:20:40.614506+0000","last_became_active":"2024-09-15T12:18:53.128765+0000","last_became_peered":"2024-09-15T12:18:53.128765+0000","last_unstale":"2024-09-15T12:20:40.614506+0000","last_undegraded":"2024-09-15T12:20:40.614506+0000","last_fullsized":"2024-09-15T12:20:40.614506+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1145,"log_dups_size":0,"ondisk_log_size":1145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51838976,"num_objects":791,"num_object_clones":0,"num_object_copies":2373,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1145,"num_write_kb":61952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"26'1185","reported_seq":1221,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:40.646701+0000","last_change":"2024-09-15T12:18:53.090984+0000","last_active":"2024-09-15T12:20:40.646701+0000","last_peered":"2024-09-15T12:20:40.646701+0000","last_clean":"2024-09-15T12:20:40.646701+0000","last_became_active":"2024-09-15T12:18:53.080676+0000","last_became_peered":"2024-09-15T12:18:53.080676+0000","last_unstale":"2024-09-15T12:20:40.646701+0000","last_undegraded":"2024-09-15T12:20:40.646701+0000","last_fullsized":"2024-09-15T12:20:40.646701+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1185,"log_dups_size":0,"ondisk_log_size":1185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53673984,"num_objects":819,"num_object_clones":0,"num_object_copies":2457,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1185,"num_write_kb":64128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":121,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.289678+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:20:36.289678+0000","last_peered":"2024-09-15T12:20:36.289678+0000","last_clean":"2024-09-15T12:20:36.289678+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:20:36.289678+0000","last_undegraded":"2024-09-15T12:20:36.289678+0000","last_fullsized":"2024-09-15T12:20:36.289678+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":50,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.311568+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:20:36.311568+0000","last_peered":"2024-09-15T12:20:36.311568+0000","last_clean":"2024-09-15T12:20:36.311568+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:20:36.311568+0000","last_undegraded":"2024-09-15T12:20:36.311568+0000","last_fullsized":"2024-09-15T12:20:36.311568+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"26'1201","reported_seq":1237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:40.631869+0000","last_change":"2024-09-15T12:18:53.172532+0000","last_active":"2024-09-15T12:20:40.631869+0000","last_peered":"2024-09-15T12:20:40.631869+0000","last_clean":"2024-09-15T12:20:40.631869+0000","last_became_active":"2024-09-15T12:18:53.166197+0000","last_became_peered":"2024-09-15T12:18:53.166197+0000","last_unstale":"2024-09-15T12:20:40.631869+0000","last_undegraded":"2024-09-15T12:20:40.631869+0000","last_fullsized":"2024-09-15T12:20:40.631869+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1201,"log_dups_size":0,"ondisk_log_size":1201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53149696,"num_objects":811,"num_object_clones":0,"num_object_copies":2433,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1201,"num_write_kb":64384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.288506+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:20:36.288506+0000","last_peered":"2024-09-15T12:20:36.288506+0000","last_clean":"2024-09-15T12:20:36.288506+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:20:36.288506+0000","last_undegraded":"2024-09-15T12:20:36.288506+0000","last_fullsized":"2024-09-15T12:20:36.288506+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"26'1136","reported_seq":1172,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:41.654850+0000","last_change":"2024-09-15T12:18:53.161283+0000","last_active":"2024-09-15T12:20:41.654850+0000","last_peered":"2024-09-15T12:20:41.654850+0000","last_clean":"2024-09-15T12:20:41.654850+0000","last_became_active":"2024-09-15T12:18:53.149710+0000","last_became_peered":"2024-09-15T12:18:53.149710+0000","last_unstale":"2024-09-15T12:20:41.654850+0000","last_undegraded":"2024-09-15T12:20:41.654850+0000","last_fullsized":"2024-09-15T12:20:41.654850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1136,"log_dups_size":0,"ondisk_log_size":1136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49545216,"num_objects":756,"num_object_clones":0,"num_object_copies":2268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1136,"num_write_kb":60544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.308887+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:20:36.308887+0000","last_peered":"2024-09-15T12:20:36.308887+0000","last_clean":"2024-09-15T12:20:36.308887+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:20:36.308887+0000","last_undegraded":"2024-09-15T12:20:36.308887+0000","last_fullsized":"2024-09-15T12:20:36.308887+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"26'1145","reported_seq":1181,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:41.728686+0000","last_change":"2024-09-15T12:18:53.169843+0000","last_active":"2024-09-15T12:20:41.728686+0000","last_peered":"2024-09-15T12:20:41.728686+0000","last_clean":"2024-09-15T12:20:41.728686+0000","last_became_active":"2024-09-15T12:18:53.161921+0000","last_became_peered":"2024-09-15T12:18:53.161921+0000","last_unstale":"2024-09-15T12:20:41.728686+0000","last_undegraded":"2024-09-15T12:20:41.728686+0000","last_fullsized":"2024-09-15T12:20:41.728686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1145,"log_dups_size":0,"ondisk_log_size":1145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52363264,"num_objects":799,"num_object_clones":0,"num_object_copies":2397,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1145,"num_write_kb":62208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":51,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.284665+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:20:36.284665+0000","last_peered":"2024-09-15T12:20:36.284665+0000","last_clean":"2024-09-15T12:20:36.284665+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:20:36.284665+0000","last_undegraded":"2024-09-15T12:20:36.284665+0000","last_fullsized":"2024-09-15T12:20:36.284665+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"26'1198","reported_seq":1234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:40.602228+0000","last_change":"2024-09-15T12:18:53.100005+0000","last_active":"2024-09-15T12:20:40.602228+0000","last_peered":"2024-09-15T12:20:40.602228+0000","last_clean":"2024-09-15T12:20:40.602228+0000","last_became_active":"2024-09-15T12:18:53.080705+0000","last_became_peered":"2024-09-15T12:18:53.080705+0000","last_unstale":"2024-09-15T12:20:40.602228+0000","last_undegraded":"2024-09-15T12:20:40.602228+0000","last_fullsized":"2024-09-15T12:20:40.602228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1198,"log_dups_size":0,"ondisk_log_size":1198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51904512,"num_objects":792,"num_object_clones":0,"num_object_copies":2376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1198,"num_write_kb":63680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"26'1190","reported_seq":1226,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:40.708493+0000","last_change":"2024-09-15T12:18:53.122880+0000","last_active":"2024-09-15T12:20:40.708493+0000","last_peered":"2024-09-15T12:20:40.708493+0000","last_clean":"2024-09-15T12:20:40.708493+0000","last_became_active":"2024-09-15T12:18:53.111647+0000","last_became_peered":"2024-09-15T12:18:53.111647+0000","last_unstale":"2024-09-15T12:20:40.708493+0000","last_undegraded":"2024-09-15T12:20:40.708493+0000","last_fullsized":"2024-09-15T12:20:40.708493+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1190,"log_dups_size":0,"ondisk_log_size":1190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55312384,"num_objects":844,"num_object_clones":0,"num_object_copies":2532,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1190,"num_write_kb":65088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.280090+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:20:36.280090+0000","last_peered":"2024-09-15T12:20:36.280090+0000","last_clean":"2024-09-15T12:20:36.280090+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:20:36.280090+0000","last_undegraded":"2024-09-15T12:20:36.280090+0000","last_fullsized":"2024-09-15T12:20:36.280090+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"26'1190","reported_seq":1226,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:40.511223+0000","last_change":"2024-09-15T12:18:53.133542+0000","last_active":"2024-09-15T12:20:40.511223+0000","last_peered":"2024-09-15T12:20:40.511223+0000","last_clean":"2024-09-15T12:20:40.511223+0000","last_became_active":"2024-09-15T12:18:53.125716+0000","last_became_peered":"2024-09-15T12:18:53.125716+0000","last_unstale":"2024-09-15T12:20:40.511223+0000","last_undegraded":"2024-09-15T12:20:40.511223+0000","last_fullsized":"2024-09-15T12:20:40.511223+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1190,"log_dups_size":0,"ondisk_log_size":1190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52953088,"num_objects":808,"num_object_clones":0,"num_object_copies":2424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1190,"num_write_kb":63936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.299694+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:20:36.299694+0000","last_peered":"2024-09-15T12:20:36.299694+0000","last_clean":"2024-09-15T12:20:36.299694+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:20:36.299694+0000","last_undegraded":"2024-09-15T12:20:36.299694+0000","last_fullsized":"2024-09-15T12:20:36.299694+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"26'1174","reported_seq":1210,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:41.641580+0000","last_change":"2024-09-15T12:18:53.133963+0000","last_active":"2024-09-15T12:20:41.641580+0000","last_peered":"2024-09-15T12:20:41.641580+0000","last_clean":"2024-09-15T12:20:41.641580+0000","last_became_active":"2024-09-15T12:18:53.122383+0000","last_became_peered":"2024-09-15T12:18:53.122383+0000","last_unstale":"2024-09-15T12:20:41.641580+0000","last_undegraded":"2024-09-15T12:20:41.641580+0000","last_fullsized":"2024-09-15T12:20:41.641580+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1174,"log_dups_size":0,"ondisk_log_size":1174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50069504,"num_objects":764,"num_object_clones":0,"num_object_copies":2292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1174,"num_write_kb":62016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.280291+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:20:36.280291+0000","last_peered":"2024-09-15T12:20:36.280291+0000","last_clean":"2024-09-15T12:20:36.280291+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:20:36.280291+0000","last_undegraded":"2024-09-15T12:20:36.280291+0000","last_fullsized":"2024-09-15T12:20:36.280291+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"26'1225","reported_seq":1261,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:40.553561+0000","last_change":"2024-09-15T12:18:53.102960+0000","last_active":"2024-09-15T12:20:40.553561+0000","last_peered":"2024-09-15T12:20:40.553561+0000","last_clean":"2024-09-15T12:20:40.553561+0000","last_became_active":"2024-09-15T12:18:53.088807+0000","last_became_peered":"2024-09-15T12:18:53.088807+0000","last_unstale":"2024-09-15T12:20:40.553561+0000","last_undegraded":"2024-09-15T12:20:40.553561+0000","last_fullsized":"2024-09-15T12:20:40.553561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1225,"log_dups_size":0,"ondisk_log_size":1225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52494336,"num_objects":801,"num_object_clones":0,"num_object_copies":2403,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1225,"num_write_kb":64832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.312203+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:20:36.312203+0000","last_peered":"2024-09-15T12:20:36.312203+0000","last_clean":"2024-09-15T12:20:36.312203+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:20:36.312203+0000","last_undegraded":"2024-09-15T12:20:36.312203+0000","last_fullsized":"2024-09-15T12:20:36.312203+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":835649560,"num_objects":12752,"num_object_clones":0,"num_object_copies":38256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":18660,"num_write_kb":1005121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":156553216,"data_stored":2504654920,"data_compressed":118934413,"data_compressed_allocated":156540928,"data_compressed_original":2504654848,"omap_allocated":0,"internal_metadata":0},"log_size":18660,"ondisk_log_size":18660,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673079,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":84276,"kb_used_data":44964,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94287564,"statfs":{"total":96636764160,"available":96550465536,"internally_reserved":0,"allocated":46043136,"data_stored":732829711,"data_compressed":34797295,"data_compressed_allocated":45801472,"data_compressed_original":732741632,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":62884,"kb_used_data":36052,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94308956,"statfs":{"total":96636764160,"available":96572370944,"internally_reserved":0,"allocated":36917248,"data_stored":586815498,"data_compressed":27863760,"data_compressed_allocated":36675584,"data_compressed_original":586727424,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70044,"kb_used_data":39052,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94301796,"statfs":{"total":96636764160,"available":96565039104,"internally_reserved":0,"allocated":39989248,"data_stored":636294658,"data_compressed":30211295,"data_compressed_allocated":39763968,"data_compressed_original":636223488,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":62524,"kb_used_data":35692,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94309316,"statfs":{"total":96636764160,"available":96572739584,"internally_reserved":0,"allocated":36548608,"data_stored":580851746,"data_compressed":27580567,"data_compressed_allocated":36302848,"data_compressed_original":580763648,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":35815424,"data_stored":572981272,"data_compressed":27208215,"data_compressed_allocated":35811328,"data_compressed_original":572981248,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":39313408,"data_stored":628949016,"data_compressed":29865863,"data_compressed_allocated":39309312,"data_compressed_original":628948992,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36184064,"data_stored":578945024,"data_compressed":27491408,"data_compressed_allocated":36184064,"data_compressed_original":578945024,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45240320,"data_stored":723779608,"data_compressed":34368927,"data_compressed_allocated":45236224,"data_compressed_original":723779584,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:21:01.891 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:21:02.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:02.048+0000 7fc324351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:02.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:02.056+0000 7fc324351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:04.331 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:21:04.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:04.467+0000 7f5d964d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:04.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:04.474+0000 7f5d964d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:06.085 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:21:06.085 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:21:06.086 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:21:06.086 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:21:06.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:06.228+0000 7f2585d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:06.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:06.239+0000 7f2585d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:06.263 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:21:06.263 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:21:06.263 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:21:06.264 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:21:06.264 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:21:06.264 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:21:06.264 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:21:06.264 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:21:06.264 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:21:06.264 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:21:06.264 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:21:06.264 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:21:06.267 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:21:06.268 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:21:06.268 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:21:06.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:06.412+0000 7f8911abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:06.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:06.424+0000 7f8911abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:06.461 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:21:06.461 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:21:06.461 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:21:06.462 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:21:06.462 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:21:06.462 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:21:06.462 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:21:06.462 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:21:06.462 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:21:06.462 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:21:06.462 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:21:06.462 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:21:06.464 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:21:06.465 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:21:06.465 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:21:06.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:06.601+0000 7fe09df91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:06.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:06.618+0000 7fe09df91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:06.649 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:21:06.649 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:21:06.649 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:21:06.649 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:21:06.649 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:21:06.649 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:21:06.649 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:21:06.649 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:21:06.650 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:21:06.650 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:21:06.650 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:21:06.650 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:21:06.652 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:21:06.653 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:21:06.653 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:21:06.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:06.803+0000 7fe2b6d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:06.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:06.817+0000 7fe2b6d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:06.994 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:21:06.994 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:21:06.994 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:21:06.994 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:21:06.994 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:21:06.994 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:21:06.994 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:21:06.994 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:21:06.994 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:21:06.994 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:21:06.994 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:21:06.994 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:21:06.997 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:21:06.998 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:21:07.083 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:21:07.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:07.227+0000 7f0ba7951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:07.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:07.236+0000 7f0ba7951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:09.637 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:21:09.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:09.792+0000 7f07d3348640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:09.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:09.798+0000 7f07d3348640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:11.998 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:21:11.999 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:21:11.999 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:21:11.999 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:21:12.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:12.142+0000 7f4adb591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:12.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:12.156+0000 7f4adb591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:12.178 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:21:12.178 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:21:12.178 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:21:12.178 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:21:12.178 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:21:12.178 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:21:12.179 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:21:12.179 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:21:12.179 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:21:12.179 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:21:12.179 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:21:12.179 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:21:12.181 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:21:12.182 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:21:12.182 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:21:12.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:12.320+0000 7efcac311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:12.332 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:21:12.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:12.336+0000 7efcac311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:12.398 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:21:12.398 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:21:12.398 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:21:12.398 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:21:12.398 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:21:12.398 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:21:12.398 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:21:12.398 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:21:12.399 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:21:12.399 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:21:12.399 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:21:12.399 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:21:12.402 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:21:12.402 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:21:12.403 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:21:12.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:12.482+0000 7fa1a4f08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:12.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:12.490+0000 7fa1a4f08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:12.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:12.595+0000 7f137bca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:12.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:12.617+0000 7f137bca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:12.653 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:21:12.653 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:21:12.653 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:21:12.653 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:21:12.653 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:21:12.654 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:21:12.654 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:21:12.654 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:21:12.654 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:21:12.654 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:21:12.654 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:21:12.654 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:21:12.657 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:21:12.658 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:21:12.658 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:21:12.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:12.855+0000 7f7f93511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:12.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:12.867+0000 7f7f93511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:13.058 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:21:13.058 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:21:13.058 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:21:13.059 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:21:13.059 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:21:13.059 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:21:13.059 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:21:13.059 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:21:13.059 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:21:13.059 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:21:13.059 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:21:13.059 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:21:13.063 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:21:13.063 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:21:15.069 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:21:15.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:15.214+0000 7f311d191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:15.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:15.224+0000 7f311d191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:17.843 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:21:17.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:17.976+0000 7fbb0cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:17.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:17.983+0000 7fbb0cb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:18.064 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:21:18.064 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:21:18.064 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:21:18.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:18.208+0000 7f5c28b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:18.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:18.223+0000 7f5c28b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:18.516 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:21:18.516 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:21:18.533 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2024-09-15T12:21:17.732536+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":477037131,"num_objects":7275,"num_object_clones":0,"num_object_copies":21825,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":24222,"num_write_kb":1006229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24196,"ondisk_log_size":24196,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":235928,"kb_used_data":89752,"kb_used_omap":0,"kb_used_meta":146112,"kb_avail":377251432,"statfs":{"total":386547056640,"available":386305466368,"internally_reserved":0,"allocated":91906048,"data_stored":1455316541,"data_compressed":69098693,"data_compressed_allocated":90951680,"data_compressed_original":1454981120,"omap_allocated":0,"internal_metadata":149618688},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-359202816,"num_objects":-5481,"num_object_clones":0,"num_object_copies":-16443,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5481,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002623"},"pg_stats":[{"pgid":"3.f","version":"26'1457","reported_seq":1493,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.667695+0000","last_change":"2024-09-15T12:18:53.083350+0000","last_active":"2024-09-15T12:21:10.667695+0000","last_peered":"2024-09-15T12:21:10.667695+0000","last_clean":"2024-09-15T12:21:10.667695+0000","last_became_active":"2024-09-15T12:18:53.075051+0000","last_became_peered":"2024-09-15T12:18:53.075051+0000","last_unstale":"2024-09-15T12:21:10.667695+0000","last_undegraded":"2024-09-15T12:21:10.667695+0000","last_fullsized":"2024-09-15T12:21:10.667695+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1457,"log_dups_size":0,"ondisk_log_size":1457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30998528,"num_objects":473,"num_object_clones":0,"num_object_copies":1419,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1457,"num_write_kb":61760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"26'1408","reported_seq":1444,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.672016+0000","last_change":"2024-09-15T12:18:53.139711+0000","last_active":"2024-09-15T12:21:10.672016+0000","last_peered":"2024-09-15T12:21:10.672016+0000","last_clean":"2024-09-15T12:21:10.672016+0000","last_became_active":"2024-09-15T12:18:53.130124+0000","last_became_peered":"2024-09-15T12:18:53.130124+0000","last_unstale":"2024-09-15T12:21:10.672016+0000","last_undegraded":"2024-09-15T12:21:10.672016+0000","last_fullsized":"2024-09-15T12:21:10.672016+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1408,"log_dups_size":0,"ondisk_log_size":1408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1408,"num_write_kb":59840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"26'1558","reported_seq":1595,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.608587+0000","last_change":"2024-09-15T12:18:53.140327+0000","last_active":"2024-09-15T12:21:10.608587+0000","last_peered":"2024-09-15T12:21:10.608587+0000","last_clean":"2024-09-15T12:21:10.608587+0000","last_became_active":"2024-09-15T12:18:53.128935+0000","last_became_peered":"2024-09-15T12:18:53.128935+0000","last_unstale":"2024-09-15T12:21:10.608587+0000","last_undegraded":"2024-09-15T12:21:10.608587+0000","last_fullsized":"2024-09-15T12:21:10.608587+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1558,"log_dups_size":0,"ondisk_log_size":1558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30605336,"num_objects":468,"num_object_clones":0,"num_object_copies":1404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1558,"num_write_kb":64769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"26'1508","reported_seq":1544,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.681167+0000","last_change":"2024-09-15T12:18:53.138678+0000","last_active":"2024-09-15T12:21:10.681167+0000","last_peered":"2024-09-15T12:21:10.681167+0000","last_clean":"2024-09-15T12:21:10.681167+0000","last_became_active":"2024-09-15T12:18:53.129492+0000","last_became_peered":"2024-09-15T12:18:53.129492+0000","last_unstale":"2024-09-15T12:21:10.681167+0000","last_undegraded":"2024-09-15T12:21:10.681167+0000","last_fullsized":"2024-09-15T12:21:10.681167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1508,"log_dups_size":0,"ondisk_log_size":1508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29753344,"num_objects":454,"num_object_clones":0,"num_object_copies":1362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1508,"num_write_kb":62784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"26'1473","reported_seq":1509,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:11.679017+0000","last_change":"2024-09-15T12:18:53.109204+0000","last_active":"2024-09-15T12:21:11.679017+0000","last_peered":"2024-09-15T12:21:11.679017+0000","last_clean":"2024-09-15T12:21:11.679017+0000","last_became_active":"2024-09-15T12:18:53.087134+0000","last_became_peered":"2024-09-15T12:18:53.087134+0000","last_unstale":"2024-09-15T12:21:11.679017+0000","last_undegraded":"2024-09-15T12:21:11.679017+0000","last_fullsized":"2024-09-15T12:21:11.679017+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1473,"log_dups_size":0,"ondisk_log_size":1473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29949952,"num_objects":457,"num_object_clones":0,"num_object_copies":1371,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1473,"num_write_kb":61760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"26'1469","reported_seq":1505,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.637762+0000","last_change":"2024-09-15T12:18:53.119675+0000","last_active":"2024-09-15T12:21:10.637762+0000","last_peered":"2024-09-15T12:21:10.637762+0000","last_clean":"2024-09-15T12:21:10.637762+0000","last_became_active":"2024-09-15T12:18:53.112010+0000","last_became_peered":"2024-09-15T12:18:53.112010+0000","last_unstale":"2024-09-15T12:21:10.637762+0000","last_undegraded":"2024-09-15T12:21:10.637762+0000","last_fullsized":"2024-09-15T12:21:10.637762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1469,"log_dups_size":0,"ondisk_log_size":1469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29556736,"num_objects":451,"num_object_clones":0,"num_object_copies":1353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1469,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"26'1492","reported_seq":1528,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.492562+0000","last_change":"2024-09-15T12:18:53.136381+0000","last_active":"2024-09-15T12:21:10.492562+0000","last_peered":"2024-09-15T12:21:10.492562+0000","last_clean":"2024-09-15T12:21:10.492562+0000","last_became_active":"2024-09-15T12:18:53.128765+0000","last_became_peered":"2024-09-15T12:18:53.128765+0000","last_unstale":"2024-09-15T12:21:10.492562+0000","last_undegraded":"2024-09-15T12:21:10.492562+0000","last_fullsized":"2024-09-15T12:21:10.492562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1492,"log_dups_size":0,"ondisk_log_size":1492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29097984,"num_objects":444,"num_object_clones":0,"num_object_copies":1332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1492,"num_write_kb":61952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"26'1534","reported_seq":1570,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.426829+0000","last_change":"2024-09-15T12:18:53.090984+0000","last_active":"2024-09-15T12:21:10.426829+0000","last_peered":"2024-09-15T12:21:10.426829+0000","last_clean":"2024-09-15T12:21:10.426829+0000","last_became_active":"2024-09-15T12:18:53.080676+0000","last_became_peered":"2024-09-15T12:18:53.080676+0000","last_unstale":"2024-09-15T12:21:10.426829+0000","last_undegraded":"2024-09-15T12:21:10.426829+0000","last_fullsized":"2024-09-15T12:21:10.426829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1534,"log_dups_size":0,"ondisk_log_size":1534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30801920,"num_objects":470,"num_object_clones":0,"num_object_copies":1410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1534,"num_write_kb":64128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":121,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.289678+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:20:36.289678+0000","last_peered":"2024-09-15T12:20:36.289678+0000","last_clean":"2024-09-15T12:20:36.289678+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:20:36.289678+0000","last_undegraded":"2024-09-15T12:20:36.289678+0000","last_fullsized":"2024-09-15T12:20:36.289678+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":50,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.311568+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:20:36.311568+0000","last_peered":"2024-09-15T12:20:36.311568+0000","last_clean":"2024-09-15T12:20:36.311568+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:20:36.311568+0000","last_undegraded":"2024-09-15T12:20:36.311568+0000","last_fullsized":"2024-09-15T12:20:36.311568+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"26'1533","reported_seq":1569,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.648688+0000","last_change":"2024-09-15T12:18:53.172532+0000","last_active":"2024-09-15T12:21:10.648688+0000","last_peered":"2024-09-15T12:21:10.648688+0000","last_clean":"2024-09-15T12:21:10.648688+0000","last_became_active":"2024-09-15T12:18:53.166197+0000","last_became_peered":"2024-09-15T12:18:53.166197+0000","last_unstale":"2024-09-15T12:21:10.648688+0000","last_undegraded":"2024-09-15T12:21:10.648688+0000","last_fullsized":"2024-09-15T12:21:10.648688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1533,"log_dups_size":0,"ondisk_log_size":1533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31391744,"num_objects":479,"num_object_clones":0,"num_object_copies":1437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1533,"num_write_kb":64384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.288506+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:20:36.288506+0000","last_peered":"2024-09-15T12:20:36.288506+0000","last_clean":"2024-09-15T12:20:36.288506+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:20:36.288506+0000","last_undegraded":"2024-09-15T12:20:36.288506+0000","last_fullsized":"2024-09-15T12:20:36.288506+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"26'1481","reported_seq":1517,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:11.509342+0000","last_change":"2024-09-15T12:18:53.161283+0000","last_active":"2024-09-15T12:21:11.509342+0000","last_peered":"2024-09-15T12:21:11.509342+0000","last_clean":"2024-09-15T12:21:11.509342+0000","last_became_active":"2024-09-15T12:18:53.149710+0000","last_became_peered":"2024-09-15T12:18:53.149710+0000","last_unstale":"2024-09-15T12:21:11.509342+0000","last_undegraded":"2024-09-15T12:21:11.509342+0000","last_fullsized":"2024-09-15T12:21:11.509342+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1481,"log_dups_size":0,"ondisk_log_size":1481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26935296,"num_objects":411,"num_object_clones":0,"num_object_copies":1233,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1481,"num_write_kb":60544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.308887+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:20:36.308887+0000","last_peered":"2024-09-15T12:20:36.308887+0000","last_clean":"2024-09-15T12:20:36.308887+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:20:36.308887+0000","last_undegraded":"2024-09-15T12:20:36.308887+0000","last_fullsized":"2024-09-15T12:20:36.308887+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"26'1520","reported_seq":1556,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:11.609758+0000","last_change":"2024-09-15T12:18:53.169843+0000","last_active":"2024-09-15T12:21:11.609758+0000","last_peered":"2024-09-15T12:21:11.609758+0000","last_clean":"2024-09-15T12:21:11.609758+0000","last_became_active":"2024-09-15T12:18:53.161921+0000","last_became_peered":"2024-09-15T12:18:53.161921+0000","last_unstale":"2024-09-15T12:21:11.609758+0000","last_undegraded":"2024-09-15T12:21:11.609758+0000","last_fullsized":"2024-09-15T12:21:11.609758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1520,"log_dups_size":0,"ondisk_log_size":1520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27787264,"num_objects":424,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1520,"num_write_kb":62208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":51,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.284665+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:20:36.284665+0000","last_peered":"2024-09-15T12:20:36.284665+0000","last_clean":"2024-09-15T12:20:36.284665+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:20:36.284665+0000","last_undegraded":"2024-09-15T12:20:36.284665+0000","last_fullsized":"2024-09-15T12:20:36.284665+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"26'1558","reported_seq":1594,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.713277+0000","last_change":"2024-09-15T12:18:53.100005+0000","last_active":"2024-09-15T12:21:10.713277+0000","last_peered":"2024-09-15T12:21:10.713277+0000","last_clean":"2024-09-15T12:21:10.713277+0000","last_became_active":"2024-09-15T12:18:53.080705+0000","last_became_peered":"2024-09-15T12:18:53.080705+0000","last_unstale":"2024-09-15T12:21:10.713277+0000","last_undegraded":"2024-09-15T12:21:10.713277+0000","last_fullsized":"2024-09-15T12:21:10.713277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1558,"log_dups_size":0,"ondisk_log_size":1558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28311552,"num_objects":432,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1558,"num_write_kb":63680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"26'1545","reported_seq":1581,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.444728+0000","last_change":"2024-09-15T12:18:53.122880+0000","last_active":"2024-09-15T12:21:10.444728+0000","last_peered":"2024-09-15T12:21:10.444728+0000","last_clean":"2024-09-15T12:21:10.444728+0000","last_became_active":"2024-09-15T12:18:53.111647+0000","last_became_peered":"2024-09-15T12:18:53.111647+0000","last_unstale":"2024-09-15T12:21:10.444728+0000","last_undegraded":"2024-09-15T12:21:10.444728+0000","last_fullsized":"2024-09-15T12:21:10.444728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1545,"log_dups_size":0,"ondisk_log_size":1545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32047104,"num_objects":489,"num_object_clones":0,"num_object_copies":1467,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1545,"num_write_kb":65088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.280090+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:20:36.280090+0000","last_peered":"2024-09-15T12:20:36.280090+0000","last_clean":"2024-09-15T12:20:36.280090+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:20:36.280090+0000","last_undegraded":"2024-09-15T12:20:36.280090+0000","last_fullsized":"2024-09-15T12:20:36.280090+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"26'1542","reported_seq":1578,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.632716+0000","last_change":"2024-09-15T12:18:53.133542+0000","last_active":"2024-09-15T12:21:10.632716+0000","last_peered":"2024-09-15T12:21:10.632716+0000","last_clean":"2024-09-15T12:21:10.632716+0000","last_became_active":"2024-09-15T12:18:53.125716+0000","last_became_peered":"2024-09-15T12:18:53.125716+0000","last_unstale":"2024-09-15T12:21:10.632716+0000","last_undegraded":"2024-09-15T12:21:10.632716+0000","last_fullsized":"2024-09-15T12:21:10.632716+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1542,"log_dups_size":0,"ondisk_log_size":1542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29884416,"num_objects":456,"num_object_clones":0,"num_object_copies":1368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1542,"num_write_kb":63936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.299694+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:20:36.299694+0000","last_peered":"2024-09-15T12:20:36.299694+0000","last_clean":"2024-09-15T12:20:36.299694+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:20:36.299694+0000","last_undegraded":"2024-09-15T12:20:36.299694+0000","last_fullsized":"2024-09-15T12:20:36.299694+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"26'1501","reported_seq":1537,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:11.538704+0000","last_change":"2024-09-15T12:18:53.133963+0000","last_active":"2024-09-15T12:21:11.538704+0000","last_peered":"2024-09-15T12:21:11.538704+0000","last_clean":"2024-09-15T12:21:11.538704+0000","last_became_active":"2024-09-15T12:18:53.122383+0000","last_became_peered":"2024-09-15T12:18:53.122383+0000","last_unstale":"2024-09-15T12:21:11.538704+0000","last_undegraded":"2024-09-15T12:21:11.538704+0000","last_fullsized":"2024-09-15T12:21:11.538704+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1501,"log_dups_size":0,"ondisk_log_size":1501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28639232,"num_objects":437,"num_object_clones":0,"num_object_copies":1311,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1501,"num_write_kb":62016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.280291+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:20:36.280291+0000","last_peered":"2024-09-15T12:20:36.280291+0000","last_clean":"2024-09-15T12:20:36.280291+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:20:36.280291+0000","last_undegraded":"2024-09-15T12:20:36.280291+0000","last_fullsized":"2024-09-15T12:20:36.280291+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"26'1562","reported_seq":1598,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.608068+0000","last_change":"2024-09-15T12:18:53.102960+0000","last_active":"2024-09-15T12:21:10.608068+0000","last_peered":"2024-09-15T12:21:10.608068+0000","last_clean":"2024-09-15T12:21:10.608068+0000","last_became_active":"2024-09-15T12:18:53.088807+0000","last_became_peered":"2024-09-15T12:18:53.088807+0000","last_unstale":"2024-09-15T12:21:10.608068+0000","last_undegraded":"2024-09-15T12:21:10.608068+0000","last_fullsized":"2024-09-15T12:21:10.608068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1562,"log_dups_size":0,"ondisk_log_size":1562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30408704,"num_objects":464,"num_object_clones":0,"num_object_copies":1392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1562,"num_write_kb":64832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.312203+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:20:36.312203+0000","last_peered":"2024-09-15T12:20:36.312203+0000","last_clean":"2024-09-15T12:20:36.312203+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:20:36.312203+0000","last_undegraded":"2024-09-15T12:20:36.312203+0000","last_fullsized":"2024-09-15T12:20:36.312203+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":476446744,"num_objects":7271,"num_object_clones":0,"num_object_copies":21813,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":24141,"num_write_kb":1005121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":89243648,"data_stored":1427701832,"data_compressed":67794917,"data_compressed_allocated":89231360,"data_compressed_original":1427701760,"omap_allocated":0,"internal_metadata":0},"log_size":24141,"ondisk_log_size":24141,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673109,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70604,"kb_used_data":25724,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94301236,"statfs":{"total":96636764160,"available":96564465664,"internally_reserved":0,"allocated":26341376,"data_stored":417601551,"data_compressed":19828575,"data_compressed_allocated":26099712,"data_compressed_original":417513472,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47620,"kb_used_data":20788,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94324220,"statfs":{"total":96636764160,"available":96588001280,"internally_reserved":0,"allocated":21286912,"data_stored":336730122,"data_compressed":15988368,"data_compressed_allocated":21045248,"data_compressed_original":336642048,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":53592,"kb_used_data":22600,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94318248,"statfs":{"total":96636764160,"available":96581885952,"internally_reserved":0,"allocated":23142400,"data_stored":366745090,"data_compressed":17411639,"data_compressed_allocated":22917120,"data_compressed_original":366673920,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64112,"kb_used_data":20640,"kb_used_omap":0,"kb_used_meta":43456,"kb_avail":94307728,"statfs":{"total":96636764160,"available":96571113472,"internally_reserved":0,"allocated":21135360,"data_stored":334239778,"data_compressed":15870111,"data_compressed_allocated":20889600,"data_compressed_original":334151680,"omap_allocated":0,"internal_metadata":44498944},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20455424,"data_stored":327221272,"data_compressed":15538215,"data_compressed_allocated":20451328,"data_compressed_original":327221248,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22552576,"data_stored":360775704,"data_compressed":17131559,"data_compressed_allocated":22548480,"data_compressed_original":360775680,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20598784,"data_stored":329580544,"data_compressed":15650248,"data_compressed_allocated":20598784,"data_compressed_original":329580544,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25636864,"data_stored":410124312,"data_compressed":19474895,"data_compressed_allocated":25632768,"data_compressed_original":410124288,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:21:20.318 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:21:20.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:20.483+0000 7efd02d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:20.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:20.490+0000 7efd02d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:22.752 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:21:22.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:22.893+0000 7fa00864f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:22.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:22.901+0000 7fa00864f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:23.535 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:21:23.535 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:21:23.535 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:21:23.536 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:21:23.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:23.695+0000 7f5ea4b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:23.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:23.707+0000 7f5ea4b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:23.729 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:21:23.729 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:21:23.729 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:21:23.729 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:21:23.730 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:21:23.730 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:21:23.730 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:21:23.730 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:21:23.730 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:21:23.730 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:21:23.730 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:21:23.730 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:21:23.735 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:21:23.735 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:21:23.735 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:21:23.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:23.883+0000 7f2719f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:23.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:23.898+0000 7f2718cef640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:24.008 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:21:24.009 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:21:24.009 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:21:24.009 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:21:24.009 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:21:24.009 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:21:24.009 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:21:24.009 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:21:24.009 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:21:24.009 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:21:24.009 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:21:24.009 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:21:24.012 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:21:24.013 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:21:24.013 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:21:24.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:24.158+0000 7fee34591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:24.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:24.174+0000 7fee34591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:24.220 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:21:24.221 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:21:24.221 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:21:24.221 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:21:24.221 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:21:24.221 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:21:24.221 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:21:24.221 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:21:24.221 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:21:24.221 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:21:24.221 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:21:24.221 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:21:24.225 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:21:24.226 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:21:24.226 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:21:24.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:24.376+0000 7f7869274640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:24.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:24.390+0000 7f7869274640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:24.543 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:21:24.543 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:21:24.543 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:21:24.543 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:21:24.544 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:21:24.544 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:21:24.544 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:21:24.544 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:21:24.544 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:21:24.544 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:21:24.544 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:21:24.544 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:21:24.548 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:21:24.548 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:21:25.254 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:21:25.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:25.387+0000 7f9ab7111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:25.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:25.395+0000 7f9ab7111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:27.691 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:21:27.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:27.837+0000 7f122b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:27.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:27.845+0000 7f122b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:29.549 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:21:29.550 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:21:29.550 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:21:29.550 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:21:29.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:29.714+0000 7f2e4984f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:29.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:29.732+0000 7f2e4984f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:29.761 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:21:29.761 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:21:29.761 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:21:29.762 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:21:29.762 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:21:29.762 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:21:29.762 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:21:29.762 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:21:29.762 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:21:29.762 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:21:29.762 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:21:29.762 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:21:29.768 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:21:29.768 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:21:29.768 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:21:29.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:29.907+0000 7f5ebd391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:29.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:29.921+0000 7f5ebd391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:30.112 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:21:30.113 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:21:30.113 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:21:30.113 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:21:30.113 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:21:30.113 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:21:30.113 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:21:30.113 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:21:30.113 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:21:30.113 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:21:30.113 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:21:30.113 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:21:30.117 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:21:30.117 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:21:30.117 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:21:30.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:30.276+0000 7fb244391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:30.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:30.292+0000 7fb244391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:30.358 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:21:30.366 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:21:30.366 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:21:30.366 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:21:30.366 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:21:30.366 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:21:30.366 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:21:30.366 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:21:30.366 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:21:30.366 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:21:30.366 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:21:30.367 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:21:30.367 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:21:30.371 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:21:30.372 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:21:30.372 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:21:30.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:30.506+0000 7fb8ecf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:30.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:30.514+0000 7fb8ecf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:30.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:30.556+0000 7fc990a9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:30.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:30.570+0000 7fc990a9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:30.663 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:21:30.664 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:21:30.664 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:21:30.664 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:21:30.664 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:21:30.664 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:21:30.664 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:21:30.664 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:21:30.664 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:21:30.664 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:21:30.664 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:21:30.664 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:21:30.667 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:21:30.668 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:21:32.924 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:21:33.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:33.090+0000 7fdf2e708640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:33.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:33.098+0000 7fdf2e708640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:35.559 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:21:35.668 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:21:35.668 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-15T12:21:35.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:35.721+0000 7f77fc8a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:35.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:35.729+0000 7f77fc8a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:35.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:35.823+0000 7fe5dc4bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:35.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:35.851+0000 7fe5dc4bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:37.235 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.0 to 1 (10000) 2024-09-15T12:21:37.258 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-15T12:21:37.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:37.409+0000 7fbd73b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:37.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:37.423+0000 7fbd73b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:38.243 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.1 to 1 (10000) 2024-09-15T12:21:38.263 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-15T12:21:38.378 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:21:38.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:38.414+0000 7f2da6d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:38.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:38.436+0000 7f2da6d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:38.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:38.527+0000 7fa833b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:38.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:38.533+0000 7fa833b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:39.244 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.2 to 1 (10000) 2024-09-15T12:21:39.263 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-15T12:21:39.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:39.390+0000 7f5161791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:39.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:39.407+0000 7f5161791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:40.250 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.3 to 1 (10000) 2024-09-15T12:21:40.267 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-15T12:21:40.267 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:21:40.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:40.391+0000 7fbe9c351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:40.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:40.403+0000 7fbe9c351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:40.678 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:21:40.678 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:21:40.699 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2024-09-15T12:21:40.252795+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":477037131,"num_objects":7275,"num_object_clones":0,"num_object_copies":21825,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":24222,"num_write_kb":1006229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24196,"ondisk_log_size":24196,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":235928,"kb_used_data":89752,"kb_used_omap":0,"kb_used_meta":146112,"kb_avail":377251432,"statfs":{"total":386547056640,"available":386305466368,"internally_reserved":0,"allocated":91906048,"data_stored":1455316541,"data_compressed":69098693,"data_compressed_allocated":90951680,"data_compressed_original":1454981120,"omap_allocated":0,"internal_metadata":149618688},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.516665"},"pg_stats":[{"pgid":"3.f","version":"26'1457","reported_seq":1493,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.667695+0000","last_change":"2024-09-15T12:18:53.083350+0000","last_active":"2024-09-15T12:21:10.667695+0000","last_peered":"2024-09-15T12:21:10.667695+0000","last_clean":"2024-09-15T12:21:10.667695+0000","last_became_active":"2024-09-15T12:18:53.075051+0000","last_became_peered":"2024-09-15T12:18:53.075051+0000","last_unstale":"2024-09-15T12:21:10.667695+0000","last_undegraded":"2024-09-15T12:21:10.667695+0000","last_fullsized":"2024-09-15T12:21:10.667695+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1457,"log_dups_size":0,"ondisk_log_size":1457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30998528,"num_objects":473,"num_object_clones":0,"num_object_copies":1419,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1457,"num_write_kb":61760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"26'1408","reported_seq":1444,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.672016+0000","last_change":"2024-09-15T12:18:53.139711+0000","last_active":"2024-09-15T12:21:10.672016+0000","last_peered":"2024-09-15T12:21:10.672016+0000","last_clean":"2024-09-15T12:21:10.672016+0000","last_became_active":"2024-09-15T12:18:53.130124+0000","last_became_peered":"2024-09-15T12:18:53.130124+0000","last_unstale":"2024-09-15T12:21:10.672016+0000","last_undegraded":"2024-09-15T12:21:10.672016+0000","last_fullsized":"2024-09-15T12:21:10.672016+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1408,"log_dups_size":0,"ondisk_log_size":1408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1408,"num_write_kb":59840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"26'1558","reported_seq":1595,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.608587+0000","last_change":"2024-09-15T12:18:53.140327+0000","last_active":"2024-09-15T12:21:10.608587+0000","last_peered":"2024-09-15T12:21:10.608587+0000","last_clean":"2024-09-15T12:21:10.608587+0000","last_became_active":"2024-09-15T12:18:53.128935+0000","last_became_peered":"2024-09-15T12:18:53.128935+0000","last_unstale":"2024-09-15T12:21:10.608587+0000","last_undegraded":"2024-09-15T12:21:10.608587+0000","last_fullsized":"2024-09-15T12:21:10.608587+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1558,"log_dups_size":0,"ondisk_log_size":1558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30605336,"num_objects":468,"num_object_clones":0,"num_object_copies":1404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1558,"num_write_kb":64769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"26'1508","reported_seq":1544,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.681167+0000","last_change":"2024-09-15T12:18:53.138678+0000","last_active":"2024-09-15T12:21:10.681167+0000","last_peered":"2024-09-15T12:21:10.681167+0000","last_clean":"2024-09-15T12:21:10.681167+0000","last_became_active":"2024-09-15T12:18:53.129492+0000","last_became_peered":"2024-09-15T12:18:53.129492+0000","last_unstale":"2024-09-15T12:21:10.681167+0000","last_undegraded":"2024-09-15T12:21:10.681167+0000","last_fullsized":"2024-09-15T12:21:10.681167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1508,"log_dups_size":0,"ondisk_log_size":1508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29753344,"num_objects":454,"num_object_clones":0,"num_object_copies":1362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1508,"num_write_kb":62784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"26'1473","reported_seq":1509,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:11.679017+0000","last_change":"2024-09-15T12:18:53.109204+0000","last_active":"2024-09-15T12:21:11.679017+0000","last_peered":"2024-09-15T12:21:11.679017+0000","last_clean":"2024-09-15T12:21:11.679017+0000","last_became_active":"2024-09-15T12:18:53.087134+0000","last_became_peered":"2024-09-15T12:18:53.087134+0000","last_unstale":"2024-09-15T12:21:11.679017+0000","last_undegraded":"2024-09-15T12:21:11.679017+0000","last_fullsized":"2024-09-15T12:21:11.679017+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1473,"log_dups_size":0,"ondisk_log_size":1473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29949952,"num_objects":457,"num_object_clones":0,"num_object_copies":1371,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1473,"num_write_kb":61760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"26'1469","reported_seq":1505,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.637762+0000","last_change":"2024-09-15T12:18:53.119675+0000","last_active":"2024-09-15T12:21:10.637762+0000","last_peered":"2024-09-15T12:21:10.637762+0000","last_clean":"2024-09-15T12:21:10.637762+0000","last_became_active":"2024-09-15T12:18:53.112010+0000","last_became_peered":"2024-09-15T12:18:53.112010+0000","last_unstale":"2024-09-15T12:21:10.637762+0000","last_undegraded":"2024-09-15T12:21:10.637762+0000","last_fullsized":"2024-09-15T12:21:10.637762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1469,"log_dups_size":0,"ondisk_log_size":1469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29556736,"num_objects":451,"num_object_clones":0,"num_object_copies":1353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1469,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"26'1492","reported_seq":1528,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.492562+0000","last_change":"2024-09-15T12:18:53.136381+0000","last_active":"2024-09-15T12:21:10.492562+0000","last_peered":"2024-09-15T12:21:10.492562+0000","last_clean":"2024-09-15T12:21:10.492562+0000","last_became_active":"2024-09-15T12:18:53.128765+0000","last_became_peered":"2024-09-15T12:18:53.128765+0000","last_unstale":"2024-09-15T12:21:10.492562+0000","last_undegraded":"2024-09-15T12:21:10.492562+0000","last_fullsized":"2024-09-15T12:21:10.492562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1492,"log_dups_size":0,"ondisk_log_size":1492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29097984,"num_objects":444,"num_object_clones":0,"num_object_copies":1332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1492,"num_write_kb":61952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"26'1534","reported_seq":1570,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.426829+0000","last_change":"2024-09-15T12:18:53.090984+0000","last_active":"2024-09-15T12:21:10.426829+0000","last_peered":"2024-09-15T12:21:10.426829+0000","last_clean":"2024-09-15T12:21:10.426829+0000","last_became_active":"2024-09-15T12:18:53.080676+0000","last_became_peered":"2024-09-15T12:18:53.080676+0000","last_unstale":"2024-09-15T12:21:10.426829+0000","last_undegraded":"2024-09-15T12:21:10.426829+0000","last_fullsized":"2024-09-15T12:21:10.426829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1534,"log_dups_size":0,"ondisk_log_size":1534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30801920,"num_objects":470,"num_object_clones":0,"num_object_copies":1410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1534,"num_write_kb":64128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":121,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.289678+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:20:36.289678+0000","last_peered":"2024-09-15T12:20:36.289678+0000","last_clean":"2024-09-15T12:20:36.289678+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:20:36.289678+0000","last_undegraded":"2024-09-15T12:20:36.289678+0000","last_fullsized":"2024-09-15T12:20:36.289678+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":50,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.311568+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:20:36.311568+0000","last_peered":"2024-09-15T12:20:36.311568+0000","last_clean":"2024-09-15T12:20:36.311568+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:20:36.311568+0000","last_undegraded":"2024-09-15T12:20:36.311568+0000","last_fullsized":"2024-09-15T12:20:36.311568+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"26'1533","reported_seq":1569,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.648688+0000","last_change":"2024-09-15T12:18:53.172532+0000","last_active":"2024-09-15T12:21:10.648688+0000","last_peered":"2024-09-15T12:21:10.648688+0000","last_clean":"2024-09-15T12:21:10.648688+0000","last_became_active":"2024-09-15T12:18:53.166197+0000","last_became_peered":"2024-09-15T12:18:53.166197+0000","last_unstale":"2024-09-15T12:21:10.648688+0000","last_undegraded":"2024-09-15T12:21:10.648688+0000","last_fullsized":"2024-09-15T12:21:10.648688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1533,"log_dups_size":0,"ondisk_log_size":1533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31391744,"num_objects":479,"num_object_clones":0,"num_object_copies":1437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1533,"num_write_kb":64384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.288506+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:20:36.288506+0000","last_peered":"2024-09-15T12:20:36.288506+0000","last_clean":"2024-09-15T12:20:36.288506+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:20:36.288506+0000","last_undegraded":"2024-09-15T12:20:36.288506+0000","last_fullsized":"2024-09-15T12:20:36.288506+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"26'1481","reported_seq":1517,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:11.509342+0000","last_change":"2024-09-15T12:18:53.161283+0000","last_active":"2024-09-15T12:21:11.509342+0000","last_peered":"2024-09-15T12:21:11.509342+0000","last_clean":"2024-09-15T12:21:11.509342+0000","last_became_active":"2024-09-15T12:18:53.149710+0000","last_became_peered":"2024-09-15T12:18:53.149710+0000","last_unstale":"2024-09-15T12:21:11.509342+0000","last_undegraded":"2024-09-15T12:21:11.509342+0000","last_fullsized":"2024-09-15T12:21:11.509342+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1481,"log_dups_size":0,"ondisk_log_size":1481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26935296,"num_objects":411,"num_object_clones":0,"num_object_copies":1233,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1481,"num_write_kb":60544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.308887+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:20:36.308887+0000","last_peered":"2024-09-15T12:20:36.308887+0000","last_clean":"2024-09-15T12:20:36.308887+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:20:36.308887+0000","last_undegraded":"2024-09-15T12:20:36.308887+0000","last_fullsized":"2024-09-15T12:20:36.308887+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"26'1520","reported_seq":1556,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:11.609758+0000","last_change":"2024-09-15T12:18:53.169843+0000","last_active":"2024-09-15T12:21:11.609758+0000","last_peered":"2024-09-15T12:21:11.609758+0000","last_clean":"2024-09-15T12:21:11.609758+0000","last_became_active":"2024-09-15T12:18:53.161921+0000","last_became_peered":"2024-09-15T12:18:53.161921+0000","last_unstale":"2024-09-15T12:21:11.609758+0000","last_undegraded":"2024-09-15T12:21:11.609758+0000","last_fullsized":"2024-09-15T12:21:11.609758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1520,"log_dups_size":0,"ondisk_log_size":1520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27787264,"num_objects":424,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1520,"num_write_kb":62208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":51,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.284665+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:20:36.284665+0000","last_peered":"2024-09-15T12:20:36.284665+0000","last_clean":"2024-09-15T12:20:36.284665+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:20:36.284665+0000","last_undegraded":"2024-09-15T12:20:36.284665+0000","last_fullsized":"2024-09-15T12:20:36.284665+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"26'1558","reported_seq":1594,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.713277+0000","last_change":"2024-09-15T12:18:53.100005+0000","last_active":"2024-09-15T12:21:10.713277+0000","last_peered":"2024-09-15T12:21:10.713277+0000","last_clean":"2024-09-15T12:21:10.713277+0000","last_became_active":"2024-09-15T12:18:53.080705+0000","last_became_peered":"2024-09-15T12:18:53.080705+0000","last_unstale":"2024-09-15T12:21:10.713277+0000","last_undegraded":"2024-09-15T12:21:10.713277+0000","last_fullsized":"2024-09-15T12:21:10.713277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1558,"log_dups_size":0,"ondisk_log_size":1558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28311552,"num_objects":432,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1558,"num_write_kb":63680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"26'1545","reported_seq":1581,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.444728+0000","last_change":"2024-09-15T12:18:53.122880+0000","last_active":"2024-09-15T12:21:10.444728+0000","last_peered":"2024-09-15T12:21:10.444728+0000","last_clean":"2024-09-15T12:21:10.444728+0000","last_became_active":"2024-09-15T12:18:53.111647+0000","last_became_peered":"2024-09-15T12:18:53.111647+0000","last_unstale":"2024-09-15T12:21:10.444728+0000","last_undegraded":"2024-09-15T12:21:10.444728+0000","last_fullsized":"2024-09-15T12:21:10.444728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1545,"log_dups_size":0,"ondisk_log_size":1545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32047104,"num_objects":489,"num_object_clones":0,"num_object_copies":1467,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1545,"num_write_kb":65088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.280090+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:20:36.280090+0000","last_peered":"2024-09-15T12:20:36.280090+0000","last_clean":"2024-09-15T12:20:36.280090+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:20:36.280090+0000","last_undegraded":"2024-09-15T12:20:36.280090+0000","last_fullsized":"2024-09-15T12:20:36.280090+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"26'1542","reported_seq":1578,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.632716+0000","last_change":"2024-09-15T12:18:53.133542+0000","last_active":"2024-09-15T12:21:10.632716+0000","last_peered":"2024-09-15T12:21:10.632716+0000","last_clean":"2024-09-15T12:21:10.632716+0000","last_became_active":"2024-09-15T12:18:53.125716+0000","last_became_peered":"2024-09-15T12:18:53.125716+0000","last_unstale":"2024-09-15T12:21:10.632716+0000","last_undegraded":"2024-09-15T12:21:10.632716+0000","last_fullsized":"2024-09-15T12:21:10.632716+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1542,"log_dups_size":0,"ondisk_log_size":1542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29884416,"num_objects":456,"num_object_clones":0,"num_object_copies":1368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1542,"num_write_kb":63936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.299694+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:20:36.299694+0000","last_peered":"2024-09-15T12:20:36.299694+0000","last_clean":"2024-09-15T12:20:36.299694+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:20:36.299694+0000","last_undegraded":"2024-09-15T12:20:36.299694+0000","last_fullsized":"2024-09-15T12:20:36.299694+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"26'1501","reported_seq":1537,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:11.538704+0000","last_change":"2024-09-15T12:18:53.133963+0000","last_active":"2024-09-15T12:21:11.538704+0000","last_peered":"2024-09-15T12:21:11.538704+0000","last_clean":"2024-09-15T12:21:11.538704+0000","last_became_active":"2024-09-15T12:18:53.122383+0000","last_became_peered":"2024-09-15T12:18:53.122383+0000","last_unstale":"2024-09-15T12:21:11.538704+0000","last_undegraded":"2024-09-15T12:21:11.538704+0000","last_fullsized":"2024-09-15T12:21:11.538704+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1501,"log_dups_size":0,"ondisk_log_size":1501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28639232,"num_objects":437,"num_object_clones":0,"num_object_copies":1311,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1501,"num_write_kb":62016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.280291+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:20:36.280291+0000","last_peered":"2024-09-15T12:20:36.280291+0000","last_clean":"2024-09-15T12:20:36.280291+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:20:36.280291+0000","last_undegraded":"2024-09-15T12:20:36.280291+0000","last_fullsized":"2024-09-15T12:20:36.280291+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"26'1562","reported_seq":1598,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.608068+0000","last_change":"2024-09-15T12:18:53.102960+0000","last_active":"2024-09-15T12:21:10.608068+0000","last_peered":"2024-09-15T12:21:10.608068+0000","last_clean":"2024-09-15T12:21:10.608068+0000","last_became_active":"2024-09-15T12:18:53.088807+0000","last_became_peered":"2024-09-15T12:18:53.088807+0000","last_unstale":"2024-09-15T12:21:10.608068+0000","last_undegraded":"2024-09-15T12:21:10.608068+0000","last_fullsized":"2024-09-15T12:21:10.608068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1562,"log_dups_size":0,"ondisk_log_size":1562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30408704,"num_objects":464,"num_object_clones":0,"num_object_copies":1392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1562,"num_write_kb":64832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.312203+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:20:36.312203+0000","last_peered":"2024-09-15T12:20:36.312203+0000","last_clean":"2024-09-15T12:20:36.312203+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:20:36.312203+0000","last_undegraded":"2024-09-15T12:20:36.312203+0000","last_fullsized":"2024-09-15T12:20:36.312203+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":476446744,"num_objects":7271,"num_object_clones":0,"num_object_copies":21813,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":24141,"num_write_kb":1005121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":89243648,"data_stored":1427701832,"data_compressed":67794917,"data_compressed_allocated":89231360,"data_compressed_original":1427701760,"omap_allocated":0,"internal_metadata":0},"log_size":24141,"ondisk_log_size":24141,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673109,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70604,"kb_used_data":25724,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94301236,"statfs":{"total":96636764160,"available":96564465664,"internally_reserved":0,"allocated":26341376,"data_stored":417601551,"data_compressed":19828575,"data_compressed_allocated":26099712,"data_compressed_original":417513472,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47620,"kb_used_data":20788,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94324220,"statfs":{"total":96636764160,"available":96588001280,"internally_reserved":0,"allocated":21286912,"data_stored":336730122,"data_compressed":15988368,"data_compressed_allocated":21045248,"data_compressed_original":336642048,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":53592,"kb_used_data":22600,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94318248,"statfs":{"total":96636764160,"available":96581885952,"internally_reserved":0,"allocated":23142400,"data_stored":366745090,"data_compressed":17411639,"data_compressed_allocated":22917120,"data_compressed_original":366673920,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64112,"kb_used_data":20640,"kb_used_omap":0,"kb_used_meta":43456,"kb_avail":94307728,"statfs":{"total":96636764160,"available":96571113472,"internally_reserved":0,"allocated":21135360,"data_stored":334239778,"data_compressed":15870111,"data_compressed_allocated":20889600,"data_compressed_original":334151680,"omap_allocated":0,"internal_metadata":44498944},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20455424,"data_stored":327221272,"data_compressed":15538215,"data_compressed_allocated":20451328,"data_compressed_original":327221248,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22552576,"data_stored":360775704,"data_compressed":17131559,"data_compressed_allocated":22548480,"data_compressed_original":360775680,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20598784,"data_stored":329580544,"data_compressed":15650248,"data_compressed_allocated":20598784,"data_compressed_original":329580544,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25636864,"data_stored":410124312,"data_compressed":19474895,"data_compressed_allocated":25632768,"data_compressed_original":410124288,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:21:40.701 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:21:40.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:40.850+0000 7f8ef7191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:40.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:40.863+0000 7f8ef7191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:41.003 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:21:41.155 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:21:41.156 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:21:41.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:41.165+0000 7fe867c57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:41.173 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2024-09-15T12:21:40.252795+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":477037131,"num_objects":7275,"num_object_clones":0,"num_object_copies":21825,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":24222,"num_write_kb":1006229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24196,"ondisk_log_size":24196,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":235928,"kb_used_data":89752,"kb_used_omap":0,"kb_used_meta":146112,"kb_avail":377251432,"statfs":{"total":386547056640,"available":386305466368,"internally_reserved":0,"allocated":91906048,"data_stored":1455316541,"data_compressed":69098693,"data_compressed_allocated":90951680,"data_compressed_original":1454981120,"omap_allocated":0,"internal_metadata":149618688},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.516665"},"pg_stats":[{"pgid":"3.f","version":"26'1457","reported_seq":1493,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.667695+0000","last_change":"2024-09-15T12:18:53.083350+0000","last_active":"2024-09-15T12:21:10.667695+0000","last_peered":"2024-09-15T12:21:10.667695+0000","last_clean":"2024-09-15T12:21:10.667695+0000","last_became_active":"2024-09-15T12:18:53.075051+0000","last_became_peered":"2024-09-15T12:18:53.075051+0000","last_unstale":"2024-09-15T12:21:10.667695+0000","last_undegraded":"2024-09-15T12:21:10.667695+0000","last_fullsized":"2024-09-15T12:21:10.667695+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1457,"log_dups_size":0,"ondisk_log_size":1457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30998528,"num_objects":473,"num_object_clones":0,"num_object_copies":1419,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1457,"num_write_kb":61760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"26'1408","reported_seq":1444,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.672016+0000","last_change":"2024-09-15T12:18:53.139711+0000","last_active":"2024-09-15T12:21:10.672016+0000","last_peered":"2024-09-15T12:21:10.672016+0000","last_clean":"2024-09-15T12:21:10.672016+0000","last_became_active":"2024-09-15T12:18:53.130124+0000","last_became_peered":"2024-09-15T12:18:53.130124+0000","last_unstale":"2024-09-15T12:21:10.672016+0000","last_undegraded":"2024-09-15T12:21:10.672016+0000","last_fullsized":"2024-09-15T12:21:10.672016+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1408,"log_dups_size":0,"ondisk_log_size":1408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1408,"num_write_kb":59840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"26'1558","reported_seq":1595,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.608587+0000","last_change":"2024-09-15T12:18:53.140327+0000","last_active":"2024-09-15T12:21:10.608587+0000","last_peered":"2024-09-15T12:21:10.608587+0000","last_clean":"2024-09-15T12:21:10.608587+0000","last_became_active":"2024-09-15T12:18:53.128935+0000","last_became_peered":"2024-09-15T12:18:53.128935+0000","last_unstale":"2024-09-15T12:21:10.608587+0000","last_undegraded":"2024-09-15T12:21:10.608587+0000","last_fullsized":"2024-09-15T12:21:10.608587+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1558,"log_dups_size":0,"ondisk_log_size":1558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30605336,"num_objects":468,"num_object_clones":0,"num_object_copies":1404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1558,"num_write_kb":64769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"26'1508","reported_seq":1544,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.681167+0000","last_change":"2024-09-15T12:18:53.138678+0000","last_active":"2024-09-15T12:21:10.681167+0000","last_peered":"2024-09-15T12:21:10.681167+0000","last_clean":"2024-09-15T12:21:10.681167+0000","last_became_active":"2024-09-15T12:18:53.129492+0000","last_became_peered":"2024-09-15T12:18:53.129492+0000","last_unstale":"2024-09-15T12:21:10.681167+0000","last_undegraded":"2024-09-15T12:21:10.681167+0000","last_fullsized":"2024-09-15T12:21:10.681167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1508,"log_dups_size":0,"ondisk_log_size":1508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29753344,"num_objects":454,"num_object_clones":0,"num_object_copies":1362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1508,"num_write_kb":62784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"26'1473","reported_seq":1509,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:11.679017+0000","last_change":"2024-09-15T12:18:53.109204+0000","last_active":"2024-09-15T12:21:11.679017+0000","last_peered":"2024-09-15T12:21:11.679017+0000","last_clean":"2024-09-15T12:21:11.679017+0000","last_became_active":"2024-09-15T12:18:53.087134+0000","last_became_peered":"2024-09-15T12:18:53.087134+0000","last_unstale":"2024-09-15T12:21:11.679017+0000","last_undegraded":"2024-09-15T12:21:11.679017+0000","last_fullsized":"2024-09-15T12:21:11.679017+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1473,"log_dups_size":0,"ondisk_log_size":1473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29949952,"num_objects":457,"num_object_clones":0,"num_object_copies":1371,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1473,"num_write_kb":61760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"26'1469","reported_seq":1505,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.637762+0000","last_change":"2024-09-15T12:18:53.119675+0000","last_active":"2024-09-15T12:21:10.637762+0000","last_peered":"2024-09-15T12:21:10.637762+0000","last_clean":"2024-09-15T12:21:10.637762+0000","last_became_active":"2024-09-15T12:18:53.112010+0000","last_became_peered":"2024-09-15T12:18:53.112010+0000","last_unstale":"2024-09-15T12:21:10.637762+0000","last_undegraded":"2024-09-15T12:21:10.637762+0000","last_fullsized":"2024-09-15T12:21:10.637762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1469,"log_dups_size":0,"ondisk_log_size":1469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29556736,"num_objects":451,"num_object_clones":0,"num_object_copies":1353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1469,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"26'1492","reported_seq":1528,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.492562+0000","last_change":"2024-09-15T12:18:53.136381+0000","last_active":"2024-09-15T12:21:10.492562+0000","last_peered":"2024-09-15T12:21:10.492562+0000","last_clean":"2024-09-15T12:21:10.492562+0000","last_became_active":"2024-09-15T12:18:53.128765+0000","last_became_peered":"2024-09-15T12:18:53.128765+0000","last_unstale":"2024-09-15T12:21:10.492562+0000","last_undegraded":"2024-09-15T12:21:10.492562+0000","last_fullsized":"2024-09-15T12:21:10.492562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1492,"log_dups_size":0,"ondisk_log_size":1492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29097984,"num_objects":444,"num_object_clones":0,"num_object_copies":1332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1492,"num_write_kb":61952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"26'1534","reported_seq":1570,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.426829+0000","last_change":"2024-09-15T12:18:53.090984+0000","last_active":"2024-09-15T12:21:10.426829+0000","last_peered":"2024-09-15T12:21:10.426829+0000","last_clean":"2024-09-15T12:21:10.426829+0000","last_became_active":"2024-09-15T12:18:53.080676+0000","last_became_peered":"2024-09-15T12:18:53.080676+0000","last_unstale":"2024-09-15T12:21:10.426829+0000","last_undegraded":"2024-09-15T12:21:10.426829+0000","last_fullsized":"2024-09-15T12:21:10.426829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1534,"log_dups_size":0,"ondisk_log_size":1534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30801920,"num_objects":470,"num_object_clones":0,"num_object_copies":1410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1534,"num_write_kb":64128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":121,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.289678+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:20:36.289678+0000","last_peered":"2024-09-15T12:20:36.289678+0000","last_clean":"2024-09-15T12:20:36.289678+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:20:36.289678+0000","last_undegraded":"2024-09-15T12:20:36.289678+0000","last_fullsized":"2024-09-15T12:20:36.289678+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":50,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.311568+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:20:36.311568+0000","last_peered":"2024-09-15T12:20:36.311568+0000","last_clean":"2024-09-15T12:20:36.311568+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:20:36.311568+0000","last_undegraded":"2024-09-15T12:20:36.311568+0000","last_fullsized":"2024-09-15T12:20:36.311568+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"26'1533","reported_seq":1569,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.648688+0000","last_change":"2024-09-15T12:18:53.172532+0000","last_active":"2024-09-15T12:21:10.648688+0000","last_peered":"2024-09-15T12:21:10.648688+0000","last_clean":"2024-09-15T12:21:10.648688+0000","last_became_active":"2024-09-15T12:18:53.166197+0000","last_became_peered":"2024-09-15T12:18:53.166197+0000","last_unstale":"2024-09-15T12:21:10.648688+0000","last_undegraded":"2024-09-15T12:21:10.648688+0000","last_fullsized":"2024-09-15T12:21:10.648688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1533,"log_dups_size":0,"ondisk_log_size":1533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31391744,"num_objects":479,"num_object_clones":0,"num_object_copies":1437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1533,"num_write_kb":64384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.288506+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:20:36.288506+0000","last_peered":"2024-09-15T12:20:36.288506+0000","last_clean":"2024-09-15T12:20:36.288506+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:20:36.288506+0000","last_undegraded":"2024-09-15T12:20:36.288506+0000","last_fullsized":"2024-09-15T12:20:36.288506+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"26'1481","reported_seq":1517,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:11.509342+0000","last_change":"2024-09-15T12:18:53.161283+0000","last_active":"2024-09-15T12:21:11.509342+0000","last_peered":"2024-09-15T12:21:11.509342+0000","last_clean":"2024-09-15T12:21:11.509342+0000","last_became_active":"2024-09-15T12:18:53.149710+0000","last_became_peered":"2024-09-15T12:18:53.149710+0000","last_unstale":"2024-09-15T12:21:11.509342+0000","last_undegraded":"2024-09-15T12:21:11.509342+0000","last_fullsized":"2024-09-15T12:21:11.509342+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1481,"log_dups_size":0,"ondisk_log_size":1481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26935296,"num_objects":411,"num_object_clones":0,"num_object_copies":1233,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1481,"num_write_kb":60544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.308887+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:20:36.308887+0000","last_peered":"2024-09-15T12:20:36.308887+0000","last_clean":"2024-09-15T12:20:36.308887+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:20:36.308887+0000","last_undegraded":"2024-09-15T12:20:36.308887+0000","last_fullsized":"2024-09-15T12:20:36.308887+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"26'1520","reported_seq":1556,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:11.609758+0000","last_change":"2024-09-15T12:18:53.169843+0000","last_active":"2024-09-15T12:21:11.609758+0000","last_peered":"2024-09-15T12:21:11.609758+0000","last_clean":"2024-09-15T12:21:11.609758+0000","last_became_active":"2024-09-15T12:18:53.161921+0000","last_became_peered":"2024-09-15T12:18:53.161921+0000","last_unstale":"2024-09-15T12:21:11.609758+0000","last_undegraded":"2024-09-15T12:21:11.609758+0000","last_fullsized":"2024-09-15T12:21:11.609758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1520,"log_dups_size":0,"ondisk_log_size":1520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27787264,"num_objects":424,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1520,"num_write_kb":62208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":51,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.284665+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:20:36.284665+0000","last_peered":"2024-09-15T12:20:36.284665+0000","last_clean":"2024-09-15T12:20:36.284665+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:20:36.284665+0000","last_undegraded":"2024-09-15T12:20:36.284665+0000","last_fullsized":"2024-09-15T12:20:36.284665+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"26'1558","reported_seq":1594,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.713277+0000","last_change":"2024-09-15T12:18:53.100005+0000","last_active":"2024-09-15T12:21:10.713277+0000","last_peered":"2024-09-15T12:21:10.713277+0000","last_clean":"2024-09-15T12:21:10.713277+0000","last_became_active":"2024-09-15T12:18:53.080705+0000","last_became_peered":"2024-09-15T12:18:53.080705+0000","last_unstale":"2024-09-15T12:21:10.713277+0000","last_undegraded":"2024-09-15T12:21:10.713277+0000","last_fullsized":"2024-09-15T12:21:10.713277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1558,"log_dups_size":0,"ondisk_log_size":1558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28311552,"num_objects":432,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1558,"num_write_kb":63680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"26'1545","reported_seq":1581,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.444728+0000","last_change":"2024-09-15T12:18:53.122880+0000","last_active":"2024-09-15T12:21:10.444728+0000","last_peered":"2024-09-15T12:21:10.444728+0000","last_clean":"2024-09-15T12:21:10.444728+0000","last_became_active":"2024-09-15T12:18:53.111647+0000","last_became_peered":"2024-09-15T12:18:53.111647+0000","last_unstale":"2024-09-15T12:21:10.444728+0000","last_undegraded":"2024-09-15T12:21:10.444728+0000","last_fullsized":"2024-09-15T12:21:10.444728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1545,"log_dups_size":0,"ondisk_log_size":1545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32047104,"num_objects":489,"num_object_clones":0,"num_object_copies":1467,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1545,"num_write_kb":65088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.280090+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:20:36.280090+0000","last_peered":"2024-09-15T12:20:36.280090+0000","last_clean":"2024-09-15T12:20:36.280090+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:20:36.280090+0000","last_undegraded":"2024-09-15T12:20:36.280090+0000","last_fullsized":"2024-09-15T12:20:36.280090+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"26'1542","reported_seq":1578,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.632716+0000","last_change":"2024-09-15T12:18:53.133542+0000","last_active":"2024-09-15T12:21:10.632716+0000","last_peered":"2024-09-15T12:21:10.632716+0000","last_clean":"2024-09-15T12:21:10.632716+0000","last_became_active":"2024-09-15T12:18:53.125716+0000","last_became_peered":"2024-09-15T12:18:53.125716+0000","last_unstale":"2024-09-15T12:21:10.632716+0000","last_undegraded":"2024-09-15T12:21:10.632716+0000","last_fullsized":"2024-09-15T12:21:10.632716+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1542,"log_dups_size":0,"ondisk_log_size":1542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29884416,"num_objects":456,"num_object_clones":0,"num_object_copies":1368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1542,"num_write_kb":63936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.299694+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:20:36.299694+0000","last_peered":"2024-09-15T12:20:36.299694+0000","last_clean":"2024-09-15T12:20:36.299694+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:20:36.299694+0000","last_undegraded":"2024-09-15T12:20:36.299694+0000","last_fullsized":"2024-09-15T12:20:36.299694+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"26'1501","reported_seq":1537,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:11.538704+0000","last_change":"2024-09-15T12:18:53.133963+0000","last_active":"2024-09-15T12:21:11.538704+0000","last_peered":"2024-09-15T12:21:11.538704+0000","last_clean":"2024-09-15T12:21:11.538704+0000","last_became_active":"2024-09-15T12:18:53.122383+0000","last_became_peered":"2024-09-15T12:18:53.122383+0000","last_unstale":"2024-09-15T12:21:11.538704+0000","last_undegraded":"2024-09-15T12:21:11.538704+0000","last_fullsized":"2024-09-15T12:21:11.538704+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1501,"log_dups_size":0,"ondisk_log_size":1501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28639232,"num_objects":437,"num_object_clones":0,"num_object_copies":1311,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1501,"num_write_kb":62016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.280291+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:20:36.280291+0000","last_peered":"2024-09-15T12:20:36.280291+0000","last_clean":"2024-09-15T12:20:36.280291+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:20:36.280291+0000","last_undegraded":"2024-09-15T12:20:36.280291+0000","last_fullsized":"2024-09-15T12:20:36.280291+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"26'1562","reported_seq":1598,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.608068+0000","last_change":"2024-09-15T12:18:53.102960+0000","last_active":"2024-09-15T12:21:10.608068+0000","last_peered":"2024-09-15T12:21:10.608068+0000","last_clean":"2024-09-15T12:21:10.608068+0000","last_became_active":"2024-09-15T12:18:53.088807+0000","last_became_peered":"2024-09-15T12:18:53.088807+0000","last_unstale":"2024-09-15T12:21:10.608068+0000","last_undegraded":"2024-09-15T12:21:10.608068+0000","last_fullsized":"2024-09-15T12:21:10.608068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1562,"log_dups_size":0,"ondisk_log_size":1562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30408704,"num_objects":464,"num_object_clones":0,"num_object_copies":1392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1562,"num_write_kb":64832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.312203+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:20:36.312203+0000","last_peered":"2024-09-15T12:20:36.312203+0000","last_clean":"2024-09-15T12:20:36.312203+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:20:36.312203+0000","last_undegraded":"2024-09-15T12:20:36.312203+0000","last_fullsized":"2024-09-15T12:20:36.312203+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":476446744,"num_objects":7271,"num_object_clones":0,"num_object_copies":21813,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":24141,"num_write_kb":1005121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":89243648,"data_stored":1427701832,"data_compressed":67794917,"data_compressed_allocated":89231360,"data_compressed_original":1427701760,"omap_allocated":0,"internal_metadata":0},"log_size":24141,"ondisk_log_size":24141,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673109,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70604,"kb_used_data":25724,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94301236,"statfs":{"total":96636764160,"available":96564465664,"internally_reserved":0,"allocated":26341376,"data_stored":417601551,"data_compressed":19828575,"data_compressed_allocated":26099712,"data_compressed_original":417513472,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47620,"kb_used_data":20788,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94324220,"statfs":{"total":96636764160,"available":96588001280,"internally_reserved":0,"allocated":21286912,"data_stored":336730122,"data_compressed":15988368,"data_compressed_allocated":21045248,"data_compressed_original":336642048,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":53592,"kb_used_data":22600,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94318248,"statfs":{"total":96636764160,"available":96581885952,"internally_reserved":0,"allocated":23142400,"data_stored":366745090,"data_compressed":17411639,"data_compressed_allocated":22917120,"data_compressed_original":366673920,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64112,"kb_used_data":20640,"kb_used_omap":0,"kb_used_meta":43456,"kb_avail":94307728,"statfs":{"total":96636764160,"available":96571113472,"internally_reserved":0,"allocated":21135360,"data_stored":334239778,"data_compressed":15870111,"data_compressed_allocated":20889600,"data_compressed_original":334151680,"omap_allocated":0,"internal_metadata":44498944},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20455424,"data_stored":327221272,"data_compressed":15538215,"data_compressed_allocated":20451328,"data_compressed_original":327221248,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22552576,"data_stored":360775704,"data_compressed":17131559,"data_compressed_allocated":22548480,"data_compressed_original":360775680,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20598784,"data_stored":329580544,"data_compressed":15650248,"data_compressed_allocated":20598784,"data_compressed_original":329580544,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25636864,"data_stored":410124312,"data_compressed":19474895,"data_compressed_allocated":25632768,"data_compressed_original":410124288,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:21:41.175 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-15T12:21:41.175 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:21:41.175 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:21:41.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:41.175+0000 7fe867c57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:41.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:41.330+0000 7feada751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:41.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:41.346+0000 7feada751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:41.600 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:21:41.601 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:21:41.624 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2024-09-15T12:21:40.252795+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":477037131,"num_objects":7275,"num_object_clones":0,"num_object_copies":21825,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":24222,"num_write_kb":1006229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24196,"ondisk_log_size":24196,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":235928,"kb_used_data":89752,"kb_used_omap":0,"kb_used_meta":146112,"kb_avail":377251432,"statfs":{"total":386547056640,"available":386305466368,"internally_reserved":0,"allocated":91906048,"data_stored":1455316541,"data_compressed":69098693,"data_compressed_allocated":90951680,"data_compressed_original":1454981120,"omap_allocated":0,"internal_metadata":149618688},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.516665"},"pg_stats":[{"pgid":"3.f","version":"26'1457","reported_seq":1493,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.667695+0000","last_change":"2024-09-15T12:18:53.083350+0000","last_active":"2024-09-15T12:21:10.667695+0000","last_peered":"2024-09-15T12:21:10.667695+0000","last_clean":"2024-09-15T12:21:10.667695+0000","last_became_active":"2024-09-15T12:18:53.075051+0000","last_became_peered":"2024-09-15T12:18:53.075051+0000","last_unstale":"2024-09-15T12:21:10.667695+0000","last_undegraded":"2024-09-15T12:21:10.667695+0000","last_fullsized":"2024-09-15T12:21:10.667695+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1457,"log_dups_size":0,"ondisk_log_size":1457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30998528,"num_objects":473,"num_object_clones":0,"num_object_copies":1419,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1457,"num_write_kb":61760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"26'1408","reported_seq":1444,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.672016+0000","last_change":"2024-09-15T12:18:53.139711+0000","last_active":"2024-09-15T12:21:10.672016+0000","last_peered":"2024-09-15T12:21:10.672016+0000","last_clean":"2024-09-15T12:21:10.672016+0000","last_became_active":"2024-09-15T12:18:53.130124+0000","last_became_peered":"2024-09-15T12:18:53.130124+0000","last_unstale":"2024-09-15T12:21:10.672016+0000","last_undegraded":"2024-09-15T12:21:10.672016+0000","last_fullsized":"2024-09-15T12:21:10.672016+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1408,"log_dups_size":0,"ondisk_log_size":1408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1408,"num_write_kb":59840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"26'1558","reported_seq":1595,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.608587+0000","last_change":"2024-09-15T12:18:53.140327+0000","last_active":"2024-09-15T12:21:10.608587+0000","last_peered":"2024-09-15T12:21:10.608587+0000","last_clean":"2024-09-15T12:21:10.608587+0000","last_became_active":"2024-09-15T12:18:53.128935+0000","last_became_peered":"2024-09-15T12:18:53.128935+0000","last_unstale":"2024-09-15T12:21:10.608587+0000","last_undegraded":"2024-09-15T12:21:10.608587+0000","last_fullsized":"2024-09-15T12:21:10.608587+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1558,"log_dups_size":0,"ondisk_log_size":1558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30605336,"num_objects":468,"num_object_clones":0,"num_object_copies":1404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1558,"num_write_kb":64769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"26'1508","reported_seq":1544,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.681167+0000","last_change":"2024-09-15T12:18:53.138678+0000","last_active":"2024-09-15T12:21:10.681167+0000","last_peered":"2024-09-15T12:21:10.681167+0000","last_clean":"2024-09-15T12:21:10.681167+0000","last_became_active":"2024-09-15T12:18:53.129492+0000","last_became_peered":"2024-09-15T12:18:53.129492+0000","last_unstale":"2024-09-15T12:21:10.681167+0000","last_undegraded":"2024-09-15T12:21:10.681167+0000","last_fullsized":"2024-09-15T12:21:10.681167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1508,"log_dups_size":0,"ondisk_log_size":1508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29753344,"num_objects":454,"num_object_clones":0,"num_object_copies":1362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1508,"num_write_kb":62784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"26'1473","reported_seq":1509,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:11.679017+0000","last_change":"2024-09-15T12:18:53.109204+0000","last_active":"2024-09-15T12:21:11.679017+0000","last_peered":"2024-09-15T12:21:11.679017+0000","last_clean":"2024-09-15T12:21:11.679017+0000","last_became_active":"2024-09-15T12:18:53.087134+0000","last_became_peered":"2024-09-15T12:18:53.087134+0000","last_unstale":"2024-09-15T12:21:11.679017+0000","last_undegraded":"2024-09-15T12:21:11.679017+0000","last_fullsized":"2024-09-15T12:21:11.679017+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1473,"log_dups_size":0,"ondisk_log_size":1473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29949952,"num_objects":457,"num_object_clones":0,"num_object_copies":1371,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1473,"num_write_kb":61760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"26'1469","reported_seq":1505,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.637762+0000","last_change":"2024-09-15T12:18:53.119675+0000","last_active":"2024-09-15T12:21:10.637762+0000","last_peered":"2024-09-15T12:21:10.637762+0000","last_clean":"2024-09-15T12:21:10.637762+0000","last_became_active":"2024-09-15T12:18:53.112010+0000","last_became_peered":"2024-09-15T12:18:53.112010+0000","last_unstale":"2024-09-15T12:21:10.637762+0000","last_undegraded":"2024-09-15T12:21:10.637762+0000","last_fullsized":"2024-09-15T12:21:10.637762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1469,"log_dups_size":0,"ondisk_log_size":1469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29556736,"num_objects":451,"num_object_clones":0,"num_object_copies":1353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1469,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"26'1492","reported_seq":1528,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.492562+0000","last_change":"2024-09-15T12:18:53.136381+0000","last_active":"2024-09-15T12:21:10.492562+0000","last_peered":"2024-09-15T12:21:10.492562+0000","last_clean":"2024-09-15T12:21:10.492562+0000","last_became_active":"2024-09-15T12:18:53.128765+0000","last_became_peered":"2024-09-15T12:18:53.128765+0000","last_unstale":"2024-09-15T12:21:10.492562+0000","last_undegraded":"2024-09-15T12:21:10.492562+0000","last_fullsized":"2024-09-15T12:21:10.492562+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1492,"log_dups_size":0,"ondisk_log_size":1492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29097984,"num_objects":444,"num_object_clones":0,"num_object_copies":1332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1492,"num_write_kb":61952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"26'1534","reported_seq":1570,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.426829+0000","last_change":"2024-09-15T12:18:53.090984+0000","last_active":"2024-09-15T12:21:10.426829+0000","last_peered":"2024-09-15T12:21:10.426829+0000","last_clean":"2024-09-15T12:21:10.426829+0000","last_became_active":"2024-09-15T12:18:53.080676+0000","last_became_peered":"2024-09-15T12:18:53.080676+0000","last_unstale":"2024-09-15T12:21:10.426829+0000","last_undegraded":"2024-09-15T12:21:10.426829+0000","last_fullsized":"2024-09-15T12:21:10.426829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1534,"log_dups_size":0,"ondisk_log_size":1534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30801920,"num_objects":470,"num_object_clones":0,"num_object_copies":1410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1534,"num_write_kb":64128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":121,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.289678+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:20:36.289678+0000","last_peered":"2024-09-15T12:20:36.289678+0000","last_clean":"2024-09-15T12:20:36.289678+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:20:36.289678+0000","last_undegraded":"2024-09-15T12:20:36.289678+0000","last_fullsized":"2024-09-15T12:20:36.289678+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":50,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.311568+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:20:36.311568+0000","last_peered":"2024-09-15T12:20:36.311568+0000","last_clean":"2024-09-15T12:20:36.311568+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:20:36.311568+0000","last_undegraded":"2024-09-15T12:20:36.311568+0000","last_fullsized":"2024-09-15T12:20:36.311568+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"26'1533","reported_seq":1569,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.648688+0000","last_change":"2024-09-15T12:18:53.172532+0000","last_active":"2024-09-15T12:21:10.648688+0000","last_peered":"2024-09-15T12:21:10.648688+0000","last_clean":"2024-09-15T12:21:10.648688+0000","last_became_active":"2024-09-15T12:18:53.166197+0000","last_became_peered":"2024-09-15T12:18:53.166197+0000","last_unstale":"2024-09-15T12:21:10.648688+0000","last_undegraded":"2024-09-15T12:21:10.648688+0000","last_fullsized":"2024-09-15T12:21:10.648688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1533,"log_dups_size":0,"ondisk_log_size":1533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31391744,"num_objects":479,"num_object_clones":0,"num_object_copies":1437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1533,"num_write_kb":64384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.288506+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:20:36.288506+0000","last_peered":"2024-09-15T12:20:36.288506+0000","last_clean":"2024-09-15T12:20:36.288506+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:20:36.288506+0000","last_undegraded":"2024-09-15T12:20:36.288506+0000","last_fullsized":"2024-09-15T12:20:36.288506+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"26'1481","reported_seq":1517,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:11.509342+0000","last_change":"2024-09-15T12:18:53.161283+0000","last_active":"2024-09-15T12:21:11.509342+0000","last_peered":"2024-09-15T12:21:11.509342+0000","last_clean":"2024-09-15T12:21:11.509342+0000","last_became_active":"2024-09-15T12:18:53.149710+0000","last_became_peered":"2024-09-15T12:18:53.149710+0000","last_unstale":"2024-09-15T12:21:11.509342+0000","last_undegraded":"2024-09-15T12:21:11.509342+0000","last_fullsized":"2024-09-15T12:21:11.509342+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1481,"log_dups_size":0,"ondisk_log_size":1481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26935296,"num_objects":411,"num_object_clones":0,"num_object_copies":1233,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1481,"num_write_kb":60544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.308887+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:20:36.308887+0000","last_peered":"2024-09-15T12:20:36.308887+0000","last_clean":"2024-09-15T12:20:36.308887+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:20:36.308887+0000","last_undegraded":"2024-09-15T12:20:36.308887+0000","last_fullsized":"2024-09-15T12:20:36.308887+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"26'1520","reported_seq":1556,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:11.609758+0000","last_change":"2024-09-15T12:18:53.169843+0000","last_active":"2024-09-15T12:21:11.609758+0000","last_peered":"2024-09-15T12:21:11.609758+0000","last_clean":"2024-09-15T12:21:11.609758+0000","last_became_active":"2024-09-15T12:18:53.161921+0000","last_became_peered":"2024-09-15T12:18:53.161921+0000","last_unstale":"2024-09-15T12:21:11.609758+0000","last_undegraded":"2024-09-15T12:21:11.609758+0000","last_fullsized":"2024-09-15T12:21:11.609758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1520,"log_dups_size":0,"ondisk_log_size":1520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27787264,"num_objects":424,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1520,"num_write_kb":62208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":51,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.284665+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:20:36.284665+0000","last_peered":"2024-09-15T12:20:36.284665+0000","last_clean":"2024-09-15T12:20:36.284665+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:20:36.284665+0000","last_undegraded":"2024-09-15T12:20:36.284665+0000","last_fullsized":"2024-09-15T12:20:36.284665+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"26'1558","reported_seq":1594,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.713277+0000","last_change":"2024-09-15T12:18:53.100005+0000","last_active":"2024-09-15T12:21:10.713277+0000","last_peered":"2024-09-15T12:21:10.713277+0000","last_clean":"2024-09-15T12:21:10.713277+0000","last_became_active":"2024-09-15T12:18:53.080705+0000","last_became_peered":"2024-09-15T12:18:53.080705+0000","last_unstale":"2024-09-15T12:21:10.713277+0000","last_undegraded":"2024-09-15T12:21:10.713277+0000","last_fullsized":"2024-09-15T12:21:10.713277+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1558,"log_dups_size":0,"ondisk_log_size":1558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28311552,"num_objects":432,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1558,"num_write_kb":63680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"26'1545","reported_seq":1581,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.444728+0000","last_change":"2024-09-15T12:18:53.122880+0000","last_active":"2024-09-15T12:21:10.444728+0000","last_peered":"2024-09-15T12:21:10.444728+0000","last_clean":"2024-09-15T12:21:10.444728+0000","last_became_active":"2024-09-15T12:18:53.111647+0000","last_became_peered":"2024-09-15T12:18:53.111647+0000","last_unstale":"2024-09-15T12:21:10.444728+0000","last_undegraded":"2024-09-15T12:21:10.444728+0000","last_fullsized":"2024-09-15T12:21:10.444728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1545,"log_dups_size":0,"ondisk_log_size":1545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32047104,"num_objects":489,"num_object_clones":0,"num_object_copies":1467,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1545,"num_write_kb":65088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.280090+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:20:36.280090+0000","last_peered":"2024-09-15T12:20:36.280090+0000","last_clean":"2024-09-15T12:20:36.280090+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:20:36.280090+0000","last_undegraded":"2024-09-15T12:20:36.280090+0000","last_fullsized":"2024-09-15T12:20:36.280090+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"26'1542","reported_seq":1578,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.632716+0000","last_change":"2024-09-15T12:18:53.133542+0000","last_active":"2024-09-15T12:21:10.632716+0000","last_peered":"2024-09-15T12:21:10.632716+0000","last_clean":"2024-09-15T12:21:10.632716+0000","last_became_active":"2024-09-15T12:18:53.125716+0000","last_became_peered":"2024-09-15T12:18:53.125716+0000","last_unstale":"2024-09-15T12:21:10.632716+0000","last_undegraded":"2024-09-15T12:21:10.632716+0000","last_fullsized":"2024-09-15T12:21:10.632716+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1542,"log_dups_size":0,"ondisk_log_size":1542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29884416,"num_objects":456,"num_object_clones":0,"num_object_copies":1368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1542,"num_write_kb":63936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.299694+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:20:36.299694+0000","last_peered":"2024-09-15T12:20:36.299694+0000","last_clean":"2024-09-15T12:20:36.299694+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:20:36.299694+0000","last_undegraded":"2024-09-15T12:20:36.299694+0000","last_fullsized":"2024-09-15T12:20:36.299694+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"26'1501","reported_seq":1537,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:11.538704+0000","last_change":"2024-09-15T12:18:53.133963+0000","last_active":"2024-09-15T12:21:11.538704+0000","last_peered":"2024-09-15T12:21:11.538704+0000","last_clean":"2024-09-15T12:21:11.538704+0000","last_became_active":"2024-09-15T12:18:53.122383+0000","last_became_peered":"2024-09-15T12:18:53.122383+0000","last_unstale":"2024-09-15T12:21:11.538704+0000","last_undegraded":"2024-09-15T12:21:11.538704+0000","last_fullsized":"2024-09-15T12:21:11.538704+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1501,"log_dups_size":0,"ondisk_log_size":1501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28639232,"num_objects":437,"num_object_clones":0,"num_object_copies":1311,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1501,"num_write_kb":62016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.280291+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:20:36.280291+0000","last_peered":"2024-09-15T12:20:36.280291+0000","last_clean":"2024-09-15T12:20:36.280291+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:20:36.280291+0000","last_undegraded":"2024-09-15T12:20:36.280291+0000","last_fullsized":"2024-09-15T12:20:36.280291+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"26'1562","reported_seq":1598,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:21:10.608068+0000","last_change":"2024-09-15T12:18:53.102960+0000","last_active":"2024-09-15T12:21:10.608068+0000","last_peered":"2024-09-15T12:21:10.608068+0000","last_clean":"2024-09-15T12:21:10.608068+0000","last_became_active":"2024-09-15T12:18:53.088807+0000","last_became_peered":"2024-09-15T12:18:53.088807+0000","last_unstale":"2024-09-15T12:21:10.608068+0000","last_undegraded":"2024-09-15T12:21:10.608068+0000","last_fullsized":"2024-09-15T12:21:10.608068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1562,"log_dups_size":0,"ondisk_log_size":1562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30408704,"num_objects":464,"num_object_clones":0,"num_object_copies":1392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1562,"num_write_kb":64832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-15T12:20:36.312203+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:20:36.312203+0000","last_peered":"2024-09-15T12:20:36.312203+0000","last_clean":"2024-09-15T12:20:36.312203+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:20:36.312203+0000","last_undegraded":"2024-09-15T12:20:36.312203+0000","last_fullsized":"2024-09-15T12:20:36.312203+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":476446744,"num_objects":7271,"num_object_clones":0,"num_object_copies":21813,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":24141,"num_write_kb":1005121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":89243648,"data_stored":1427701832,"data_compressed":67794917,"data_compressed_allocated":89231360,"data_compressed_original":1427701760,"omap_allocated":0,"internal_metadata":0},"log_size":24141,"ondisk_log_size":24141,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673109,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70604,"kb_used_data":25724,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94301236,"statfs":{"total":96636764160,"available":96564465664,"internally_reserved":0,"allocated":26341376,"data_stored":417601551,"data_compressed":19828575,"data_compressed_allocated":26099712,"data_compressed_original":417513472,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47620,"kb_used_data":20788,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94324220,"statfs":{"total":96636764160,"available":96588001280,"internally_reserved":0,"allocated":21286912,"data_stored":336730122,"data_compressed":15988368,"data_compressed_allocated":21045248,"data_compressed_original":336642048,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":53592,"kb_used_data":22600,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94318248,"statfs":{"total":96636764160,"available":96581885952,"internally_reserved":0,"allocated":23142400,"data_stored":366745090,"data_compressed":17411639,"data_compressed_allocated":22917120,"data_compressed_original":366673920,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705813,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64112,"kb_used_data":20640,"kb_used_omap":0,"kb_used_meta":43456,"kb_avail":94307728,"statfs":{"total":96636764160,"available":96571113472,"internally_reserved":0,"allocated":21135360,"data_stored":334239778,"data_compressed":15870111,"data_compressed_allocated":20889600,"data_compressed_original":334151680,"omap_allocated":0,"internal_metadata":44498944},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20455424,"data_stored":327221272,"data_compressed":15538215,"data_compressed_allocated":20451328,"data_compressed_original":327221248,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22552576,"data_stored":360775704,"data_compressed":17131559,"data_compressed_allocated":22548480,"data_compressed_original":360775680,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20598784,"data_stored":329580544,"data_compressed":15650248,"data_compressed_allocated":20598784,"data_compressed_original":329580544,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25636864,"data_stored":410124312,"data_compressed":19474895,"data_compressed_allocated":25632768,"data_compressed_original":410124288,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:21:43.852 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:21:43.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:43.996+0000 7f5bce2e3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:44.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:44.004+0000 7f5bce2e3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:46.625 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:21:46.626 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:21:46.626 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:21:46.648 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:21:46.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:46.777+0000 7f106ed48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:46.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:46.794+0000 7f106dae6640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:46.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:46.826+0000 7f708e111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:46.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:46.833+0000 7f708e111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:47.162 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:21:47.163 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:21:47.179 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2024-09-15T12:21:45.738092+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":143917643,"num_objects":2192,"num_object_clones":0,"num_object_copies":6576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":29305,"num_write_kb":1006229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29279,"ondisk_log_size":29279,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":237064,"kb_used_data":28424,"kb_used_omap":0,"kb_used_meta":208576,"kb_avail":377250296,"statfs":{"total":386547056640,"available":386304303104,"internally_reserved":0,"allocated":29106176,"data_stored":448857202,"data_compressed":21304600,"data_compressed_allocated":28045312,"data_compressed_original":448479232,"omap_allocated":0,"internal_metadata":213581824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-333119488,"num_objects":-5083,"num_object_clones":0,"num_object_copies":-15249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5083,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.494286"},"pg_stats":[{"pgid":"3.f","version":"30'1773","reported_seq":1821,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.332026+0000","last_change":"2024-09-15T12:18:53.083350+0000","last_active":"2024-09-15T12:21:40.332026+0000","last_peered":"2024-09-15T12:21:40.332026+0000","last_clean":"2024-09-15T12:21:40.332026+0000","last_became_active":"2024-09-15T12:18:53.075051+0000","last_became_peered":"2024-09-15T12:18:53.075051+0000","last_unstale":"2024-09-15T12:21:40.332026+0000","last_undegraded":"2024-09-15T12:21:40.332026+0000","last_fullsized":"2024-09-15T12:21:40.332026+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1773,"log_dups_size":0,"ondisk_log_size":1773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10289152,"num_objects":157,"num_object_clones":0,"num_object_copies":471,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1773,"num_write_kb":61760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"30'1726","reported_seq":1774,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.629207+0000","last_change":"2024-09-15T12:18:53.139711+0000","last_active":"2024-09-15T12:21:40.629207+0000","last_peered":"2024-09-15T12:21:40.629207+0000","last_clean":"2024-09-15T12:21:40.629207+0000","last_became_active":"2024-09-15T12:18:53.130124+0000","last_became_peered":"2024-09-15T12:18:53.130124+0000","last_unstale":"2024-09-15T12:21:40.629207+0000","last_undegraded":"2024-09-15T12:21:40.629207+0000","last_fullsized":"2024-09-15T12:21:40.629207+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1726,"log_dups_size":0,"ondisk_log_size":1726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":144,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1726,"num_write_kb":59840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"30'1884","reported_seq":1933,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.632119+0000","last_change":"2024-09-15T12:18:53.140327+0000","last_active":"2024-09-15T12:21:40.632119+0000","last_peered":"2024-09-15T12:21:40.632119+0000","last_clean":"2024-09-15T12:21:40.632119+0000","last_became_active":"2024-09-15T12:18:53.128935+0000","last_became_peered":"2024-09-15T12:18:53.128935+0000","last_unstale":"2024-09-15T12:21:40.632119+0000","last_undegraded":"2024-09-15T12:21:40.632119+0000","last_fullsized":"2024-09-15T12:21:40.632119+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1884,"log_dups_size":0,"ondisk_log_size":1884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9240600,"num_objects":142,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1884,"num_write_kb":64769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"30'1835","reported_seq":1883,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.714356+0000","last_change":"2024-09-15T12:18:53.138678+0000","last_active":"2024-09-15T12:21:40.714356+0000","last_peered":"2024-09-15T12:21:40.714356+0000","last_clean":"2024-09-15T12:21:40.714356+0000","last_became_active":"2024-09-15T12:18:53.129492+0000","last_became_peered":"2024-09-15T12:18:53.129492+0000","last_unstale":"2024-09-15T12:21:40.714356+0000","last_undegraded":"2024-09-15T12:21:40.714356+0000","last_fullsized":"2024-09-15T12:21:40.714356+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1835,"log_dups_size":0,"ondisk_log_size":1835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1835,"num_write_kb":62784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"30'1797","reported_seq":1845,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:41.549973+0000","last_change":"2024-09-15T12:18:53.109204+0000","last_active":"2024-09-15T12:21:41.549973+0000","last_peered":"2024-09-15T12:21:41.549973+0000","last_clean":"2024-09-15T12:21:41.549973+0000","last_became_active":"2024-09-15T12:18:53.087134+0000","last_became_peered":"2024-09-15T12:18:53.087134+0000","last_unstale":"2024-09-15T12:21:41.549973+0000","last_undegraded":"2024-09-15T12:21:41.549973+0000","last_fullsized":"2024-09-15T12:21:41.549973+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1797,"log_dups_size":0,"ondisk_log_size":1797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1797,"num_write_kb":61760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"30'1795","reported_seq":1843,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.454668+0000","last_change":"2024-09-15T12:18:53.119675+0000","last_active":"2024-09-15T12:21:40.454668+0000","last_peered":"2024-09-15T12:21:40.454668+0000","last_clean":"2024-09-15T12:21:40.454668+0000","last_became_active":"2024-09-15T12:18:53.112010+0000","last_became_peered":"2024-09-15T12:18:53.112010+0000","last_unstale":"2024-09-15T12:21:40.454668+0000","last_undegraded":"2024-09-15T12:21:40.454668+0000","last_fullsized":"2024-09-15T12:21:40.454668+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1795,"log_dups_size":0,"ondisk_log_size":1795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192000,"num_objects":125,"num_object_clones":0,"num_object_copies":375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1795,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"30'1799","reported_seq":1847,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.631787+0000","last_change":"2024-09-15T12:18:53.136381+0000","last_active":"2024-09-15T12:21:40.631787+0000","last_peered":"2024-09-15T12:21:40.631787+0000","last_clean":"2024-09-15T12:21:40.631787+0000","last_became_active":"2024-09-15T12:18:53.128765+0000","last_became_peered":"2024-09-15T12:18:53.128765+0000","last_unstale":"2024-09-15T12:21:40.631787+0000","last_undegraded":"2024-09-15T12:21:40.631787+0000","last_fullsized":"2024-09-15T12:21:40.631787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1799,"log_dups_size":0,"ondisk_log_size":1799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8978432,"num_objects":137,"num_object_clones":0,"num_object_copies":411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1799,"num_write_kb":61952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"30'1843","reported_seq":1891,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.561360+0000","last_change":"2024-09-15T12:18:53.090984+0000","last_active":"2024-09-15T12:21:40.561360+0000","last_peered":"2024-09-15T12:21:40.561360+0000","last_clean":"2024-09-15T12:21:40.561360+0000","last_became_active":"2024-09-15T12:18:53.080676+0000","last_became_peered":"2024-09-15T12:18:53.080676+0000","last_unstale":"2024-09-15T12:21:40.561360+0000","last_undegraded":"2024-09-15T12:21:40.561360+0000","last_fullsized":"2024-09-15T12:21:40.561360+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1843,"log_dups_size":0,"ondisk_log_size":1843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551296,"num_objects":161,"num_object_clones":0,"num_object_copies":483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1843,"num_write_kb":64128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":133,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.332192+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:21:40.332192+0000","last_peered":"2024-09-15T12:21:40.332192+0000","last_clean":"2024-09-15T12:21:40.332192+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:21:40.332192+0000","last_undegraded":"2024-09-15T12:21:40.332192+0000","last_fullsized":"2024-09-15T12:21:40.332192+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.282358+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:21:40.282358+0000","last_peered":"2024-09-15T12:21:40.282358+0000","last_clean":"2024-09-15T12:21:40.282358+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:21:40.282358+0000","last_undegraded":"2024-09-15T12:21:40.282358+0000","last_fullsized":"2024-09-15T12:21:40.282358+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"30'1873","reported_seq":1921,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.667688+0000","last_change":"2024-09-15T12:18:53.172532+0000","last_active":"2024-09-15T12:21:40.667688+0000","last_peered":"2024-09-15T12:21:40.667688+0000","last_clean":"2024-09-15T12:21:40.667688+0000","last_became_active":"2024-09-15T12:18:53.166197+0000","last_became_peered":"2024-09-15T12:18:53.166197+0000","last_unstale":"2024-09-15T12:21:40.667688+0000","last_undegraded":"2024-09-15T12:21:40.667688+0000","last_fullsized":"2024-09-15T12:21:40.667688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1873,"log_dups_size":0,"ondisk_log_size":1873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9109504,"num_objects":139,"num_object_clones":0,"num_object_copies":417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1873,"num_write_kb":64384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.316497+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:21:40.316497+0000","last_peered":"2024-09-15T12:21:40.316497+0000","last_clean":"2024-09-15T12:21:40.316497+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:21:40.316497+0000","last_undegraded":"2024-09-15T12:21:40.316497+0000","last_fullsized":"2024-09-15T12:21:40.316497+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"30'1766","reported_seq":1814,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:41.722026+0000","last_change":"2024-09-15T12:18:53.161283+0000","last_active":"2024-09-15T12:21:41.722026+0000","last_peered":"2024-09-15T12:21:41.722026+0000","last_clean":"2024-09-15T12:21:41.722026+0000","last_became_active":"2024-09-15T12:18:53.149710+0000","last_became_peered":"2024-09-15T12:18:53.149710+0000","last_unstale":"2024-09-15T12:21:41.722026+0000","last_undegraded":"2024-09-15T12:21:41.722026+0000","last_fullsized":"2024-09-15T12:21:41.722026+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1766,"log_dups_size":0,"ondisk_log_size":1766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8257536,"num_objects":126,"num_object_clones":0,"num_object_copies":378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1766,"num_write_kb":60544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.274462+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:21:40.274462+0000","last_peered":"2024-09-15T12:21:40.274462+0000","last_clean":"2024-09-15T12:21:40.274462+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:21:40.274462+0000","last_undegraded":"2024-09-15T12:21:40.274462+0000","last_fullsized":"2024-09-15T12:21:40.274462+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"30'1838","reported_seq":1886,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:41.428972+0000","last_change":"2024-09-15T12:18:53.169843+0000","last_active":"2024-09-15T12:21:41.428972+0000","last_peered":"2024-09-15T12:21:41.428972+0000","last_clean":"2024-09-15T12:21:41.428972+0000","last_became_active":"2024-09-15T12:18:53.161921+0000","last_became_peered":"2024-09-15T12:18:53.161921+0000","last_unstale":"2024-09-15T12:21:41.428972+0000","last_undegraded":"2024-09-15T12:21:41.428972+0000","last_fullsized":"2024-09-15T12:21:41.428972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1838,"log_dups_size":0,"ondisk_log_size":1838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6946816,"num_objects":106,"num_object_clones":0,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1838,"num_write_kb":62208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.313488+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:21:40.313488+0000","last_peered":"2024-09-15T12:21:40.313488+0000","last_clean":"2024-09-15T12:21:40.313488+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:21:40.313488+0000","last_undegraded":"2024-09-15T12:21:40.313488+0000","last_fullsized":"2024-09-15T12:21:40.313488+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"30'1852","reported_seq":1900,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.547409+0000","last_change":"2024-09-15T12:18:53.100005+0000","last_active":"2024-09-15T12:21:40.547409+0000","last_peered":"2024-09-15T12:21:40.547409+0000","last_clean":"2024-09-15T12:21:40.547409+0000","last_became_active":"2024-09-15T12:18:53.080705+0000","last_became_peered":"2024-09-15T12:18:53.080705+0000","last_unstale":"2024-09-15T12:21:40.547409+0000","last_undegraded":"2024-09-15T12:21:40.547409+0000","last_fullsized":"2024-09-15T12:21:40.547409+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1852,"log_dups_size":0,"ondisk_log_size":1852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9043968,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1852,"num_write_kb":63680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"30'1872","reported_seq":1920,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.537654+0000","last_change":"2024-09-15T12:18:53.122880+0000","last_active":"2024-09-15T12:21:40.537654+0000","last_peered":"2024-09-15T12:21:40.537654+0000","last_clean":"2024-09-15T12:21:40.537654+0000","last_became_active":"2024-09-15T12:18:53.111647+0000","last_became_peered":"2024-09-15T12:18:53.111647+0000","last_unstale":"2024-09-15T12:21:40.537654+0000","last_undegraded":"2024-09-15T12:21:40.537654+0000","last_fullsized":"2024-09-15T12:21:40.537654+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1872,"log_dups_size":0,"ondisk_log_size":1872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10616832,"num_objects":162,"num_object_clones":0,"num_object_copies":486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1872,"num_write_kb":65088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.279443+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:21:40.279443+0000","last_peered":"2024-09-15T12:21:40.279443+0000","last_clean":"2024-09-15T12:21:40.279443+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:21:40.279443+0000","last_undegraded":"2024-09-15T12:21:40.279443+0000","last_fullsized":"2024-09-15T12:21:40.279443+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"30'1867","reported_seq":1915,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.698620+0000","last_change":"2024-09-15T12:18:53.133542+0000","last_active":"2024-09-15T12:21:40.698620+0000","last_peered":"2024-09-15T12:21:40.698620+0000","last_clean":"2024-09-15T12:21:40.698620+0000","last_became_active":"2024-09-15T12:18:53.125716+0000","last_became_peered":"2024-09-15T12:18:53.125716+0000","last_unstale":"2024-09-15T12:21:40.698620+0000","last_undegraded":"2024-09-15T12:21:40.698620+0000","last_fullsized":"2024-09-15T12:21:40.698620+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1867,"log_dups_size":0,"ondisk_log_size":1867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8585216,"num_objects":131,"num_object_clones":0,"num_object_copies":393,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1867,"num_write_kb":63936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.332228+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:21:40.332228+0000","last_peered":"2024-09-15T12:21:40.332228+0000","last_clean":"2024-09-15T12:21:40.332228+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:21:40.332228+0000","last_undegraded":"2024-09-15T12:21:40.332228+0000","last_fullsized":"2024-09-15T12:21:40.332228+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"30'1819","reported_seq":1867,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:41.577469+0000","last_change":"2024-09-15T12:18:53.133963+0000","last_active":"2024-09-15T12:21:41.577469+0000","last_peered":"2024-09-15T12:21:41.577469+0000","last_clean":"2024-09-15T12:21:41.577469+0000","last_became_active":"2024-09-15T12:18:53.122383+0000","last_became_peered":"2024-09-15T12:18:53.122383+0000","last_unstale":"2024-09-15T12:21:41.577469+0000","last_undegraded":"2024-09-15T12:21:41.577469+0000","last_fullsized":"2024-09-15T12:21:41.577469+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1819,"log_dups_size":0,"ondisk_log_size":1819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1819,"num_write_kb":62016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.277067+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:21:40.277067+0000","last_peered":"2024-09-15T12:21:40.277067+0000","last_clean":"2024-09-15T12:21:40.277067+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:21:40.277067+0000","last_undegraded":"2024-09-15T12:21:40.277067+0000","last_fullsized":"2024-09-15T12:21:40.277067+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"30'1885","reported_seq":1933,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.621762+0000","last_change":"2024-09-15T12:18:53.102960+0000","last_active":"2024-09-15T12:21:40.621762+0000","last_peered":"2024-09-15T12:21:40.621762+0000","last_clean":"2024-09-15T12:21:40.621762+0000","last_became_active":"2024-09-15T12:18:53.088807+0000","last_became_peered":"2024-09-15T12:18:53.088807+0000","last_unstale":"2024-09-15T12:21:40.621762+0000","last_undegraded":"2024-09-15T12:21:40.621762+0000","last_fullsized":"2024-09-15T12:21:40.621762+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:51.971548+0000","last_clean_scrub_stamp":"2024-09-15T12:18:51.971548+0000","objects_scrubbed":0,"log_size":1885,"log_dups_size":0,"ondisk_log_size":1885,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9240576,"num_objects":141,"num_object_clones":0,"num_object_copies":423,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1885,"num_write_kb":64832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.282143+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:21:40.282143+0000","last_peered":"2024-09-15T12:21:40.282143+0000","last_clean":"2024-09-15T12:21:40.282143+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:21:40.282143+0000","last_undegraded":"2024-09-15T12:21:40.282143+0000","last_fullsized":"2024-09-15T12:21:40.282143+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":143327256,"num_objects":2188,"num_object_clones":0,"num_object_copies":6564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":29224,"num_write_kb":1005121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":26726400,"data_stored":427425864,"data_compressed":20296464,"data_compressed_allocated":26714112,"data_compressed_original":427425792,"omap_allocated":0,"internal_metadata":0},"log_size":29224,"ondisk_log_size":29224,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673139,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52780,"kb_used_data":7900,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94319060,"statfs":{"total":96636764160,"available":96582717440,"internally_reserved":0,"allocated":8089600,"data_stored":125061939,"data_compressed":5936608,"data_compressed_allocated":7815168,"data_compressed_original":124960768,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64040,"kb_used_data":6680,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94307800,"statfs":{"total":96636764160,"available":96571187200,"internally_reserved":0,"allocated":6840320,"data_stored":105201253,"data_compressed":4993672,"data_compressed_allocated":6574080,"data_compressed_original":105103360,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":56272,"kb_used_data":7232,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94315568,"statfs":{"total":96636764160,"available":96579141632,"internally_reserved":0,"allocated":7405568,"data_stored":114572381,"data_compressed":5436664,"data_compressed_allocated":7155712,"data_compressed_original":114491392,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63972,"kb_used_data":6612,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94307868,"statfs":{"total":96636764160,"available":96571256832,"internally_reserved":0,"allocated":6770688,"data_stored":104021629,"data_compressed":4937656,"data_compressed_allocated":6500352,"data_compressed_original":103923712,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6160384,"data_stored":98500632,"data_compressed":4677336,"data_compressed_allocated":6156288,"data_compressed_original":98500608,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6905856,"data_stored":110428184,"data_compressed":5243720,"data_compressed_allocated":6901760,"data_compressed_original":110428160,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6213632,"data_stored":99418112,"data_compressed":4720904,"data_compressed_allocated":6213632,"data_compressed_original":99418112,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7446528,"data_stored":119078936,"data_compressed":5654504,"data_compressed_allocated":7442432,"data_compressed_original":119078912,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:21:49.442 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:21:49.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:49.598+0000 7fdd62551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:49.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:49.610+0000 7fdd62551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:52.181 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:21:52.181 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:21:52.181 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:21:52.181 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:21:52.212 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:21:52.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:52.345+0000 7f635b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:52.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:52.360+0000 7f635b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:52.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:52.383+0000 7f9956b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:52.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:52.390+0000 7f9956b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:52.494 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:21:52.495 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:21:52.495 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:21:52.495 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:21:52.495 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:21:52.495 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:21:52.495 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:21:52.495 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:21:52.495 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:21:52.495 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:21:52.495 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:21:52.495 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:21:52.498 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:21:52.499 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:21:52.499 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:21:52.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:52.644+0000 7fad60391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:52.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:52.663+0000 7fad60391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:52.902 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:21:52.902 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:21:52.902 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:21:52.902 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:21:52.902 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:21:52.902 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:21:52.902 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:21:52.902 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:21:52.902 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:21:52.902 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:21:52.903 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:21:52.903 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:21:52.906 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:21:52.906 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:21:52.907 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:21:53.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:53.052+0000 7f6483ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:53.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:53.068+0000 7f6483ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:53.197 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:21:53.197 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:21:53.197 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:21:53.198 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:21:53.198 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:21:53.198 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:21:53.198 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:21:53.198 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:21:53.198 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:21:53.198 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:21:53.198 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:21:53.198 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:21:53.202 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:21:53.202 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:21:53.202 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:21:53.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:53.332+0000 7f0809151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:53.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:53.343+0000 7f0809151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:53.482 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:21:53.482 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:21:53.482 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:21:53.482 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:21:53.482 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:21:53.482 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:21:53.482 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:21:53.482 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:21:53.482 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:21:53.482 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:21:53.482 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:21:53.483 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:21:53.485 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:21:53.485 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:21:54.432 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Removed 15705 objects 2024-09-15T12:21:54.432 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Clean up completed and total clean up time :89.3326 2024-09-15T12:21:55.012 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:21:55.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:55.119+0000 7fa0bf2c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:55.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:55.124+0000 7fa0bf2c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:57.039 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2024-09-15T12:21:57.039 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-09-15T12:21:57.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:57.156+0000 7f34f3191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:57.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:57.174+0000 7f34f3191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:57.225 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:21:57.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:57.330+0000 7f36886d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:57.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:57.336+0000 7f36886d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:58.236 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'unique_pool_0' removed 2024-09-15T12:21:58.258 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-15T12:21:58.259 INFO:tasks.radosbench:Beginning radosbench... 2024-09-15T12:21:58.259 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_1 2024-09-15T12:21:58.259 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_1 16 2024-09-15T12:21:58.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:58.399+0000 7f2e952a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:58.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:58.412+0000 7f2e952a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:58.486 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:21:58.486 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:21:58.487 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:21:58.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:58.633+0000 7fa620d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:58.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:58.647+0000 7fa620d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:58.870 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:21:58.870 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:21:58.883 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2024-09-15T12:21:58.236354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":237064,"kb_used_data":28424,"kb_used_omap":0,"kb_used_meta":208576,"kb_avail":377250296,"statfs":{"total":386547056640,"available":386304303104,"internally_reserved":0,"allocated":29106176,"data_stored":448857202,"data_compressed":21304600,"data_compressed_allocated":28045312,"data_compressed_original":448479232,"omap_allocated":0,"internal_metadata":213581824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-143327256,"num_objects":-2188,"num_object_clones":0,"num_object_copies":-6564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-29224,"num_write_kb":-1005121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.497936"},"pg_stats":[{"pgid":"1.0","version":"11'52","reported_seq":133,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.332192+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:21:40.332192+0000","last_peered":"2024-09-15T12:21:40.332192+0000","last_clean":"2024-09-15T12:21:40.332192+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:21:40.332192+0000","last_undegraded":"2024-09-15T12:21:40.332192+0000","last_fullsized":"2024-09-15T12:21:40.332192+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.282358+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:21:40.282358+0000","last_peered":"2024-09-15T12:21:40.282358+0000","last_clean":"2024-09-15T12:21:40.282358+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:21:40.282358+0000","last_undegraded":"2024-09-15T12:21:40.282358+0000","last_fullsized":"2024-09-15T12:21:40.282358+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.316497+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:21:40.316497+0000","last_peered":"2024-09-15T12:21:40.316497+0000","last_clean":"2024-09-15T12:21:40.316497+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:21:40.316497+0000","last_undegraded":"2024-09-15T12:21:40.316497+0000","last_fullsized":"2024-09-15T12:21:40.316497+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.274462+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:21:40.274462+0000","last_peered":"2024-09-15T12:21:40.274462+0000","last_clean":"2024-09-15T12:21:40.274462+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:21:40.274462+0000","last_undegraded":"2024-09-15T12:21:40.274462+0000","last_fullsized":"2024-09-15T12:21:40.274462+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.313488+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:21:40.313488+0000","last_peered":"2024-09-15T12:21:40.313488+0000","last_clean":"2024-09-15T12:21:40.313488+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:21:40.313488+0000","last_undegraded":"2024-09-15T12:21:40.313488+0000","last_fullsized":"2024-09-15T12:21:40.313488+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.279443+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:21:40.279443+0000","last_peered":"2024-09-15T12:21:40.279443+0000","last_clean":"2024-09-15T12:21:40.279443+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:21:40.279443+0000","last_undegraded":"2024-09-15T12:21:40.279443+0000","last_fullsized":"2024-09-15T12:21:40.279443+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.332228+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:21:40.332228+0000","last_peered":"2024-09-15T12:21:40.332228+0000","last_clean":"2024-09-15T12:21:40.332228+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:21:40.332228+0000","last_undegraded":"2024-09-15T12:21:40.332228+0000","last_fullsized":"2024-09-15T12:21:40.332228+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.277067+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:21:40.277067+0000","last_peered":"2024-09-15T12:21:40.277067+0000","last_clean":"2024-09-15T12:21:40.277067+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:21:40.277067+0000","last_undegraded":"2024-09-15T12:21:40.277067+0000","last_fullsized":"2024-09-15T12:21:40.277067+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.282143+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:21:40.282143+0000","last_peered":"2024-09-15T12:21:40.282143+0000","last_clean":"2024-09-15T12:21:40.282143+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:21:40.282143+0000","last_undegraded":"2024-09-15T12:21:40.282143+0000","last_fullsized":"2024-09-15T12:21:40.282143+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673139,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52780,"kb_used_data":7900,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94319060,"statfs":{"total":96636764160,"available":96582717440,"internally_reserved":0,"allocated":8089600,"data_stored":125061939,"data_compressed":5936608,"data_compressed_allocated":7815168,"data_compressed_original":124960768,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64040,"kb_used_data":6680,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94307800,"statfs":{"total":96636764160,"available":96571187200,"internally_reserved":0,"allocated":6840320,"data_stored":105201253,"data_compressed":4993672,"data_compressed_allocated":6574080,"data_compressed_original":105103360,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":56272,"kb_used_data":7232,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94315568,"statfs":{"total":96636764160,"available":96579141632,"internally_reserved":0,"allocated":7405568,"data_stored":114572381,"data_compressed":5436664,"data_compressed_allocated":7155712,"data_compressed_original":114491392,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63972,"kb_used_data":6612,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94307868,"statfs":{"total":96636764160,"available":96571256832,"internally_reserved":0,"allocated":6770688,"data_stored":104021629,"data_compressed":4937656,"data_compressed_allocated":6500352,"data_compressed_original":103923712,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:21:59.237 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'unique_pool_1' created 2024-09-15T12:21:59.255 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_1 rados --yes-i-really-mean-it || true 2024-09-15T12:21:59.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:59.396+0000 7f8487c46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:59.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:59.410+0000 7f8487c46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:59.438 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:21:59.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:59.541+0000 7f7b0d951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:21:59.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:21:59.547+0000 7f7b0d951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:00.246 INFO:teuthology.orchestra.run.smithi077.stderr:enabled application 'rados' on pool 'unique_pool_1' 2024-09-15T12:22:01.269 DEBUG:teuthology.orchestra.run.smithi077:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_1 bench 90 write' 2024-09-15T12:22:01.271 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-15T12:22:01.272 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-15T12:22:01.335 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:hints = 1 2024-09-15T12:22:01.336 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-15T12:22:01.336 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Object prefix: benchmark_data_smithi077_37754 2024-09-15T12:22:01.336 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-15T12:22:01.336 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 0 0 0 0 0 0 - 0 2024-09-15T12:22:01.661 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:22:01.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:01.814+0000 7f442a84f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:01.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:01.827+0000 7f442a84f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:02.335 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 1 15 240 225 14.0618 14.0625 0.0670497 0.0683489 2024-09-15T12:22:03.336 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 2 16 472 456 14.249 14.4375 0.0799408 0.0686156 2024-09-15T12:22:03.885 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:22:03.886 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-15T12:22:04.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:04.027+0000 7f543c551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:04.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:04.044+0000 7f543c551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:04.330 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:22:04.336 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 3 16 681 665 13.8531 13.0625 0.0469895 0.0706363 2024-09-15T12:22:04.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:04.497+0000 7f752c6fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:04.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:04.507+0000 7f752c6fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:05.258 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.0 to 1 (10000) 2024-09-15T12:22:05.278 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-15T12:22:05.336 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 4 16 905 889 13.8895 14 0.0873109 0.0707877 2024-09-15T12:22:05.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:05.414+0000 7f01c9511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:05.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:05.428+0000 7f01c9511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:06.275 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.1 to 1 (10000) 2024-09-15T12:22:06.299 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-15T12:22:06.336 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 5 16 1126 1110 13.8739 13.8125 0.0778955 0.0713627 2024-09-15T12:22:06.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:06.460+0000 7fd47c688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:06.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:06.480+0000 7fd47c688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:07.017 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:22:07.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:07.165+0000 7f7ffad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:07.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:07.174+0000 7f7ffad91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:07.275 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.2 to 1 (10000) 2024-09-15T12:22:07.297 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-15T12:22:07.336 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 6 16 1340 1324 13.7905 13.375 0.0512925 0.0720182 2024-09-15T12:22:07.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:07.459+0000 7fb68fb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:07.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:07.478+0000 7fb68fb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:08.286 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.3 to 1 (10000) 2024-09-15T12:22:08.309 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-15T12:22:08.309 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:22:08.336 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 7 16 1567 1551 13.8471 14.1875 0.0746718 0.0718297 2024-09-15T12:22:08.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:08.484+0000 7fa838911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:08.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:08.499+0000 7fa838911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:08.880 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:22:08.880 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:22:08.903 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2024-09-15T12:22:08.287845+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":237064,"kb_used_data":28424,"kb_used_omap":0,"kb_used_meta":208576,"kb_avail":377250296,"statfs":{"total":386547056640,"available":386304303104,"internally_reserved":0,"allocated":29106176,"data_stored":448857202,"data_compressed":21304600,"data_compressed_allocated":28045312,"data_compressed_original":448479232,"omap_allocated":0,"internal_metadata":213581824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.546010"},"pg_stats":[{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":133,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.332192+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:21:40.332192+0000","last_peered":"2024-09-15T12:21:40.332192+0000","last_clean":"2024-09-15T12:21:40.332192+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:21:40.332192+0000","last_undegraded":"2024-09-15T12:21:40.332192+0000","last_fullsized":"2024-09-15T12:21:40.332192+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.282358+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:21:40.282358+0000","last_peered":"2024-09-15T12:21:40.282358+0000","last_clean":"2024-09-15T12:21:40.282358+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:21:40.282358+0000","last_undegraded":"2024-09-15T12:21:40.282358+0000","last_fullsized":"2024-09-15T12:21:40.282358+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.316497+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:21:40.316497+0000","last_peered":"2024-09-15T12:21:40.316497+0000","last_clean":"2024-09-15T12:21:40.316497+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:21:40.316497+0000","last_undegraded":"2024-09-15T12:21:40.316497+0000","last_fullsized":"2024-09-15T12:21:40.316497+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.274462+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:21:40.274462+0000","last_peered":"2024-09-15T12:21:40.274462+0000","last_clean":"2024-09-15T12:21:40.274462+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:21:40.274462+0000","last_undegraded":"2024-09-15T12:21:40.274462+0000","last_fullsized":"2024-09-15T12:21:40.274462+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.313488+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:21:40.313488+0000","last_peered":"2024-09-15T12:21:40.313488+0000","last_clean":"2024-09-15T12:21:40.313488+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:21:40.313488+0000","last_undegraded":"2024-09-15T12:21:40.313488+0000","last_fullsized":"2024-09-15T12:21:40.313488+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.279443+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:21:40.279443+0000","last_peered":"2024-09-15T12:21:40.279443+0000","last_clean":"2024-09-15T12:21:40.279443+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:21:40.279443+0000","last_undegraded":"2024-09-15T12:21:40.279443+0000","last_fullsized":"2024-09-15T12:21:40.279443+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.332228+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:21:40.332228+0000","last_peered":"2024-09-15T12:21:40.332228+0000","last_clean":"2024-09-15T12:21:40.332228+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:21:40.332228+0000","last_undegraded":"2024-09-15T12:21:40.332228+0000","last_fullsized":"2024-09-15T12:21:40.332228+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.277067+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:21:40.277067+0000","last_peered":"2024-09-15T12:21:40.277067+0000","last_clean":"2024-09-15T12:21:40.277067+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:21:40.277067+0000","last_undegraded":"2024-09-15T12:21:40.277067+0000","last_fullsized":"2024-09-15T12:21:40.277067+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.282143+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:21:40.282143+0000","last_peered":"2024-09-15T12:21:40.282143+0000","last_clean":"2024-09-15T12:21:40.282143+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:21:40.282143+0000","last_undegraded":"2024-09-15T12:21:40.282143+0000","last_fullsized":"2024-09-15T12:21:40.282143+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673139,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52780,"kb_used_data":7900,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94319060,"statfs":{"total":96636764160,"available":96582717440,"internally_reserved":0,"allocated":8089600,"data_stored":125061939,"data_compressed":5936608,"data_compressed_allocated":7815168,"data_compressed_original":124960768,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64040,"kb_used_data":6680,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94307800,"statfs":{"total":96636764160,"available":96571187200,"internally_reserved":0,"allocated":6840320,"data_stored":105201253,"data_compressed":4993672,"data_compressed_allocated":6574080,"data_compressed_original":105103360,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":56272,"kb_used_data":7232,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94315568,"statfs":{"total":96636764160,"available":96579141632,"internally_reserved":0,"allocated":7405568,"data_stored":114572381,"data_compressed":5436664,"data_compressed_allocated":7155712,"data_compressed_original":114491392,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63972,"kb_used_data":6612,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94307868,"statfs":{"total":96636764160,"available":96571256832,"internally_reserved":0,"allocated":6770688,"data_stored":104021629,"data_compressed":4937656,"data_compressed_allocated":6500352,"data_compressed_original":103923712,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:22:08.904 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:22:09.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:09.116+0000 7fb246151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:09.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:09.129+0000 7fb246151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:09.336 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 8 16 1775 1759 13.741 13 0.0824249 0.0723767 2024-09-15T12:22:09.516 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:22:09.517 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:22:09.536 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2024-09-15T12:22:08.287845+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":237064,"kb_used_data":28424,"kb_used_omap":0,"kb_used_meta":208576,"kb_avail":377250296,"statfs":{"total":386547056640,"available":386304303104,"internally_reserved":0,"allocated":29106176,"data_stored":448857202,"data_compressed":21304600,"data_compressed_allocated":28045312,"data_compressed_original":448479232,"omap_allocated":0,"internal_metadata":213581824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.546010"},"pg_stats":[{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":133,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.332192+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:21:40.332192+0000","last_peered":"2024-09-15T12:21:40.332192+0000","last_clean":"2024-09-15T12:21:40.332192+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:21:40.332192+0000","last_undegraded":"2024-09-15T12:21:40.332192+0000","last_fullsized":"2024-09-15T12:21:40.332192+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.282358+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:21:40.282358+0000","last_peered":"2024-09-15T12:21:40.282358+0000","last_clean":"2024-09-15T12:21:40.282358+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:21:40.282358+0000","last_undegraded":"2024-09-15T12:21:40.282358+0000","last_fullsized":"2024-09-15T12:21:40.282358+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.316497+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:21:40.316497+0000","last_peered":"2024-09-15T12:21:40.316497+0000","last_clean":"2024-09-15T12:21:40.316497+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:21:40.316497+0000","last_undegraded":"2024-09-15T12:21:40.316497+0000","last_fullsized":"2024-09-15T12:21:40.316497+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.274462+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:21:40.274462+0000","last_peered":"2024-09-15T12:21:40.274462+0000","last_clean":"2024-09-15T12:21:40.274462+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:21:40.274462+0000","last_undegraded":"2024-09-15T12:21:40.274462+0000","last_fullsized":"2024-09-15T12:21:40.274462+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.313488+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:21:40.313488+0000","last_peered":"2024-09-15T12:21:40.313488+0000","last_clean":"2024-09-15T12:21:40.313488+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:21:40.313488+0000","last_undegraded":"2024-09-15T12:21:40.313488+0000","last_fullsized":"2024-09-15T12:21:40.313488+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.279443+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:21:40.279443+0000","last_peered":"2024-09-15T12:21:40.279443+0000","last_clean":"2024-09-15T12:21:40.279443+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:21:40.279443+0000","last_undegraded":"2024-09-15T12:21:40.279443+0000","last_fullsized":"2024-09-15T12:21:40.279443+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.332228+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:21:40.332228+0000","last_peered":"2024-09-15T12:21:40.332228+0000","last_clean":"2024-09-15T12:21:40.332228+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:21:40.332228+0000","last_undegraded":"2024-09-15T12:21:40.332228+0000","last_fullsized":"2024-09-15T12:21:40.332228+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.277067+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:21:40.277067+0000","last_peered":"2024-09-15T12:21:40.277067+0000","last_clean":"2024-09-15T12:21:40.277067+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:21:40.277067+0000","last_undegraded":"2024-09-15T12:21:40.277067+0000","last_fullsized":"2024-09-15T12:21:40.277067+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.282143+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:21:40.282143+0000","last_peered":"2024-09-15T12:21:40.282143+0000","last_clean":"2024-09-15T12:21:40.282143+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:21:40.282143+0000","last_undegraded":"2024-09-15T12:21:40.282143+0000","last_fullsized":"2024-09-15T12:21:40.282143+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673139,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52780,"kb_used_data":7900,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94319060,"statfs":{"total":96636764160,"available":96582717440,"internally_reserved":0,"allocated":8089600,"data_stored":125061939,"data_compressed":5936608,"data_compressed_allocated":7815168,"data_compressed_original":124960768,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64040,"kb_used_data":6680,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94307800,"statfs":{"total":96636764160,"available":96571187200,"internally_reserved":0,"allocated":6840320,"data_stored":105201253,"data_compressed":4993672,"data_compressed_allocated":6574080,"data_compressed_original":105103360,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":56272,"kb_used_data":7232,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94315568,"statfs":{"total":96636764160,"available":96579141632,"internally_reserved":0,"allocated":7405568,"data_stored":114572381,"data_compressed":5436664,"data_compressed_allocated":7155712,"data_compressed_original":114491392,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63972,"kb_used_data":6612,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94307868,"statfs":{"total":96636764160,"available":96571256832,"internally_reserved":0,"allocated":6770688,"data_stored":104021629,"data_compressed":4937656,"data_compressed_allocated":6500352,"data_compressed_original":103923712,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:22:09.537 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T12:22:09.627 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:22:09.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:09.696+0000 7f55c5b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:09.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:09.724+0000 7f55c5b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:09.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:09.789+0000 7f9400d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:09.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:09.800+0000 7f9400d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:10.117 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:22:10.117 INFO:teuthology.orchestra.run.smithi077.stdout:{"fsid":"0010d80b-83bc-42b2-8185-928cfe1dc364","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":216,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":38,"num_osds":4,"num_up_osds":4,"osd_up_since":1726402721,"num_in_osds":4,"osd_in_since":1726402715,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":16},{"state_name":"active+clean","count":9}],"num_pgs":25,"num_pools":3,"num_objects":4,"data_bytes":590387,"bytes_used":242753536,"bytes_avail":386304303104,"bytes_total":386547056640,"unknown_pgs_ratio":0.63999998569488525},"fsmap":{"epoch":1,"btime":"2024-09-15T12:18:33:200776+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-15T12:19:39.712688+0000","services":{}},"progress_events":{}} 2024-09-15T12:22:10.141 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T12:22:10.141 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:22:10.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:10.307+0000 7fd0b2f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:10.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:10.323+0000 7fd0b2f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:10.336 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 9 16 1981 1965 13.6447 12.875 0.0549834 0.0730003 2024-09-15T12:22:10.690 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:22:10.690 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:22:10.713 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2024-09-15T12:22:09.743121+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":237064,"kb_used_data":28424,"kb_used_omap":0,"kb_used_meta":208576,"kb_avail":377250296,"statfs":{"total":386547056640,"available":386304303104,"internally_reserved":0,"allocated":29106176,"data_stored":448857202,"data_compressed":21304600,"data_compressed_allocated":28045312,"data_compressed_original":448479232,"omap_allocated":0,"internal_metadata":213581824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.482792"},"pg_stats":[{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":133,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.332192+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:21:40.332192+0000","last_peered":"2024-09-15T12:21:40.332192+0000","last_clean":"2024-09-15T12:21:40.332192+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:21:40.332192+0000","last_undegraded":"2024-09-15T12:21:40.332192+0000","last_fullsized":"2024-09-15T12:21:40.332192+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":62,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.282358+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:21:40.282358+0000","last_peered":"2024-09-15T12:21:40.282358+0000","last_clean":"2024-09-15T12:21:40.282358+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:21:40.282358+0000","last_undegraded":"2024-09-15T12:21:40.282358+0000","last_fullsized":"2024-09-15T12:21:40.282358+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.316497+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:21:40.316497+0000","last_peered":"2024-09-15T12:21:40.316497+0000","last_clean":"2024-09-15T12:21:40.316497+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:21:40.316497+0000","last_undegraded":"2024-09-15T12:21:40.316497+0000","last_fullsized":"2024-09-15T12:21:40.316497+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.274462+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:21:40.274462+0000","last_peered":"2024-09-15T12:21:40.274462+0000","last_clean":"2024-09-15T12:21:40.274462+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:21:40.274462+0000","last_undegraded":"2024-09-15T12:21:40.274462+0000","last_fullsized":"2024-09-15T12:21:40.274462+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":63,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.313488+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:21:40.313488+0000","last_peered":"2024-09-15T12:21:40.313488+0000","last_clean":"2024-09-15T12:21:40.313488+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:21:40.313488+0000","last_undegraded":"2024-09-15T12:21:40.313488+0000","last_fullsized":"2024-09-15T12:21:40.313488+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.279443+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:21:40.279443+0000","last_peered":"2024-09-15T12:21:40.279443+0000","last_clean":"2024-09-15T12:21:40.279443+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:21:40.279443+0000","last_undegraded":"2024-09-15T12:21:40.279443+0000","last_fullsized":"2024-09-15T12:21:40.279443+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.332228+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:21:40.332228+0000","last_peered":"2024-09-15T12:21:40.332228+0000","last_clean":"2024-09-15T12:21:40.332228+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:21:40.332228+0000","last_undegraded":"2024-09-15T12:21:40.332228+0000","last_fullsized":"2024-09-15T12:21:40.332228+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.277067+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:21:40.277067+0000","last_peered":"2024-09-15T12:21:40.277067+0000","last_clean":"2024-09-15T12:21:40.277067+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:21:40.277067+0000","last_undegraded":"2024-09-15T12:21:40.277067+0000","last_fullsized":"2024-09-15T12:21:40.277067+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:21:59.235820+0000","last_change":"2024-09-15T12:21:59.235820+0000","last_active":"2024-09-15T12:21:59.235820+0000","last_peered":"2024-09-15T12:21:59.235820+0000","last_clean":"2024-09-15T12:21:59.235820+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:21:59.235820+0000","last_undegraded":"2024-09-15T12:21:59.235820+0000","last_fullsized":"2024-09-15T12:21:59.235820+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":61,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-15T12:21:40.282143+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:21:40.282143+0000","last_peered":"2024-09-15T12:21:40.282143+0000","last_clean":"2024-09-15T12:21:40.282143+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:21:40.282143+0000","last_undegraded":"2024-09-15T12:21:40.282143+0000","last_fullsized":"2024-09-15T12:21:40.282143+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673139,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52780,"kb_used_data":7900,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94319060,"statfs":{"total":96636764160,"available":96582717440,"internally_reserved":0,"allocated":8089600,"data_stored":125061939,"data_compressed":5936608,"data_compressed_allocated":7815168,"data_compressed_original":124960768,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64040,"kb_used_data":6680,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94307800,"statfs":{"total":96636764160,"available":96571187200,"internally_reserved":0,"allocated":6840320,"data_stored":105201253,"data_compressed":4993672,"data_compressed_allocated":6574080,"data_compressed_original":105103360,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":56272,"kb_used_data":7232,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94315568,"statfs":{"total":96636764160,"available":96579141632,"internally_reserved":0,"allocated":7405568,"data_stored":114572381,"data_compressed":5436664,"data_compressed_allocated":7155712,"data_compressed_original":114491392,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63972,"kb_used_data":6612,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94307868,"statfs":{"total":96636764160,"available":96571256832,"internally_reserved":0,"allocated":6770688,"data_stored":104021629,"data_compressed":4937656,"data_compressed_allocated":6500352,"data_compressed_original":103923712,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:22:11.336 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 10 16 2209 2193 13.7051 14.25 0.0597542 0.0726498 2024-09-15T12:22:12.251 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:22:12.337 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 11 16 2454 2438 13.8511 15.3125 0.0470235 0.0718873 2024-09-15T12:22:12.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:12.412+0000 7f161a391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:12.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:12.425+0000 7f161a391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:13.337 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 12 16 2677 2661 13.8582 13.9375 0.0986858 0.0718653 2024-09-15T12:22:13.715 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:22:13.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:13.866+0000 7f7519f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:13.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:13.880+0000 7f7519f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:14.178 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:22:14.180 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:22:14.204 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2024-09-15T12:22:13.744070+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":136643123,"num_objects":2080,"num_object_clones":0,"num_object_copies":6240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2157,"num_write_kb":133972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2131,"ondisk_log_size":2131,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":221712,"kb_used_data":25552,"kb_used_omap":0,"kb_used_meta":196096,"kb_avail":377265648,"statfs":{"total":386547056640,"available":386320023552,"internally_reserved":0,"allocated":26165248,"data_stored":397267841,"data_compressed":18845902,"data_compressed_allocated":24813568,"data_compressed_original":396771328,"omap_allocated":0,"internal_metadata":200802304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":136052736,"num_objects":2076,"num_object_clones":0,"num_object_copies":6228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2076,"num_write_kb":132864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.467008"},"pg_stats":[{"pgid":"4.f","version":"38'143","reported_seq":167,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.724986+0000","last_change":"2024-09-15T12:22:00.377854+0000","last_active":"2024-09-15T12:22:10.724986+0000","last_peered":"2024-09-15T12:22:10.724986+0000","last_clean":"2024-09-15T12:22:10.724986+0000","last_became_active":"2024-09-15T12:22:00.359790+0000","last_became_peered":"2024-09-15T12:22:00.359790+0000","last_unstale":"2024-09-15T12:22:10.724986+0000","last_undegraded":"2024-09-15T12:22:10.724986+0000","last_fullsized":"2024-09-15T12:22:10.724986+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9371648,"num_objects":143,"num_object_clones":0,"num_object_copies":429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":9152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"38'124","reported_seq":148,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.658974+0000","last_change":"2024-09-15T12:22:00.383291+0000","last_active":"2024-09-15T12:22:10.658974+0000","last_peered":"2024-09-15T12:22:10.658974+0000","last_clean":"2024-09-15T12:22:10.658974+0000","last_became_active":"2024-09-15T12:22:00.376330+0000","last_became_peered":"2024-09-15T12:22:00.376330+0000","last_unstale":"2024-09-15T12:22:10.658974+0000","last_undegraded":"2024-09-15T12:22:10.658974+0000","last_fullsized":"2024-09-15T12:22:10.658974+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"38'145","reported_seq":169,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.667267+0000","last_change":"2024-09-15T12:22:00.413467+0000","last_active":"2024-09-15T12:22:10.667267+0000","last_peered":"2024-09-15T12:22:10.667267+0000","last_clean":"2024-09-15T12:22:10.667267+0000","last_became_active":"2024-09-15T12:22:00.399293+0000","last_became_peered":"2024-09-15T12:22:00.399293+0000","last_unstale":"2024-09-15T12:22:10.667267+0000","last_undegraded":"2024-09-15T12:22:10.667267+0000","last_fullsized":"2024-09-15T12:22:10.667267+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9502720,"num_objects":145,"num_object_clones":0,"num_object_copies":435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":9280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"38'135","reported_seq":159,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:11.540954+0000","last_change":"2024-09-15T12:22:00.397700+0000","last_active":"2024-09-15T12:22:11.540954+0000","last_peered":"2024-09-15T12:22:11.540954+0000","last_clean":"2024-09-15T12:22:11.540954+0000","last_became_active":"2024-09-15T12:22:00.388314+0000","last_became_peered":"2024-09-15T12:22:00.388314+0000","last_unstale":"2024-09-15T12:22:11.540954+0000","last_undegraded":"2024-09-15T12:22:11.540954+0000","last_fullsized":"2024-09-15T12:22:11.540954+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"38'117","reported_seq":141,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.707349+0000","last_change":"2024-09-15T12:22:00.418610+0000","last_active":"2024-09-15T12:22:10.707349+0000","last_peered":"2024-09-15T12:22:10.707349+0000","last_clean":"2024-09-15T12:22:10.707349+0000","last_became_active":"2024-09-15T12:22:00.404352+0000","last_became_peered":"2024-09-15T12:22:00.404352+0000","last_unstale":"2024-09-15T12:22:10.707349+0000","last_undegraded":"2024-09-15T12:22:10.707349+0000","last_fullsized":"2024-09-15T12:22:10.707349+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":7488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"38'134","reported_seq":158,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.605300+0000","last_change":"2024-09-15T12:22:00.408893+0000","last_active":"2024-09-15T12:22:10.605300+0000","last_peered":"2024-09-15T12:22:10.605300+0000","last_clean":"2024-09-15T12:22:10.605300+0000","last_became_active":"2024-09-15T12:22:00.399557+0000","last_became_peered":"2024-09-15T12:22:00.399557+0000","last_unstale":"2024-09-15T12:22:10.605300+0000","last_undegraded":"2024-09-15T12:22:10.605300+0000","last_fullsized":"2024-09-15T12:22:10.605300+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8781824,"num_objects":134,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":8576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"38'161","reported_seq":185,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.630299+0000","last_change":"2024-09-15T12:22:00.458263+0000","last_active":"2024-09-15T12:22:10.630299+0000","last_peered":"2024-09-15T12:22:10.630299+0000","last_clean":"2024-09-15T12:22:10.630299+0000","last_became_active":"2024-09-15T12:22:00.446629+0000","last_became_peered":"2024-09-15T12:22:00.446629+0000","last_unstale":"2024-09-15T12:22:10.630299+0000","last_undegraded":"2024-09-15T12:22:10.630299+0000","last_fullsized":"2024-09-15T12:22:10.630299+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551296,"num_objects":161,"num_object_clones":0,"num_object_copies":483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":10304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"38'129","reported_seq":153,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.648429+0000","last_change":"2024-09-15T12:22:00.432607+0000","last_active":"2024-09-15T12:22:10.648429+0000","last_peered":"2024-09-15T12:22:10.648429+0000","last_clean":"2024-09-15T12:22:10.648429+0000","last_became_active":"2024-09-15T12:22:00.422177+0000","last_became_peered":"2024-09-15T12:22:00.422177+0000","last_unstale":"2024-09-15T12:22:10.648429+0000","last_undegraded":"2024-09-15T12:22:10.648429+0000","last_fullsized":"2024-09-15T12:22:10.648429+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8454144,"num_objects":129,"num_object_clones":0,"num_object_copies":387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":8256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"38'143","reported_seq":167,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.597212+0000","last_change":"2024-09-15T12:22:00.420197+0000","last_active":"2024-09-15T12:22:10.597212+0000","last_peered":"2024-09-15T12:22:10.597212+0000","last_clean":"2024-09-15T12:22:10.597212+0000","last_became_active":"2024-09-15T12:22:00.406666+0000","last_became_peered":"2024-09-15T12:22:00.406666+0000","last_unstale":"2024-09-15T12:22:10.597212+0000","last_undegraded":"2024-09-15T12:22:10.597212+0000","last_fullsized":"2024-09-15T12:22:10.597212+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9371648,"num_objects":143,"num_object_clones":0,"num_object_copies":429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":9152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":157,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.329852+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:22:08.329852+0000","last_peered":"2024-09-15T12:22:08.329852+0000","last_clean":"2024-09-15T12:22:08.329852+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:22:08.329852+0000","last_undegraded":"2024-09-15T12:22:08.329852+0000","last_fullsized":"2024-09-15T12:22:08.329852+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":86,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.325383+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:22:08.325383+0000","last_peered":"2024-09-15T12:22:08.325383+0000","last_clean":"2024-09-15T12:22:08.325383+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:22:08.325383+0000","last_undegraded":"2024-09-15T12:22:08.325383+0000","last_fullsized":"2024-09-15T12:22:08.325383+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"38'123","reported_seq":147,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.660775+0000","last_change":"2024-09-15T12:22:00.381165+0000","last_active":"2024-09-15T12:22:10.660775+0000","last_peered":"2024-09-15T12:22:10.660775+0000","last_clean":"2024-09-15T12:22:10.660775+0000","last_became_active":"2024-09-15T12:22:00.374145+0000","last_became_peered":"2024-09-15T12:22:00.374145+0000","last_unstale":"2024-09-15T12:22:10.660775+0000","last_undegraded":"2024-09-15T12:22:10.660775+0000","last_fullsized":"2024-09-15T12:22:10.660775+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":7872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.347588+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:22:08.347588+0000","last_peered":"2024-09-15T12:22:08.347588+0000","last_clean":"2024-09-15T12:22:08.347588+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:22:08.347588+0000","last_undegraded":"2024-09-15T12:22:08.347588+0000","last_fullsized":"2024-09-15T12:22:08.347588+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"38'121","reported_seq":145,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.710273+0000","last_change":"2024-09-15T12:22:00.405131+0000","last_active":"2024-09-15T12:22:10.710273+0000","last_peered":"2024-09-15T12:22:10.710273+0000","last_clean":"2024-09-15T12:22:10.710273+0000","last_became_active":"2024-09-15T12:22:00.398288+0000","last_became_peered":"2024-09-15T12:22:00.398288+0000","last_unstale":"2024-09-15T12:22:10.710273+0000","last_undegraded":"2024-09-15T12:22:10.710273+0000","last_fullsized":"2024-09-15T12:22:10.710273+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7929856,"num_objects":121,"num_object_clones":0,"num_object_copies":363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":7744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.315315+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:22:08.315315+0000","last_peered":"2024-09-15T12:22:08.315315+0000","last_clean":"2024-09-15T12:22:08.315315+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:22:08.315315+0000","last_undegraded":"2024-09-15T12:22:08.315315+0000","last_fullsized":"2024-09-15T12:22:08.315315+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"38'118","reported_seq":142,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.493646+0000","last_change":"2024-09-15T12:22:00.390143+0000","last_active":"2024-09-15T12:22:10.493646+0000","last_peered":"2024-09-15T12:22:10.493646+0000","last_clean":"2024-09-15T12:22:10.493646+0000","last_became_active":"2024-09-15T12:22:00.370049+0000","last_became_peered":"2024-09-15T12:22:00.370049+0000","last_unstale":"2024-09-15T12:22:10.493646+0000","last_undegraded":"2024-09-15T12:22:10.493646+0000","last_fullsized":"2024-09-15T12:22:10.493646+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":87,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.345671+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:22:08.345671+0000","last_peered":"2024-09-15T12:22:08.345671+0000","last_clean":"2024-09-15T12:22:08.345671+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:22:08.345671+0000","last_undegraded":"2024-09-15T12:22:08.345671+0000","last_fullsized":"2024-09-15T12:22:08.345671+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"38'124","reported_seq":148,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.477023+0000","last_change":"2024-09-15T12:22:00.450159+0000","last_active":"2024-09-15T12:22:10.477023+0000","last_peered":"2024-09-15T12:22:10.477023+0000","last_clean":"2024-09-15T12:22:10.477023+0000","last_became_active":"2024-09-15T12:22:00.437056+0000","last_became_peered":"2024-09-15T12:22:00.437056+0000","last_unstale":"2024-09-15T12:22:10.477023+0000","last_undegraded":"2024-09-15T12:22:10.477023+0000","last_fullsized":"2024-09-15T12:22:10.477023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.343276+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:22:08.343276+0000","last_peered":"2024-09-15T12:22:08.343276+0000","last_clean":"2024-09-15T12:22:08.343276+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:22:08.343276+0000","last_undegraded":"2024-09-15T12:22:08.343276+0000","last_fullsized":"2024-09-15T12:22:08.343276+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"38'124","reported_seq":148,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.544967+0000","last_change":"2024-09-15T12:22:00.364579+0000","last_active":"2024-09-15T12:22:10.544967+0000","last_peered":"2024-09-15T12:22:10.544967+0000","last_clean":"2024-09-15T12:22:10.544967+0000","last_became_active":"2024-09-15T12:22:00.353614+0000","last_became_peered":"2024-09-15T12:22:00.353614+0000","last_unstale":"2024-09-15T12:22:10.544967+0000","last_undegraded":"2024-09-15T12:22:10.544967+0000","last_fullsized":"2024-09-15T12:22:10.544967+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.334782+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:22:08.334782+0000","last_peered":"2024-09-15T12:22:08.334782+0000","last_clean":"2024-09-15T12:22:08.334782+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:22:08.334782+0000","last_undegraded":"2024-09-15T12:22:08.334782+0000","last_fullsized":"2024-09-15T12:22:08.334782+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"38'101","reported_seq":125,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.649900+0000","last_change":"2024-09-15T12:22:00.384094+0000","last_active":"2024-09-15T12:22:10.649900+0000","last_peered":"2024-09-15T12:22:10.649900+0000","last_clean":"2024-09-15T12:22:10.649900+0000","last_became_active":"2024-09-15T12:22:00.377789+0000","last_became_peered":"2024-09-15T12:22:00.377789+0000","last_unstale":"2024-09-15T12:22:10.649900+0000","last_undegraded":"2024-09-15T12:22:10.649900+0000","last_fullsized":"2024-09-15T12:22:10.649900+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.340307+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:22:08.340307+0000","last_peered":"2024-09-15T12:22:08.340307+0000","last_clean":"2024-09-15T12:22:08.340307+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:22:08.340307+0000","last_undegraded":"2024-09-15T12:22:08.340307+0000","last_fullsized":"2024-09-15T12:22:08.340307+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"38'134","reported_seq":158,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.736506+0000","last_change":"2024-09-15T12:22:00.394121+0000","last_active":"2024-09-15T12:22:10.736506+0000","last_peered":"2024-09-15T12:22:10.736506+0000","last_clean":"2024-09-15T12:22:10.736506+0000","last_became_active":"2024-09-15T12:22:00.388183+0000","last_became_peered":"2024-09-15T12:22:00.388183+0000","last_unstale":"2024-09-15T12:22:10.736506+0000","last_undegraded":"2024-09-15T12:22:10.736506+0000","last_fullsized":"2024-09-15T12:22:10.736506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8781824,"num_objects":134,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":8576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.319927+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:22:08.319927+0000","last_peered":"2024-09-15T12:22:08.319927+0000","last_clean":"2024-09-15T12:22:08.319927+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:22:08.319927+0000","last_undegraded":"2024-09-15T12:22:08.319927+0000","last_fullsized":"2024-09-15T12:22:08.319927+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":136052736,"num_objects":2076,"num_object_clones":0,"num_object_copies":6228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2076,"num_write_kb":132864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":26263552,"data_stored":420216832,"data_compressed":19950814,"data_compressed_allocated":26263552,"data_compressed_original":420216832,"omap_allocated":0,"internal_metadata":0},"log_size":2076,"ondisk_log_size":2076,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52376,"kb_used_data":7496,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94319464,"statfs":{"total":96636764160,"available":96583131136,"internally_reserved":0,"allocated":7675904,"data_stored":117421402,"data_compressed":5571588,"data_compressed_allocated":7335936,"data_compressed_original":117293056,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":58324,"kb_used_data":5124,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94313516,"statfs":{"total":96636764160,"available":96577040384,"internally_reserved":0,"allocated":5246976,"data_stored":78493037,"data_compressed":3723298,"data_compressed_allocated":4902912,"data_compressed_original":78364672,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51548,"kb_used_data":6668,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94320292,"statfs":{"total":96636764160,"available":96583979008,"internally_reserved":0,"allocated":6828032,"data_stored":104182605,"data_compressed":4940955,"data_compressed_allocated":6504448,"data_compressed_original":104071168,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59464,"kb_used_data":6264,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94312376,"statfs":{"total":96636764160,"available":96575873024,"internally_reserved":0,"allocated":6414336,"data_stored":97170797,"data_compressed":4610061,"data_compressed_allocated":6070272,"data_compressed_original":97042432,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6434816,"data_stored":102957056,"data_compressed":4888117,"data_compressed_allocated":6434816,"data_compressed_original":102957056,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6885376,"data_stored":110166016,"data_compressed":5230371,"data_compressed_allocated":6885376,"data_compressed_original":110166016,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5210112,"data_stored":83361792,"data_compressed":3957786,"data_compressed_allocated":5210112,"data_compressed_original":83361792,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7733248,"data_stored":123731968,"data_compressed":5874540,"data_compressed_allocated":7733248,"data_compressed_original":123731968,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:22:14.206 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-15T12:22:14.206 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:22:14.206 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:22:14.337 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 13 16 2899 2883 13.8594 13.875 0.0608353 0.0719244 2024-09-15T12:22:14.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:14.363+0000 7fabf0191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:14.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:14.375+0000 7fabf0191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:14.690 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:22:14.691 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:22:14.710 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2024-09-15T12:22:13.744070+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":136643123,"num_objects":2080,"num_object_clones":0,"num_object_copies":6240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2157,"num_write_kb":133972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2131,"ondisk_log_size":2131,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":221712,"kb_used_data":25552,"kb_used_omap":0,"kb_used_meta":196096,"kb_avail":377265648,"statfs":{"total":386547056640,"available":386320023552,"internally_reserved":0,"allocated":26165248,"data_stored":397267841,"data_compressed":18845902,"data_compressed_allocated":24813568,"data_compressed_original":396771328,"omap_allocated":0,"internal_metadata":200802304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":136052736,"num_objects":2076,"num_object_clones":0,"num_object_copies":6228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2076,"num_write_kb":132864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.467008"},"pg_stats":[{"pgid":"4.f","version":"38'143","reported_seq":167,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.724986+0000","last_change":"2024-09-15T12:22:00.377854+0000","last_active":"2024-09-15T12:22:10.724986+0000","last_peered":"2024-09-15T12:22:10.724986+0000","last_clean":"2024-09-15T12:22:10.724986+0000","last_became_active":"2024-09-15T12:22:00.359790+0000","last_became_peered":"2024-09-15T12:22:00.359790+0000","last_unstale":"2024-09-15T12:22:10.724986+0000","last_undegraded":"2024-09-15T12:22:10.724986+0000","last_fullsized":"2024-09-15T12:22:10.724986+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9371648,"num_objects":143,"num_object_clones":0,"num_object_copies":429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":9152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"38'124","reported_seq":148,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.658974+0000","last_change":"2024-09-15T12:22:00.383291+0000","last_active":"2024-09-15T12:22:10.658974+0000","last_peered":"2024-09-15T12:22:10.658974+0000","last_clean":"2024-09-15T12:22:10.658974+0000","last_became_active":"2024-09-15T12:22:00.376330+0000","last_became_peered":"2024-09-15T12:22:00.376330+0000","last_unstale":"2024-09-15T12:22:10.658974+0000","last_undegraded":"2024-09-15T12:22:10.658974+0000","last_fullsized":"2024-09-15T12:22:10.658974+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"38'145","reported_seq":169,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.667267+0000","last_change":"2024-09-15T12:22:00.413467+0000","last_active":"2024-09-15T12:22:10.667267+0000","last_peered":"2024-09-15T12:22:10.667267+0000","last_clean":"2024-09-15T12:22:10.667267+0000","last_became_active":"2024-09-15T12:22:00.399293+0000","last_became_peered":"2024-09-15T12:22:00.399293+0000","last_unstale":"2024-09-15T12:22:10.667267+0000","last_undegraded":"2024-09-15T12:22:10.667267+0000","last_fullsized":"2024-09-15T12:22:10.667267+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9502720,"num_objects":145,"num_object_clones":0,"num_object_copies":435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":9280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"38'135","reported_seq":159,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:11.540954+0000","last_change":"2024-09-15T12:22:00.397700+0000","last_active":"2024-09-15T12:22:11.540954+0000","last_peered":"2024-09-15T12:22:11.540954+0000","last_clean":"2024-09-15T12:22:11.540954+0000","last_became_active":"2024-09-15T12:22:00.388314+0000","last_became_peered":"2024-09-15T12:22:00.388314+0000","last_unstale":"2024-09-15T12:22:11.540954+0000","last_undegraded":"2024-09-15T12:22:11.540954+0000","last_fullsized":"2024-09-15T12:22:11.540954+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"38'117","reported_seq":141,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.707349+0000","last_change":"2024-09-15T12:22:00.418610+0000","last_active":"2024-09-15T12:22:10.707349+0000","last_peered":"2024-09-15T12:22:10.707349+0000","last_clean":"2024-09-15T12:22:10.707349+0000","last_became_active":"2024-09-15T12:22:00.404352+0000","last_became_peered":"2024-09-15T12:22:00.404352+0000","last_unstale":"2024-09-15T12:22:10.707349+0000","last_undegraded":"2024-09-15T12:22:10.707349+0000","last_fullsized":"2024-09-15T12:22:10.707349+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":7488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"38'134","reported_seq":158,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.605300+0000","last_change":"2024-09-15T12:22:00.408893+0000","last_active":"2024-09-15T12:22:10.605300+0000","last_peered":"2024-09-15T12:22:10.605300+0000","last_clean":"2024-09-15T12:22:10.605300+0000","last_became_active":"2024-09-15T12:22:00.399557+0000","last_became_peered":"2024-09-15T12:22:00.399557+0000","last_unstale":"2024-09-15T12:22:10.605300+0000","last_undegraded":"2024-09-15T12:22:10.605300+0000","last_fullsized":"2024-09-15T12:22:10.605300+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8781824,"num_objects":134,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":8576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"38'161","reported_seq":185,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.630299+0000","last_change":"2024-09-15T12:22:00.458263+0000","last_active":"2024-09-15T12:22:10.630299+0000","last_peered":"2024-09-15T12:22:10.630299+0000","last_clean":"2024-09-15T12:22:10.630299+0000","last_became_active":"2024-09-15T12:22:00.446629+0000","last_became_peered":"2024-09-15T12:22:00.446629+0000","last_unstale":"2024-09-15T12:22:10.630299+0000","last_undegraded":"2024-09-15T12:22:10.630299+0000","last_fullsized":"2024-09-15T12:22:10.630299+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551296,"num_objects":161,"num_object_clones":0,"num_object_copies":483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":10304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"38'129","reported_seq":153,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.648429+0000","last_change":"2024-09-15T12:22:00.432607+0000","last_active":"2024-09-15T12:22:10.648429+0000","last_peered":"2024-09-15T12:22:10.648429+0000","last_clean":"2024-09-15T12:22:10.648429+0000","last_became_active":"2024-09-15T12:22:00.422177+0000","last_became_peered":"2024-09-15T12:22:00.422177+0000","last_unstale":"2024-09-15T12:22:10.648429+0000","last_undegraded":"2024-09-15T12:22:10.648429+0000","last_fullsized":"2024-09-15T12:22:10.648429+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8454144,"num_objects":129,"num_object_clones":0,"num_object_copies":387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":8256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"38'143","reported_seq":167,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.597212+0000","last_change":"2024-09-15T12:22:00.420197+0000","last_active":"2024-09-15T12:22:10.597212+0000","last_peered":"2024-09-15T12:22:10.597212+0000","last_clean":"2024-09-15T12:22:10.597212+0000","last_became_active":"2024-09-15T12:22:00.406666+0000","last_became_peered":"2024-09-15T12:22:00.406666+0000","last_unstale":"2024-09-15T12:22:10.597212+0000","last_undegraded":"2024-09-15T12:22:10.597212+0000","last_fullsized":"2024-09-15T12:22:10.597212+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9371648,"num_objects":143,"num_object_clones":0,"num_object_copies":429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":9152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":157,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.329852+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:22:08.329852+0000","last_peered":"2024-09-15T12:22:08.329852+0000","last_clean":"2024-09-15T12:22:08.329852+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:22:08.329852+0000","last_undegraded":"2024-09-15T12:22:08.329852+0000","last_fullsized":"2024-09-15T12:22:08.329852+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":86,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.325383+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:22:08.325383+0000","last_peered":"2024-09-15T12:22:08.325383+0000","last_clean":"2024-09-15T12:22:08.325383+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:22:08.325383+0000","last_undegraded":"2024-09-15T12:22:08.325383+0000","last_fullsized":"2024-09-15T12:22:08.325383+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"38'123","reported_seq":147,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.660775+0000","last_change":"2024-09-15T12:22:00.381165+0000","last_active":"2024-09-15T12:22:10.660775+0000","last_peered":"2024-09-15T12:22:10.660775+0000","last_clean":"2024-09-15T12:22:10.660775+0000","last_became_active":"2024-09-15T12:22:00.374145+0000","last_became_peered":"2024-09-15T12:22:00.374145+0000","last_unstale":"2024-09-15T12:22:10.660775+0000","last_undegraded":"2024-09-15T12:22:10.660775+0000","last_fullsized":"2024-09-15T12:22:10.660775+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":7872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.347588+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:22:08.347588+0000","last_peered":"2024-09-15T12:22:08.347588+0000","last_clean":"2024-09-15T12:22:08.347588+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:22:08.347588+0000","last_undegraded":"2024-09-15T12:22:08.347588+0000","last_fullsized":"2024-09-15T12:22:08.347588+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"38'121","reported_seq":145,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.710273+0000","last_change":"2024-09-15T12:22:00.405131+0000","last_active":"2024-09-15T12:22:10.710273+0000","last_peered":"2024-09-15T12:22:10.710273+0000","last_clean":"2024-09-15T12:22:10.710273+0000","last_became_active":"2024-09-15T12:22:00.398288+0000","last_became_peered":"2024-09-15T12:22:00.398288+0000","last_unstale":"2024-09-15T12:22:10.710273+0000","last_undegraded":"2024-09-15T12:22:10.710273+0000","last_fullsized":"2024-09-15T12:22:10.710273+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7929856,"num_objects":121,"num_object_clones":0,"num_object_copies":363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":7744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.315315+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:22:08.315315+0000","last_peered":"2024-09-15T12:22:08.315315+0000","last_clean":"2024-09-15T12:22:08.315315+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:22:08.315315+0000","last_undegraded":"2024-09-15T12:22:08.315315+0000","last_fullsized":"2024-09-15T12:22:08.315315+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"38'118","reported_seq":142,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.493646+0000","last_change":"2024-09-15T12:22:00.390143+0000","last_active":"2024-09-15T12:22:10.493646+0000","last_peered":"2024-09-15T12:22:10.493646+0000","last_clean":"2024-09-15T12:22:10.493646+0000","last_became_active":"2024-09-15T12:22:00.370049+0000","last_became_peered":"2024-09-15T12:22:00.370049+0000","last_unstale":"2024-09-15T12:22:10.493646+0000","last_undegraded":"2024-09-15T12:22:10.493646+0000","last_fullsized":"2024-09-15T12:22:10.493646+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":87,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.345671+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:22:08.345671+0000","last_peered":"2024-09-15T12:22:08.345671+0000","last_clean":"2024-09-15T12:22:08.345671+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:22:08.345671+0000","last_undegraded":"2024-09-15T12:22:08.345671+0000","last_fullsized":"2024-09-15T12:22:08.345671+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"38'124","reported_seq":148,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.477023+0000","last_change":"2024-09-15T12:22:00.450159+0000","last_active":"2024-09-15T12:22:10.477023+0000","last_peered":"2024-09-15T12:22:10.477023+0000","last_clean":"2024-09-15T12:22:10.477023+0000","last_became_active":"2024-09-15T12:22:00.437056+0000","last_became_peered":"2024-09-15T12:22:00.437056+0000","last_unstale":"2024-09-15T12:22:10.477023+0000","last_undegraded":"2024-09-15T12:22:10.477023+0000","last_fullsized":"2024-09-15T12:22:10.477023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.343276+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:22:08.343276+0000","last_peered":"2024-09-15T12:22:08.343276+0000","last_clean":"2024-09-15T12:22:08.343276+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:22:08.343276+0000","last_undegraded":"2024-09-15T12:22:08.343276+0000","last_fullsized":"2024-09-15T12:22:08.343276+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"38'124","reported_seq":148,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.544967+0000","last_change":"2024-09-15T12:22:00.364579+0000","last_active":"2024-09-15T12:22:10.544967+0000","last_peered":"2024-09-15T12:22:10.544967+0000","last_clean":"2024-09-15T12:22:10.544967+0000","last_became_active":"2024-09-15T12:22:00.353614+0000","last_became_peered":"2024-09-15T12:22:00.353614+0000","last_unstale":"2024-09-15T12:22:10.544967+0000","last_undegraded":"2024-09-15T12:22:10.544967+0000","last_fullsized":"2024-09-15T12:22:10.544967+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.334782+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:22:08.334782+0000","last_peered":"2024-09-15T12:22:08.334782+0000","last_clean":"2024-09-15T12:22:08.334782+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:22:08.334782+0000","last_undegraded":"2024-09-15T12:22:08.334782+0000","last_fullsized":"2024-09-15T12:22:08.334782+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"38'101","reported_seq":125,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.649900+0000","last_change":"2024-09-15T12:22:00.384094+0000","last_active":"2024-09-15T12:22:10.649900+0000","last_peered":"2024-09-15T12:22:10.649900+0000","last_clean":"2024-09-15T12:22:10.649900+0000","last_became_active":"2024-09-15T12:22:00.377789+0000","last_became_peered":"2024-09-15T12:22:00.377789+0000","last_unstale":"2024-09-15T12:22:10.649900+0000","last_undegraded":"2024-09-15T12:22:10.649900+0000","last_fullsized":"2024-09-15T12:22:10.649900+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.340307+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:22:08.340307+0000","last_peered":"2024-09-15T12:22:08.340307+0000","last_clean":"2024-09-15T12:22:08.340307+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:22:08.340307+0000","last_undegraded":"2024-09-15T12:22:08.340307+0000","last_fullsized":"2024-09-15T12:22:08.340307+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"38'134","reported_seq":158,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.736506+0000","last_change":"2024-09-15T12:22:00.394121+0000","last_active":"2024-09-15T12:22:10.736506+0000","last_peered":"2024-09-15T12:22:10.736506+0000","last_clean":"2024-09-15T12:22:10.736506+0000","last_became_active":"2024-09-15T12:22:00.388183+0000","last_became_peered":"2024-09-15T12:22:00.388183+0000","last_unstale":"2024-09-15T12:22:10.736506+0000","last_undegraded":"2024-09-15T12:22:10.736506+0000","last_fullsized":"2024-09-15T12:22:10.736506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8781824,"num_objects":134,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":8576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.319927+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:22:08.319927+0000","last_peered":"2024-09-15T12:22:08.319927+0000","last_clean":"2024-09-15T12:22:08.319927+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:22:08.319927+0000","last_undegraded":"2024-09-15T12:22:08.319927+0000","last_fullsized":"2024-09-15T12:22:08.319927+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":136052736,"num_objects":2076,"num_object_clones":0,"num_object_copies":6228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2076,"num_write_kb":132864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":26263552,"data_stored":420216832,"data_compressed":19950814,"data_compressed_allocated":26263552,"data_compressed_original":420216832,"omap_allocated":0,"internal_metadata":0},"log_size":2076,"ondisk_log_size":2076,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52376,"kb_used_data":7496,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94319464,"statfs":{"total":96636764160,"available":96583131136,"internally_reserved":0,"allocated":7675904,"data_stored":117421402,"data_compressed":5571588,"data_compressed_allocated":7335936,"data_compressed_original":117293056,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":58324,"kb_used_data":5124,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94313516,"statfs":{"total":96636764160,"available":96577040384,"internally_reserved":0,"allocated":5246976,"data_stored":78493037,"data_compressed":3723298,"data_compressed_allocated":4902912,"data_compressed_original":78364672,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51548,"kb_used_data":6668,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94320292,"statfs":{"total":96636764160,"available":96583979008,"internally_reserved":0,"allocated":6828032,"data_stored":104182605,"data_compressed":4940955,"data_compressed_allocated":6504448,"data_compressed_original":104071168,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59464,"kb_used_data":6264,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94312376,"statfs":{"total":96636764160,"available":96575873024,"internally_reserved":0,"allocated":6414336,"data_stored":97170797,"data_compressed":4610061,"data_compressed_allocated":6070272,"data_compressed_original":97042432,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6434816,"data_stored":102957056,"data_compressed":4888117,"data_compressed_allocated":6434816,"data_compressed_original":102957056,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6885376,"data_stored":110166016,"data_compressed":5230371,"data_compressed_allocated":6885376,"data_compressed_original":110166016,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5210112,"data_stored":83361792,"data_compressed":3957786,"data_compressed_allocated":5210112,"data_compressed_original":83361792,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7733248,"data_stored":123731968,"data_compressed":5874540,"data_compressed_allocated":7733248,"data_compressed_original":123731968,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:22:14.782 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:22:14.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:14.939+0000 7fe688751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:14.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:14.952+0000 7fe688751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:15.337 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 14 16 3107 3091 13.7979 13 0.0509024 0.0722146 2024-09-15T12:22:16.337 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 15 16 3341 3325 13.853 14.625 0.0453427 0.0719876 2024-09-15T12:22:17.305 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:22:17.337 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 16 16 3575 3559 13.9011 14.625 0.0777384 0.0717328 2024-09-15T12:22:17.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:17.472+0000 7f5b92711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:17.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:17.483+0000 7f5b92711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:18.337 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 17 16 3793 3777 13.8848 13.625 0.0746416 0.071826 2024-09-15T12:22:19.337 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 18 16 4027 4011 13.9259 14.625 0.0668195 0.0717184 2024-09-15T12:22:19.712 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:22:19.712 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:22:19.712 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:22:19.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:19.885+0000 7fca49d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:19.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:19.900+0000 7fca49d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:19.957 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:22:20.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:20.119+0000 7ff369191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:20.133+0000 7ff369191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:20.239 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:22:20.240 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:22:20.263 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2024-09-15T12:22:19.745417+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":136643123,"num_objects":2080,"num_object_clones":0,"num_object_copies":6240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2157,"num_write_kb":133972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2131,"ondisk_log_size":2131,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":221712,"kb_used_data":25552,"kb_used_omap":0,"kb_used_meta":196096,"kb_avail":377265648,"statfs":{"total":386547056640,"available":386320023552,"internally_reserved":0,"allocated":26165248,"data_stored":397267841,"data_compressed":18845902,"data_compressed_allocated":24813568,"data_compressed_original":396771328,"omap_allocated":0,"internal_metadata":200802304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":136052736,"num_objects":2076,"num_object_clones":0,"num_object_copies":6228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2076,"num_write_kb":132864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.457571"},"pg_stats":[{"pgid":"4.f","version":"38'143","reported_seq":167,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.724986+0000","last_change":"2024-09-15T12:22:00.377854+0000","last_active":"2024-09-15T12:22:10.724986+0000","last_peered":"2024-09-15T12:22:10.724986+0000","last_clean":"2024-09-15T12:22:10.724986+0000","last_became_active":"2024-09-15T12:22:00.359790+0000","last_became_peered":"2024-09-15T12:22:00.359790+0000","last_unstale":"2024-09-15T12:22:10.724986+0000","last_undegraded":"2024-09-15T12:22:10.724986+0000","last_fullsized":"2024-09-15T12:22:10.724986+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9371648,"num_objects":143,"num_object_clones":0,"num_object_copies":429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":9152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"38'124","reported_seq":148,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.658974+0000","last_change":"2024-09-15T12:22:00.383291+0000","last_active":"2024-09-15T12:22:10.658974+0000","last_peered":"2024-09-15T12:22:10.658974+0000","last_clean":"2024-09-15T12:22:10.658974+0000","last_became_active":"2024-09-15T12:22:00.376330+0000","last_became_peered":"2024-09-15T12:22:00.376330+0000","last_unstale":"2024-09-15T12:22:10.658974+0000","last_undegraded":"2024-09-15T12:22:10.658974+0000","last_fullsized":"2024-09-15T12:22:10.658974+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"38'145","reported_seq":169,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.667267+0000","last_change":"2024-09-15T12:22:00.413467+0000","last_active":"2024-09-15T12:22:10.667267+0000","last_peered":"2024-09-15T12:22:10.667267+0000","last_clean":"2024-09-15T12:22:10.667267+0000","last_became_active":"2024-09-15T12:22:00.399293+0000","last_became_peered":"2024-09-15T12:22:00.399293+0000","last_unstale":"2024-09-15T12:22:10.667267+0000","last_undegraded":"2024-09-15T12:22:10.667267+0000","last_fullsized":"2024-09-15T12:22:10.667267+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9502720,"num_objects":145,"num_object_clones":0,"num_object_copies":435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":9280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"38'135","reported_seq":159,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:11.540954+0000","last_change":"2024-09-15T12:22:00.397700+0000","last_active":"2024-09-15T12:22:11.540954+0000","last_peered":"2024-09-15T12:22:11.540954+0000","last_clean":"2024-09-15T12:22:11.540954+0000","last_became_active":"2024-09-15T12:22:00.388314+0000","last_became_peered":"2024-09-15T12:22:00.388314+0000","last_unstale":"2024-09-15T12:22:11.540954+0000","last_undegraded":"2024-09-15T12:22:11.540954+0000","last_fullsized":"2024-09-15T12:22:11.540954+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"38'117","reported_seq":141,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.707349+0000","last_change":"2024-09-15T12:22:00.418610+0000","last_active":"2024-09-15T12:22:10.707349+0000","last_peered":"2024-09-15T12:22:10.707349+0000","last_clean":"2024-09-15T12:22:10.707349+0000","last_became_active":"2024-09-15T12:22:00.404352+0000","last_became_peered":"2024-09-15T12:22:00.404352+0000","last_unstale":"2024-09-15T12:22:10.707349+0000","last_undegraded":"2024-09-15T12:22:10.707349+0000","last_fullsized":"2024-09-15T12:22:10.707349+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":7488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"38'134","reported_seq":158,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.605300+0000","last_change":"2024-09-15T12:22:00.408893+0000","last_active":"2024-09-15T12:22:10.605300+0000","last_peered":"2024-09-15T12:22:10.605300+0000","last_clean":"2024-09-15T12:22:10.605300+0000","last_became_active":"2024-09-15T12:22:00.399557+0000","last_became_peered":"2024-09-15T12:22:00.399557+0000","last_unstale":"2024-09-15T12:22:10.605300+0000","last_undegraded":"2024-09-15T12:22:10.605300+0000","last_fullsized":"2024-09-15T12:22:10.605300+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8781824,"num_objects":134,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":8576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"38'161","reported_seq":185,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.630299+0000","last_change":"2024-09-15T12:22:00.458263+0000","last_active":"2024-09-15T12:22:10.630299+0000","last_peered":"2024-09-15T12:22:10.630299+0000","last_clean":"2024-09-15T12:22:10.630299+0000","last_became_active":"2024-09-15T12:22:00.446629+0000","last_became_peered":"2024-09-15T12:22:00.446629+0000","last_unstale":"2024-09-15T12:22:10.630299+0000","last_undegraded":"2024-09-15T12:22:10.630299+0000","last_fullsized":"2024-09-15T12:22:10.630299+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551296,"num_objects":161,"num_object_clones":0,"num_object_copies":483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":10304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"38'129","reported_seq":153,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.648429+0000","last_change":"2024-09-15T12:22:00.432607+0000","last_active":"2024-09-15T12:22:10.648429+0000","last_peered":"2024-09-15T12:22:10.648429+0000","last_clean":"2024-09-15T12:22:10.648429+0000","last_became_active":"2024-09-15T12:22:00.422177+0000","last_became_peered":"2024-09-15T12:22:00.422177+0000","last_unstale":"2024-09-15T12:22:10.648429+0000","last_undegraded":"2024-09-15T12:22:10.648429+0000","last_fullsized":"2024-09-15T12:22:10.648429+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8454144,"num_objects":129,"num_object_clones":0,"num_object_copies":387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":8256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"38'143","reported_seq":167,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.597212+0000","last_change":"2024-09-15T12:22:00.420197+0000","last_active":"2024-09-15T12:22:10.597212+0000","last_peered":"2024-09-15T12:22:10.597212+0000","last_clean":"2024-09-15T12:22:10.597212+0000","last_became_active":"2024-09-15T12:22:00.406666+0000","last_became_peered":"2024-09-15T12:22:00.406666+0000","last_unstale":"2024-09-15T12:22:10.597212+0000","last_undegraded":"2024-09-15T12:22:10.597212+0000","last_fullsized":"2024-09-15T12:22:10.597212+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9371648,"num_objects":143,"num_object_clones":0,"num_object_copies":429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":9152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":157,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.329852+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:22:08.329852+0000","last_peered":"2024-09-15T12:22:08.329852+0000","last_clean":"2024-09-15T12:22:08.329852+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:22:08.329852+0000","last_undegraded":"2024-09-15T12:22:08.329852+0000","last_fullsized":"2024-09-15T12:22:08.329852+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":86,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.325383+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:22:08.325383+0000","last_peered":"2024-09-15T12:22:08.325383+0000","last_clean":"2024-09-15T12:22:08.325383+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:22:08.325383+0000","last_undegraded":"2024-09-15T12:22:08.325383+0000","last_fullsized":"2024-09-15T12:22:08.325383+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"38'123","reported_seq":147,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.660775+0000","last_change":"2024-09-15T12:22:00.381165+0000","last_active":"2024-09-15T12:22:10.660775+0000","last_peered":"2024-09-15T12:22:10.660775+0000","last_clean":"2024-09-15T12:22:10.660775+0000","last_became_active":"2024-09-15T12:22:00.374145+0000","last_became_peered":"2024-09-15T12:22:00.374145+0000","last_unstale":"2024-09-15T12:22:10.660775+0000","last_undegraded":"2024-09-15T12:22:10.660775+0000","last_fullsized":"2024-09-15T12:22:10.660775+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":7872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.347588+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:22:08.347588+0000","last_peered":"2024-09-15T12:22:08.347588+0000","last_clean":"2024-09-15T12:22:08.347588+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:22:08.347588+0000","last_undegraded":"2024-09-15T12:22:08.347588+0000","last_fullsized":"2024-09-15T12:22:08.347588+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"38'121","reported_seq":145,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.710273+0000","last_change":"2024-09-15T12:22:00.405131+0000","last_active":"2024-09-15T12:22:10.710273+0000","last_peered":"2024-09-15T12:22:10.710273+0000","last_clean":"2024-09-15T12:22:10.710273+0000","last_became_active":"2024-09-15T12:22:00.398288+0000","last_became_peered":"2024-09-15T12:22:00.398288+0000","last_unstale":"2024-09-15T12:22:10.710273+0000","last_undegraded":"2024-09-15T12:22:10.710273+0000","last_fullsized":"2024-09-15T12:22:10.710273+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7929856,"num_objects":121,"num_object_clones":0,"num_object_copies":363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":7744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.315315+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:22:08.315315+0000","last_peered":"2024-09-15T12:22:08.315315+0000","last_clean":"2024-09-15T12:22:08.315315+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:22:08.315315+0000","last_undegraded":"2024-09-15T12:22:08.315315+0000","last_fullsized":"2024-09-15T12:22:08.315315+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"38'118","reported_seq":142,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.493646+0000","last_change":"2024-09-15T12:22:00.390143+0000","last_active":"2024-09-15T12:22:10.493646+0000","last_peered":"2024-09-15T12:22:10.493646+0000","last_clean":"2024-09-15T12:22:10.493646+0000","last_became_active":"2024-09-15T12:22:00.370049+0000","last_became_peered":"2024-09-15T12:22:00.370049+0000","last_unstale":"2024-09-15T12:22:10.493646+0000","last_undegraded":"2024-09-15T12:22:10.493646+0000","last_fullsized":"2024-09-15T12:22:10.493646+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":87,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.345671+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:22:08.345671+0000","last_peered":"2024-09-15T12:22:08.345671+0000","last_clean":"2024-09-15T12:22:08.345671+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:22:08.345671+0000","last_undegraded":"2024-09-15T12:22:08.345671+0000","last_fullsized":"2024-09-15T12:22:08.345671+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"38'124","reported_seq":148,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.477023+0000","last_change":"2024-09-15T12:22:00.450159+0000","last_active":"2024-09-15T12:22:10.477023+0000","last_peered":"2024-09-15T12:22:10.477023+0000","last_clean":"2024-09-15T12:22:10.477023+0000","last_became_active":"2024-09-15T12:22:00.437056+0000","last_became_peered":"2024-09-15T12:22:00.437056+0000","last_unstale":"2024-09-15T12:22:10.477023+0000","last_undegraded":"2024-09-15T12:22:10.477023+0000","last_fullsized":"2024-09-15T12:22:10.477023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.343276+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:22:08.343276+0000","last_peered":"2024-09-15T12:22:08.343276+0000","last_clean":"2024-09-15T12:22:08.343276+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:22:08.343276+0000","last_undegraded":"2024-09-15T12:22:08.343276+0000","last_fullsized":"2024-09-15T12:22:08.343276+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"38'124","reported_seq":148,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.544967+0000","last_change":"2024-09-15T12:22:00.364579+0000","last_active":"2024-09-15T12:22:10.544967+0000","last_peered":"2024-09-15T12:22:10.544967+0000","last_clean":"2024-09-15T12:22:10.544967+0000","last_became_active":"2024-09-15T12:22:00.353614+0000","last_became_peered":"2024-09-15T12:22:00.353614+0000","last_unstale":"2024-09-15T12:22:10.544967+0000","last_undegraded":"2024-09-15T12:22:10.544967+0000","last_fullsized":"2024-09-15T12:22:10.544967+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.334782+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:22:08.334782+0000","last_peered":"2024-09-15T12:22:08.334782+0000","last_clean":"2024-09-15T12:22:08.334782+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:22:08.334782+0000","last_undegraded":"2024-09-15T12:22:08.334782+0000","last_fullsized":"2024-09-15T12:22:08.334782+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"38'101","reported_seq":125,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.649900+0000","last_change":"2024-09-15T12:22:00.384094+0000","last_active":"2024-09-15T12:22:10.649900+0000","last_peered":"2024-09-15T12:22:10.649900+0000","last_clean":"2024-09-15T12:22:10.649900+0000","last_became_active":"2024-09-15T12:22:00.377789+0000","last_became_peered":"2024-09-15T12:22:00.377789+0000","last_unstale":"2024-09-15T12:22:10.649900+0000","last_undegraded":"2024-09-15T12:22:10.649900+0000","last_fullsized":"2024-09-15T12:22:10.649900+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.340307+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:22:08.340307+0000","last_peered":"2024-09-15T12:22:08.340307+0000","last_clean":"2024-09-15T12:22:08.340307+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:22:08.340307+0000","last_undegraded":"2024-09-15T12:22:08.340307+0000","last_fullsized":"2024-09-15T12:22:08.340307+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"38'134","reported_seq":158,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.736506+0000","last_change":"2024-09-15T12:22:00.394121+0000","last_active":"2024-09-15T12:22:10.736506+0000","last_peered":"2024-09-15T12:22:10.736506+0000","last_clean":"2024-09-15T12:22:10.736506+0000","last_became_active":"2024-09-15T12:22:00.388183+0000","last_became_peered":"2024-09-15T12:22:00.388183+0000","last_unstale":"2024-09-15T12:22:10.736506+0000","last_undegraded":"2024-09-15T12:22:10.736506+0000","last_fullsized":"2024-09-15T12:22:10.736506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8781824,"num_objects":134,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":8576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.319927+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:22:08.319927+0000","last_peered":"2024-09-15T12:22:08.319927+0000","last_clean":"2024-09-15T12:22:08.319927+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:22:08.319927+0000","last_undegraded":"2024-09-15T12:22:08.319927+0000","last_fullsized":"2024-09-15T12:22:08.319927+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":136052736,"num_objects":2076,"num_object_clones":0,"num_object_copies":6228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2076,"num_write_kb":132864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":26263552,"data_stored":420216832,"data_compressed":19950814,"data_compressed_allocated":26263552,"data_compressed_original":420216832,"omap_allocated":0,"internal_metadata":0},"log_size":2076,"ondisk_log_size":2076,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52376,"kb_used_data":7496,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94319464,"statfs":{"total":96636764160,"available":96583131136,"internally_reserved":0,"allocated":7675904,"data_stored":117421402,"data_compressed":5571588,"data_compressed_allocated":7335936,"data_compressed_original":117293056,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":58324,"kb_used_data":5124,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94313516,"statfs":{"total":96636764160,"available":96577040384,"internally_reserved":0,"allocated":5246976,"data_stored":78493037,"data_compressed":3723298,"data_compressed_allocated":4902912,"data_compressed_original":78364672,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51548,"kb_used_data":6668,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94320292,"statfs":{"total":96636764160,"available":96583979008,"internally_reserved":0,"allocated":6828032,"data_stored":104182605,"data_compressed":4940955,"data_compressed_allocated":6504448,"data_compressed_original":104071168,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59464,"kb_used_data":6264,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94312376,"statfs":{"total":96636764160,"available":96575873024,"internally_reserved":0,"allocated":6414336,"data_stored":97170797,"data_compressed":4610061,"data_compressed_allocated":6070272,"data_compressed_original":97042432,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6434816,"data_stored":102957056,"data_compressed":4888117,"data_compressed_allocated":6434816,"data_compressed_original":102957056,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6885376,"data_stored":110166016,"data_compressed":5230371,"data_compressed_allocated":6885376,"data_compressed_original":110166016,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5210112,"data_stored":83361792,"data_compressed":3957786,"data_compressed_allocated":5210112,"data_compressed_original":83361792,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7733248,"data_stored":123731968,"data_compressed":5874540,"data_compressed_allocated":7733248,"data_compressed_original":123731968,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:22:20.337 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 19 16 4240 4224 13.8935 13.3125 0.0501252 0.0718333 2024-09-15T12:22:21.337 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:2024-09-15T12:22:21.337264+0000 min lat: 0.0169163 max lat: 0.190085 avg lat: 0.0718998 2024-09-15T12:22:21.337 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-15T12:22:21.338 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 20 16 4453 4437 13.8644 13.3125 0.0249078 0.0718998 2024-09-15T12:22:22.337 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 21 16 4676 4660 13.8678 13.9375 0.0427172 0.0719459 2024-09-15T12:22:22.766 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:22:22.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:22.936+0000 7f86d6d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:22.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:22.945+0000 7f86d6d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:23.337 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 22 16 4888 4872 13.8397 13.25 0.0519707 0.0720602 2024-09-15T12:22:24.338 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 23 16 5101 5085 13.8167 13.3125 0.0734972 0.0722368 2024-09-15T12:22:25.266 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:22:25.266 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:22:25.266 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:22:25.323 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:22:25.338 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 24 16 5329 5313 13.8347 14.25 0.0615996 0.0721717 2024-09-15T12:22:25.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:25.440+0000 7f79bf191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:25.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:25.458+0000 7f79bf191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:25.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:25.506+0000 7f8ff4cbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:25.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:25.517+0000 7f8ff4cbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:25.790 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:22:25.790 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:22:25.807 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-09-15T12:22:25.746760+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":136643123,"num_objects":2080,"num_object_clones":0,"num_object_copies":6240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2157,"num_write_kb":133972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2131,"ondisk_log_size":2131,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":221712,"kb_used_data":25552,"kb_used_omap":0,"kb_used_meta":196096,"kb_avail":377265648,"statfs":{"total":386547056640,"available":386320023552,"internally_reserved":0,"allocated":26165248,"data_stored":397267841,"data_compressed":18845902,"data_compressed_allocated":24813568,"data_compressed_original":396771328,"omap_allocated":0,"internal_metadata":200802304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002690"},"pg_stats":[{"pgid":"4.f","version":"38'143","reported_seq":167,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.724986+0000","last_change":"2024-09-15T12:22:00.377854+0000","last_active":"2024-09-15T12:22:10.724986+0000","last_peered":"2024-09-15T12:22:10.724986+0000","last_clean":"2024-09-15T12:22:10.724986+0000","last_became_active":"2024-09-15T12:22:00.359790+0000","last_became_peered":"2024-09-15T12:22:00.359790+0000","last_unstale":"2024-09-15T12:22:10.724986+0000","last_undegraded":"2024-09-15T12:22:10.724986+0000","last_fullsized":"2024-09-15T12:22:10.724986+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9371648,"num_objects":143,"num_object_clones":0,"num_object_copies":429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":9152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"38'124","reported_seq":148,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.658974+0000","last_change":"2024-09-15T12:22:00.383291+0000","last_active":"2024-09-15T12:22:10.658974+0000","last_peered":"2024-09-15T12:22:10.658974+0000","last_clean":"2024-09-15T12:22:10.658974+0000","last_became_active":"2024-09-15T12:22:00.376330+0000","last_became_peered":"2024-09-15T12:22:00.376330+0000","last_unstale":"2024-09-15T12:22:10.658974+0000","last_undegraded":"2024-09-15T12:22:10.658974+0000","last_fullsized":"2024-09-15T12:22:10.658974+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"38'145","reported_seq":169,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.667267+0000","last_change":"2024-09-15T12:22:00.413467+0000","last_active":"2024-09-15T12:22:10.667267+0000","last_peered":"2024-09-15T12:22:10.667267+0000","last_clean":"2024-09-15T12:22:10.667267+0000","last_became_active":"2024-09-15T12:22:00.399293+0000","last_became_peered":"2024-09-15T12:22:00.399293+0000","last_unstale":"2024-09-15T12:22:10.667267+0000","last_undegraded":"2024-09-15T12:22:10.667267+0000","last_fullsized":"2024-09-15T12:22:10.667267+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9502720,"num_objects":145,"num_object_clones":0,"num_object_copies":435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":145,"num_write_kb":9280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"38'135","reported_seq":159,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:11.540954+0000","last_change":"2024-09-15T12:22:00.397700+0000","last_active":"2024-09-15T12:22:11.540954+0000","last_peered":"2024-09-15T12:22:11.540954+0000","last_clean":"2024-09-15T12:22:11.540954+0000","last_became_active":"2024-09-15T12:22:00.388314+0000","last_became_peered":"2024-09-15T12:22:00.388314+0000","last_unstale":"2024-09-15T12:22:11.540954+0000","last_undegraded":"2024-09-15T12:22:11.540954+0000","last_fullsized":"2024-09-15T12:22:11.540954+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"38'117","reported_seq":141,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.707349+0000","last_change":"2024-09-15T12:22:00.418610+0000","last_active":"2024-09-15T12:22:10.707349+0000","last_peered":"2024-09-15T12:22:10.707349+0000","last_clean":"2024-09-15T12:22:10.707349+0000","last_became_active":"2024-09-15T12:22:00.404352+0000","last_became_peered":"2024-09-15T12:22:00.404352+0000","last_unstale":"2024-09-15T12:22:10.707349+0000","last_undegraded":"2024-09-15T12:22:10.707349+0000","last_fullsized":"2024-09-15T12:22:10.707349+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":7488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"38'134","reported_seq":158,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.605300+0000","last_change":"2024-09-15T12:22:00.408893+0000","last_active":"2024-09-15T12:22:10.605300+0000","last_peered":"2024-09-15T12:22:10.605300+0000","last_clean":"2024-09-15T12:22:10.605300+0000","last_became_active":"2024-09-15T12:22:00.399557+0000","last_became_peered":"2024-09-15T12:22:00.399557+0000","last_unstale":"2024-09-15T12:22:10.605300+0000","last_undegraded":"2024-09-15T12:22:10.605300+0000","last_fullsized":"2024-09-15T12:22:10.605300+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8781824,"num_objects":134,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":8576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"38'161","reported_seq":185,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.630299+0000","last_change":"2024-09-15T12:22:00.458263+0000","last_active":"2024-09-15T12:22:10.630299+0000","last_peered":"2024-09-15T12:22:10.630299+0000","last_clean":"2024-09-15T12:22:10.630299+0000","last_became_active":"2024-09-15T12:22:00.446629+0000","last_became_peered":"2024-09-15T12:22:00.446629+0000","last_unstale":"2024-09-15T12:22:10.630299+0000","last_undegraded":"2024-09-15T12:22:10.630299+0000","last_fullsized":"2024-09-15T12:22:10.630299+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10551296,"num_objects":161,"num_object_clones":0,"num_object_copies":483,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":161,"num_write_kb":10304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"38'129","reported_seq":153,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.648429+0000","last_change":"2024-09-15T12:22:00.432607+0000","last_active":"2024-09-15T12:22:10.648429+0000","last_peered":"2024-09-15T12:22:10.648429+0000","last_clean":"2024-09-15T12:22:10.648429+0000","last_became_active":"2024-09-15T12:22:00.422177+0000","last_became_peered":"2024-09-15T12:22:00.422177+0000","last_unstale":"2024-09-15T12:22:10.648429+0000","last_undegraded":"2024-09-15T12:22:10.648429+0000","last_fullsized":"2024-09-15T12:22:10.648429+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8454144,"num_objects":129,"num_object_clones":0,"num_object_copies":387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":8256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"38'143","reported_seq":167,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.597212+0000","last_change":"2024-09-15T12:22:00.420197+0000","last_active":"2024-09-15T12:22:10.597212+0000","last_peered":"2024-09-15T12:22:10.597212+0000","last_clean":"2024-09-15T12:22:10.597212+0000","last_became_active":"2024-09-15T12:22:00.406666+0000","last_became_peered":"2024-09-15T12:22:00.406666+0000","last_unstale":"2024-09-15T12:22:10.597212+0000","last_undegraded":"2024-09-15T12:22:10.597212+0000","last_fullsized":"2024-09-15T12:22:10.597212+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9371648,"num_objects":143,"num_object_clones":0,"num_object_copies":429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":143,"num_write_kb":9152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":157,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.329852+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:22:08.329852+0000","last_peered":"2024-09-15T12:22:08.329852+0000","last_clean":"2024-09-15T12:22:08.329852+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:22:08.329852+0000","last_undegraded":"2024-09-15T12:22:08.329852+0000","last_fullsized":"2024-09-15T12:22:08.329852+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":86,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.325383+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:22:08.325383+0000","last_peered":"2024-09-15T12:22:08.325383+0000","last_clean":"2024-09-15T12:22:08.325383+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:22:08.325383+0000","last_undegraded":"2024-09-15T12:22:08.325383+0000","last_fullsized":"2024-09-15T12:22:08.325383+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"38'123","reported_seq":147,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.660775+0000","last_change":"2024-09-15T12:22:00.381165+0000","last_active":"2024-09-15T12:22:10.660775+0000","last_peered":"2024-09-15T12:22:10.660775+0000","last_clean":"2024-09-15T12:22:10.660775+0000","last_became_active":"2024-09-15T12:22:00.374145+0000","last_became_peered":"2024-09-15T12:22:00.374145+0000","last_unstale":"2024-09-15T12:22:10.660775+0000","last_undegraded":"2024-09-15T12:22:10.660775+0000","last_fullsized":"2024-09-15T12:22:10.660775+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8060928,"num_objects":123,"num_object_clones":0,"num_object_copies":369,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":7872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.347588+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:22:08.347588+0000","last_peered":"2024-09-15T12:22:08.347588+0000","last_clean":"2024-09-15T12:22:08.347588+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:22:08.347588+0000","last_undegraded":"2024-09-15T12:22:08.347588+0000","last_fullsized":"2024-09-15T12:22:08.347588+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"38'121","reported_seq":145,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.710273+0000","last_change":"2024-09-15T12:22:00.405131+0000","last_active":"2024-09-15T12:22:10.710273+0000","last_peered":"2024-09-15T12:22:10.710273+0000","last_clean":"2024-09-15T12:22:10.710273+0000","last_became_active":"2024-09-15T12:22:00.398288+0000","last_became_peered":"2024-09-15T12:22:00.398288+0000","last_unstale":"2024-09-15T12:22:10.710273+0000","last_undegraded":"2024-09-15T12:22:10.710273+0000","last_fullsized":"2024-09-15T12:22:10.710273+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7929856,"num_objects":121,"num_object_clones":0,"num_object_copies":363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":7744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.315315+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:22:08.315315+0000","last_peered":"2024-09-15T12:22:08.315315+0000","last_clean":"2024-09-15T12:22:08.315315+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:22:08.315315+0000","last_undegraded":"2024-09-15T12:22:08.315315+0000","last_fullsized":"2024-09-15T12:22:08.315315+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"38'118","reported_seq":142,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.493646+0000","last_change":"2024-09-15T12:22:00.390143+0000","last_active":"2024-09-15T12:22:10.493646+0000","last_peered":"2024-09-15T12:22:10.493646+0000","last_clean":"2024-09-15T12:22:10.493646+0000","last_became_active":"2024-09-15T12:22:00.370049+0000","last_became_peered":"2024-09-15T12:22:00.370049+0000","last_unstale":"2024-09-15T12:22:10.493646+0000","last_undegraded":"2024-09-15T12:22:10.493646+0000","last_fullsized":"2024-09-15T12:22:10.493646+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7733248,"num_objects":118,"num_object_clones":0,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":118,"num_write_kb":7552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":87,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.345671+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:22:08.345671+0000","last_peered":"2024-09-15T12:22:08.345671+0000","last_clean":"2024-09-15T12:22:08.345671+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:22:08.345671+0000","last_undegraded":"2024-09-15T12:22:08.345671+0000","last_fullsized":"2024-09-15T12:22:08.345671+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"38'124","reported_seq":148,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.477023+0000","last_change":"2024-09-15T12:22:00.450159+0000","last_active":"2024-09-15T12:22:10.477023+0000","last_peered":"2024-09-15T12:22:10.477023+0000","last_clean":"2024-09-15T12:22:10.477023+0000","last_became_active":"2024-09-15T12:22:00.437056+0000","last_became_peered":"2024-09-15T12:22:00.437056+0000","last_unstale":"2024-09-15T12:22:10.477023+0000","last_undegraded":"2024-09-15T12:22:10.477023+0000","last_fullsized":"2024-09-15T12:22:10.477023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.343276+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:22:08.343276+0000","last_peered":"2024-09-15T12:22:08.343276+0000","last_clean":"2024-09-15T12:22:08.343276+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:22:08.343276+0000","last_undegraded":"2024-09-15T12:22:08.343276+0000","last_fullsized":"2024-09-15T12:22:08.343276+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"38'124","reported_seq":148,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.544967+0000","last_change":"2024-09-15T12:22:00.364579+0000","last_active":"2024-09-15T12:22:10.544967+0000","last_peered":"2024-09-15T12:22:10.544967+0000","last_clean":"2024-09-15T12:22:10.544967+0000","last_became_active":"2024-09-15T12:22:00.353614+0000","last_became_peered":"2024-09-15T12:22:00.353614+0000","last_unstale":"2024-09-15T12:22:10.544967+0000","last_undegraded":"2024-09-15T12:22:10.544967+0000","last_fullsized":"2024-09-15T12:22:10.544967+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.334782+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:22:08.334782+0000","last_peered":"2024-09-15T12:22:08.334782+0000","last_clean":"2024-09-15T12:22:08.334782+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:22:08.334782+0000","last_undegraded":"2024-09-15T12:22:08.334782+0000","last_fullsized":"2024-09-15T12:22:08.334782+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"38'101","reported_seq":125,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.649900+0000","last_change":"2024-09-15T12:22:00.384094+0000","last_active":"2024-09-15T12:22:10.649900+0000","last_peered":"2024-09-15T12:22:10.649900+0000","last_clean":"2024-09-15T12:22:10.649900+0000","last_became_active":"2024-09-15T12:22:00.377789+0000","last_became_peered":"2024-09-15T12:22:00.377789+0000","last_unstale":"2024-09-15T12:22:10.649900+0000","last_undegraded":"2024-09-15T12:22:10.649900+0000","last_fullsized":"2024-09-15T12:22:10.649900+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6619136,"num_objects":101,"num_object_clones":0,"num_object_copies":303,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":101,"num_write_kb":6464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.340307+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:22:08.340307+0000","last_peered":"2024-09-15T12:22:08.340307+0000","last_clean":"2024-09-15T12:22:08.340307+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:22:08.340307+0000","last_undegraded":"2024-09-15T12:22:08.340307+0000","last_fullsized":"2024-09-15T12:22:08.340307+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"38'134","reported_seq":158,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:10.736506+0000","last_change":"2024-09-15T12:22:00.394121+0000","last_active":"2024-09-15T12:22:10.736506+0000","last_peered":"2024-09-15T12:22:10.736506+0000","last_clean":"2024-09-15T12:22:10.736506+0000","last_became_active":"2024-09-15T12:22:00.388183+0000","last_became_peered":"2024-09-15T12:22:00.388183+0000","last_unstale":"2024-09-15T12:22:10.736506+0000","last_undegraded":"2024-09-15T12:22:10.736506+0000","last_fullsized":"2024-09-15T12:22:10.736506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8781824,"num_objects":134,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":8576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.319927+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:22:08.319927+0000","last_peered":"2024-09-15T12:22:08.319927+0000","last_clean":"2024-09-15T12:22:08.319927+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:22:08.319927+0000","last_undegraded":"2024-09-15T12:22:08.319927+0000","last_fullsized":"2024-09-15T12:22:08.319927+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":136052736,"num_objects":2076,"num_object_clones":0,"num_object_copies":6228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2076,"num_write_kb":132864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":26263552,"data_stored":420216832,"data_compressed":19950814,"data_compressed_allocated":26263552,"data_compressed_original":420216832,"omap_allocated":0,"internal_metadata":0},"log_size":2076,"ondisk_log_size":2076,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52376,"kb_used_data":7496,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94319464,"statfs":{"total":96636764160,"available":96583131136,"internally_reserved":0,"allocated":7675904,"data_stored":117421402,"data_compressed":5571588,"data_compressed_allocated":7335936,"data_compressed_original":117293056,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":58324,"kb_used_data":5124,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94313516,"statfs":{"total":96636764160,"available":96577040384,"internally_reserved":0,"allocated":5246976,"data_stored":78493037,"data_compressed":3723298,"data_compressed_allocated":4902912,"data_compressed_original":78364672,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51548,"kb_used_data":6668,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94320292,"statfs":{"total":96636764160,"available":96583979008,"internally_reserved":0,"allocated":6828032,"data_stored":104182605,"data_compressed":4940955,"data_compressed_allocated":6504448,"data_compressed_original":104071168,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59464,"kb_used_data":6264,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94312376,"statfs":{"total":96636764160,"available":96575873024,"internally_reserved":0,"allocated":6414336,"data_stored":97170797,"data_compressed":4610061,"data_compressed_allocated":6070272,"data_compressed_original":97042432,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6434816,"data_stored":102957056,"data_compressed":4888117,"data_compressed_allocated":6434816,"data_compressed_original":102957056,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6885376,"data_stored":110166016,"data_compressed":5230371,"data_compressed_allocated":6885376,"data_compressed_original":110166016,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5210112,"data_stored":83361792,"data_compressed":3957786,"data_compressed_allocated":5210112,"data_compressed_original":83361792,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7733248,"data_stored":123731968,"data_compressed":5874540,"data_compressed_allocated":7733248,"data_compressed_original":123731968,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:22:26.338 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 25 16 5522 5506 13.7638 12.0625 0.0449359 0.0724928 2024-09-15T12:22:27.338 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 26 16 5747 5731 13.7752 14.0625 0.112952 0.0724811 2024-09-15T12:22:28.109 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:22:28.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:28.255+0000 7fd00a646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:28.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:28.264+0000 7fd00a646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:28.338 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 27 16 5957 5941 13.7511 13.125 0.0727113 0.0726133 2024-09-15T12:22:29.338 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 28 16 6176 6160 13.7488 13.6875 0.0839816 0.0726532 2024-09-15T12:22:30.338 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 29 16 6389 6373 13.7337 13.3125 0.0683595 0.072682 2024-09-15T12:22:30.689 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:22:30.809 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:22:30.809 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:22:30.810 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:22:30.810 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:22:30.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:30.863+0000 7f108b05c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:30.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:30.880+0000 7f108b05c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:30.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:30.976+0000 7f7c30d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:30.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:30.993+0000 7f7c30d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:31.196 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:22:31.197 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:22:31.197 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:22:31.197 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:22:31.197 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:22:31.197 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:22:31.197 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:22:31.197 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:22:31.197 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:22:31.197 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:22:31.197 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:22:31.197 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:22:31.202 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:22:31.202 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:22:31.203 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:22:31.338 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 30 16 6597 6581 13.7092 13 0.0748959 0.0727907 2024-09-15T12:22:31.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:31.376+0000 7f3945791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:31.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:31.409+0000 7f3945791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:31.555 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:22:31.555 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:22:31.555 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:22:31.555 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:22:31.555 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:22:31.555 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:22:31.555 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:22:31.555 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:22:31.555 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:22:31.556 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:22:31.556 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:22:31.556 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:22:31.561 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:22:31.561 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:22:31.562 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:22:31.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:31.762+0000 7fdea2a57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:31.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:31.778+0000 7fdea2a57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:31.810 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:22:31.810 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:22:31.810 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:22:31.810 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:22:31.811 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:22:31.811 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:22:31.811 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:22:31.811 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:22:31.811 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:22:31.811 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:22:31.811 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:22:31.811 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:22:31.813 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:22:31.814 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:22:31.814 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:22:31.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:31.984+0000 7f9c048fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:31.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:31.998+0000 7f9c048fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:32.051 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:22:32.051 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:22:32.051 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:22:32.051 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:22:32.051 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:22:32.051 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:22:32.051 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:22:32.052 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:22:32.052 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:22:32.052 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:22:32.052 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:22:32.052 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:22:32.054 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:22:32.055 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:22:32.338 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 31 16 6809 6793 13.6944 13.25 0.152019 0.0729246 2024-09-15T12:22:33.338 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 32 16 7024 7008 13.6863 13.4375 0.0789478 0.0729734 2024-09-15T12:22:33.380 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:22:33.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:33.524+0000 7f0ae6e93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:33.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:33.534+0000 7f0ae6e93640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:34.338 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 33 16 7221 7205 13.6446 12.3125 0.0887148 0.0731881 2024-09-15T12:22:35.339 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 34 16 7434 7418 13.6348 13.3125 0.106084 0.0732485 2024-09-15T12:22:35.973 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:22:36.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:36.128+0000 7f495e391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:36.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:36.139+0000 7f495e391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:36.339 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 35 16 7643 7627 13.6184 13.0625 0.0632101 0.0733286 2024-09-15T12:22:37.055 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:22:37.056 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-15T12:22:37.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:37.219+0000 7f1d0b391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:37.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:37.239+0000 7f1d0b391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:37.339 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 36 16 7853 7837 13.6047 13.125 0.0795247 0.073369 2024-09-15T12:22:38.247 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.0 to 1 (10000) 2024-09-15T12:22:38.268 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-15T12:22:38.339 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 37 15 8056 8041 13.5816 12.75 0.109671 0.0735065 2024-09-15T12:22:38.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:38.414+0000 7f98a5191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:38.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:38.431+0000 7f98a5191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:38.865 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:22:39.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:39.034+0000 7ff52aabd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:39.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:39.046+0000 7ff52aabd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:39.248 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.1 to 1 (10000) 2024-09-15T12:22:39.270 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-15T12:22:39.339 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 38 16 8259 8243 13.5564 12.625 0.168635 0.0736666 2024-09-15T12:22:39.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:39.431+0000 7fd72b951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:39.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:39.453+0000 7fd72b951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:40.258 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.2 to 1 (10000) 2024-09-15T12:22:40.281 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-15T12:22:40.339 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 39 16 8458 8442 13.5276 12.4375 0.108928 0.0738189 2024-09-15T12:22:40.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:40.451+0000 7f673d751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:40.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:40.469+0000 7f673d751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:41.262 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.3 to 1 (10000) 2024-09-15T12:22:41.282 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-15T12:22:41.282 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:22:41.339 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:2024-09-15T12:22:41.339079+0000 min lat: 0.0169163 max lat: 0.194581 avg lat: 0.0740504 2024-09-15T12:22:41.339 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-15T12:22:41.339 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 40 16 8647 8631 13.4847 11.8125 0.105189 0.0740504 2024-09-15T12:22:41.407 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:22:41.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:41.444+0000 7f3a90b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:41.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:41.460+0000 7f3a90b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:41.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:41.574+0000 7f574cf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:41.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:41.586+0000 7f574cf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:41.804 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:22:41.806 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:22:41.829 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-09-15T12:22:41.749967+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":533594675,"num_objects":8137,"num_object_clones":0,"num_object_copies":24411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8214,"num_write_kb":521620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8188,"ondisk_log_size":8188,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":282680,"kb_used_data":82352,"kb_used_omap":0,"kb_used_meta":200256,"kb_avail":377204680,"statfs":{"total":386547056640,"available":386257592320,"internally_reserved":0,"allocated":84328448,"data_stored":1326984448,"data_compressed":62992734,"data_compressed_allocated":82919424,"data_compressed_original":1326465024,"omap_allocated":0,"internal_metadata":205062144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":396951552,"num_objects":6057,"num_object_clones":0,"num_object_copies":18171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6057,"num_write_kb":387648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000777"},"pg_stats":[{"pgid":"4.f","version":"41'543","reported_seq":576,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.587715+0000","last_change":"2024-09-15T12:22:00.377854+0000","last_active":"2024-09-15T12:22:40.587715+0000","last_peered":"2024-09-15T12:22:40.587715+0000","last_clean":"2024-09-15T12:22:40.587715+0000","last_became_active":"2024-09-15T12:22:00.359790+0000","last_became_peered":"2024-09-15T12:22:00.359790+0000","last_unstale":"2024-09-15T12:22:40.587715+0000","last_undegraded":"2024-09-15T12:22:40.587715+0000","last_fullsized":"2024-09-15T12:22:40.587715+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35586048,"num_objects":543,"num_object_clones":0,"num_object_copies":1629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":543,"num_write_kb":34752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"41'542","reported_seq":575,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.596341+0000","last_change":"2024-09-15T12:22:00.383291+0000","last_active":"2024-09-15T12:22:40.596341+0000","last_peered":"2024-09-15T12:22:40.596341+0000","last_clean":"2024-09-15T12:22:40.596341+0000","last_became_active":"2024-09-15T12:22:00.376330+0000","last_became_peered":"2024-09-15T12:22:00.376330+0000","last_unstale":"2024-09-15T12:22:40.596341+0000","last_undegraded":"2024-09-15T12:22:40.596341+0000","last_fullsized":"2024-09-15T12:22:40.596341+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35520512,"num_objects":542,"num_object_clones":0,"num_object_copies":1626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":542,"num_write_kb":34688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"41'553","reported_seq":586,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.645107+0000","last_change":"2024-09-15T12:22:00.413467+0000","last_active":"2024-09-15T12:22:40.645107+0000","last_peered":"2024-09-15T12:22:40.645107+0000","last_clean":"2024-09-15T12:22:40.645107+0000","last_became_active":"2024-09-15T12:22:00.399293+0000","last_became_peered":"2024-09-15T12:22:00.399293+0000","last_unstale":"2024-09-15T12:22:40.645107+0000","last_undegraded":"2024-09-15T12:22:40.645107+0000","last_fullsized":"2024-09-15T12:22:40.645107+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"38'135","reported_seq":159,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:11.540954+0000","last_change":"2024-09-15T12:22:00.397700+0000","last_active":"2024-09-15T12:22:11.540954+0000","last_peered":"2024-09-15T12:22:11.540954+0000","last_clean":"2024-09-15T12:22:11.540954+0000","last_became_active":"2024-09-15T12:22:00.388314+0000","last_became_peered":"2024-09-15T12:22:00.388314+0000","last_unstale":"2024-09-15T12:22:11.540954+0000","last_undegraded":"2024-09-15T12:22:11.540954+0000","last_fullsized":"2024-09-15T12:22:11.540954+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"41'497","reported_seq":530,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.686178+0000","last_change":"2024-09-15T12:22:00.418610+0000","last_active":"2024-09-15T12:22:40.686178+0000","last_peered":"2024-09-15T12:22:40.686178+0000","last_clean":"2024-09-15T12:22:40.686178+0000","last_became_active":"2024-09-15T12:22:00.404352+0000","last_became_peered":"2024-09-15T12:22:00.404352+0000","last_unstale":"2024-09-15T12:22:40.686178+0000","last_undegraded":"2024-09-15T12:22:40.686178+0000","last_fullsized":"2024-09-15T12:22:40.686178+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32571392,"num_objects":497,"num_object_clones":0,"num_object_copies":1491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":497,"num_write_kb":31808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"41'516","reported_seq":549,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.699702+0000","last_change":"2024-09-15T12:22:00.408893+0000","last_active":"2024-09-15T12:22:40.699702+0000","last_peered":"2024-09-15T12:22:40.699702+0000","last_clean":"2024-09-15T12:22:40.699702+0000","last_became_active":"2024-09-15T12:22:00.399557+0000","last_became_peered":"2024-09-15T12:22:00.399557+0000","last_unstale":"2024-09-15T12:22:40.699702+0000","last_undegraded":"2024-09-15T12:22:40.699702+0000","last_fullsized":"2024-09-15T12:22:40.699702+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":516,"log_dups_size":0,"ondisk_log_size":516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33816576,"num_objects":516,"num_object_clones":0,"num_object_copies":1548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":516,"num_write_kb":33024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"41'556","reported_seq":589,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.553546+0000","last_change":"2024-09-15T12:22:00.458263+0000","last_active":"2024-09-15T12:22:40.553546+0000","last_peered":"2024-09-15T12:22:40.553546+0000","last_clean":"2024-09-15T12:22:40.553546+0000","last_became_active":"2024-09-15T12:22:00.446629+0000","last_became_peered":"2024-09-15T12:22:00.446629+0000","last_unstale":"2024-09-15T12:22:40.553546+0000","last_undegraded":"2024-09-15T12:22:40.553546+0000","last_fullsized":"2024-09-15T12:22:40.553546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36438016,"num_objects":556,"num_object_clones":0,"num_object_copies":1668,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":556,"num_write_kb":35584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"41'545","reported_seq":578,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.586804+0000","last_change":"2024-09-15T12:22:00.432607+0000","last_active":"2024-09-15T12:22:40.586804+0000","last_peered":"2024-09-15T12:22:40.586804+0000","last_clean":"2024-09-15T12:22:40.586804+0000","last_became_active":"2024-09-15T12:22:00.422177+0000","last_became_peered":"2024-09-15T12:22:00.422177+0000","last_unstale":"2024-09-15T12:22:40.586804+0000","last_undegraded":"2024-09-15T12:22:40.586804+0000","last_fullsized":"2024-09-15T12:22:40.586804+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35717120,"num_objects":545,"num_object_clones":0,"num_object_copies":1635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":545,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"41'528","reported_seq":561,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.651148+0000","last_change":"2024-09-15T12:22:00.420197+0000","last_active":"2024-09-15T12:22:40.651148+0000","last_peered":"2024-09-15T12:22:40.651148+0000","last_clean":"2024-09-15T12:22:40.651148+0000","last_became_active":"2024-09-15T12:22:00.406666+0000","last_became_peered":"2024-09-15T12:22:00.406666+0000","last_unstale":"2024-09-15T12:22:40.651148+0000","last_undegraded":"2024-09-15T12:22:40.651148+0000","last_fullsized":"2024-09-15T12:22:40.651148+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34603008,"num_objects":528,"num_object_clones":0,"num_object_copies":1584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":33792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":157,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.329852+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:22:08.329852+0000","last_peered":"2024-09-15T12:22:08.329852+0000","last_clean":"2024-09-15T12:22:08.329852+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:22:08.329852+0000","last_undegraded":"2024-09-15T12:22:08.329852+0000","last_fullsized":"2024-09-15T12:22:08.329852+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":95,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.313486+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:22:40.313486+0000","last_peered":"2024-09-15T12:22:40.313486+0000","last_clean":"2024-09-15T12:22:40.313486+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:22:40.313486+0000","last_undegraded":"2024-09-15T12:22:40.313486+0000","last_fullsized":"2024-09-15T12:22:40.313486+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"41'552","reported_seq":585,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.626033+0000","last_change":"2024-09-15T12:22:00.381165+0000","last_active":"2024-09-15T12:22:40.626033+0000","last_peered":"2024-09-15T12:22:40.626033+0000","last_clean":"2024-09-15T12:22:40.626033+0000","last_became_active":"2024-09-15T12:22:00.374145+0000","last_became_peered":"2024-09-15T12:22:00.374145+0000","last_unstale":"2024-09-15T12:22:40.626033+0000","last_undegraded":"2024-09-15T12:22:40.626033+0000","last_fullsized":"2024-09-15T12:22:40.626033+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36175872,"num_objects":552,"num_object_clones":0,"num_object_copies":1656,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":35328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":94,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.318562+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:22:40.318562+0000","last_peered":"2024-09-15T12:22:40.318562+0000","last_clean":"2024-09-15T12:22:40.318562+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:22:40.318562+0000","last_undegraded":"2024-09-15T12:22:40.318562+0000","last_fullsized":"2024-09-15T12:22:40.318562+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"41'496","reported_seq":529,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.710009+0000","last_change":"2024-09-15T12:22:00.405131+0000","last_active":"2024-09-15T12:22:40.710009+0000","last_peered":"2024-09-15T12:22:40.710009+0000","last_clean":"2024-09-15T12:22:40.710009+0000","last_became_active":"2024-09-15T12:22:00.398288+0000","last_became_peered":"2024-09-15T12:22:00.398288+0000","last_unstale":"2024-09-15T12:22:40.710009+0000","last_undegraded":"2024-09-15T12:22:40.710009+0000","last_fullsized":"2024-09-15T12:22:40.710009+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32505856,"num_objects":496,"num_object_clones":0,"num_object_copies":1488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":94,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.294473+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:22:40.294473+0000","last_peered":"2024-09-15T12:22:40.294473+0000","last_clean":"2024-09-15T12:22:40.294473+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:22:40.294473+0000","last_undegraded":"2024-09-15T12:22:40.294473+0000","last_fullsized":"2024-09-15T12:22:40.294473+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"41'540","reported_seq":573,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.738388+0000","last_change":"2024-09-15T12:22:00.390143+0000","last_active":"2024-09-15T12:22:40.738388+0000","last_peered":"2024-09-15T12:22:40.738388+0000","last_clean":"2024-09-15T12:22:40.738388+0000","last_became_active":"2024-09-15T12:22:00.370049+0000","last_became_peered":"2024-09-15T12:22:00.370049+0000","last_unstale":"2024-09-15T12:22:40.738388+0000","last_undegraded":"2024-09-15T12:22:40.738388+0000","last_fullsized":"2024-09-15T12:22:40.738388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35389440,"num_objects":540,"num_object_clones":0,"num_object_copies":1620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":540,"num_write_kb":34560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":96,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.317662+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:22:40.317662+0000","last_peered":"2024-09-15T12:22:40.317662+0000","last_clean":"2024-09-15T12:22:40.317662+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:22:40.317662+0000","last_undegraded":"2024-09-15T12:22:40.317662+0000","last_fullsized":"2024-09-15T12:22:40.317662+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"41'515","reported_seq":548,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.713666+0000","last_change":"2024-09-15T12:22:00.450159+0000","last_active":"2024-09-15T12:22:40.713666+0000","last_peered":"2024-09-15T12:22:40.713666+0000","last_clean":"2024-09-15T12:22:40.713666+0000","last_became_active":"2024-09-15T12:22:00.437056+0000","last_became_peered":"2024-09-15T12:22:00.437056+0000","last_unstale":"2024-09-15T12:22:40.713666+0000","last_undegraded":"2024-09-15T12:22:40.713666+0000","last_fullsized":"2024-09-15T12:22:40.713666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33751040,"num_objects":515,"num_object_clones":0,"num_object_copies":1545,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":515,"num_write_kb":32960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":94,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.296473+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:22:40.296473+0000","last_peered":"2024-09-15T12:22:40.296473+0000","last_clean":"2024-09-15T12:22:40.296473+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:22:40.296473+0000","last_undegraded":"2024-09-15T12:22:40.296473+0000","last_fullsized":"2024-09-15T12:22:40.296473+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"41'526","reported_seq":559,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.635508+0000","last_change":"2024-09-15T12:22:00.364579+0000","last_active":"2024-09-15T12:22:40.635508+0000","last_peered":"2024-09-15T12:22:40.635508+0000","last_clean":"2024-09-15T12:22:40.635508+0000","last_became_active":"2024-09-15T12:22:00.353614+0000","last_became_peered":"2024-09-15T12:22:00.353614+0000","last_unstale":"2024-09-15T12:22:40.635508+0000","last_undegraded":"2024-09-15T12:22:40.635508+0000","last_fullsized":"2024-09-15T12:22:40.635508+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34471936,"num_objects":526,"num_object_clones":0,"num_object_copies":1578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":526,"num_write_kb":33664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.334782+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:22:08.334782+0000","last_peered":"2024-09-15T12:22:08.334782+0000","last_clean":"2024-09-15T12:22:08.334782+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:22:08.334782+0000","last_undegraded":"2024-09-15T12:22:08.334782+0000","last_fullsized":"2024-09-15T12:22:08.334782+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"41'529","reported_seq":562,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.690404+0000","last_change":"2024-09-15T12:22:00.384094+0000","last_active":"2024-09-15T12:22:40.690404+0000","last_peered":"2024-09-15T12:22:40.690404+0000","last_clean":"2024-09-15T12:22:40.690404+0000","last_became_active":"2024-09-15T12:22:00.377789+0000","last_became_peered":"2024-09-15T12:22:00.377789+0000","last_unstale":"2024-09-15T12:22:40.690404+0000","last_undegraded":"2024-09-15T12:22:40.690404+0000","last_fullsized":"2024-09-15T12:22:40.690404+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":33856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":94,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.298927+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:22:40.298927+0000","last_peered":"2024-09-15T12:22:40.298927+0000","last_clean":"2024-09-15T12:22:40.298927+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:22:40.298927+0000","last_undegraded":"2024-09-15T12:22:40.298927+0000","last_fullsized":"2024-09-15T12:22:40.298927+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"41'560","reported_seq":593,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.358895+0000","last_change":"2024-09-15T12:22:00.394121+0000","last_active":"2024-09-15T12:22:40.358895+0000","last_peered":"2024-09-15T12:22:40.358895+0000","last_clean":"2024-09-15T12:22:40.358895+0000","last_became_active":"2024-09-15T12:22:00.388183+0000","last_became_peered":"2024-09-15T12:22:00.388183+0000","last_unstale":"2024-09-15T12:22:40.358895+0000","last_undegraded":"2024-09-15T12:22:40.358895+0000","last_fullsized":"2024-09-15T12:22:40.358895+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36700160,"num_objects":560,"num_object_clones":0,"num_object_copies":1680,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":35840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":94,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.304824+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:22:40.304824+0000","last_peered":"2024-09-15T12:22:40.304824+0000","last_clean":"2024-09-15T12:22:40.304824+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:22:40.304824+0000","last_undegraded":"2024-09-15T12:22:40.304824+0000","last_fullsized":"2024-09-15T12:22:40.304824+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":533004288,"num_objects":8133,"num_object_clones":0,"num_object_copies":24399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8133,"num_write_kb":520512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":84058112,"data_stored":1344929792,"data_compressed":63861134,"data_compressed_allocated":84058112,"data_compressed_original":1344929792,"omap_allocated":0,"internal_metadata":0},"log_size":8133,"ondisk_log_size":8133,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52376,"kb_used_data":7496,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94319464,"statfs":{"total":96636764160,"available":96583131136,"internally_reserved":0,"allocated":7675904,"data_stored":117421402,"data_compressed":5571588,"data_compressed_allocated":7335936,"data_compressed_original":117293056,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74444,"kb_used_data":21240,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94297396,"statfs":{"total":96636764160,"available":96560533504,"internally_reserved":0,"allocated":21749760,"data_stored":342281983,"data_compressed":16249098,"data_compressed_allocated":21389312,"data_compressed_original":342147072,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":76864,"kb_used_data":27824,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94294976,"statfs":{"total":96636764160,"available":96558055424,"internally_reserved":0,"allocated":28491776,"data_stored":450419112,"data_compressed":21381651,"data_compressed_allocated":28143616,"data_compressed_original":450297856,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":78996,"kb_used_data":25792,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94292844,"statfs":{"total":96636764160,"available":96555872256,"internally_reserved":0,"allocated":26411008,"data_stored":416861951,"data_compressed":19790397,"data_compressed_allocated":26050560,"data_compressed_original":416727040,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26300416,"data_stored":420806656,"data_compressed":19981317,"data_compressed_allocated":26300416,"data_compressed_original":420806656,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28401664,"data_stored":454426624,"data_compressed":21577707,"data_compressed_allocated":28401664,"data_compressed_original":454426624,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21622784,"data_stored":345964544,"data_compressed":16427570,"data_compressed_allocated":21622784,"data_compressed_original":345964544,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7733248,"data_stored":123731968,"data_compressed":5874540,"data_compressed_allocated":7733248,"data_compressed_original":123731968,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:22:41.831 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:22:42.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:41.993+0000 7f5e29191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:42.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:42.008+0000 7f5e29191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:42.324 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:22:42.325 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:22:42.339 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 41 16 8835 8819 13.4424 11.75 0.0465077 0.0742841 2024-09-15T12:22:42.348 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-09-15T12:22:41.749967+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":533594675,"num_objects":8137,"num_object_clones":0,"num_object_copies":24411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8214,"num_write_kb":521620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8188,"ondisk_log_size":8188,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":282680,"kb_used_data":82352,"kb_used_omap":0,"kb_used_meta":200256,"kb_avail":377204680,"statfs":{"total":386547056640,"available":386257592320,"internally_reserved":0,"allocated":84328448,"data_stored":1326984448,"data_compressed":62992734,"data_compressed_allocated":82919424,"data_compressed_original":1326465024,"omap_allocated":0,"internal_metadata":205062144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":396951552,"num_objects":6057,"num_object_clones":0,"num_object_copies":18171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6057,"num_write_kb":387648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000777"},"pg_stats":[{"pgid":"4.f","version":"41'543","reported_seq":576,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.587715+0000","last_change":"2024-09-15T12:22:00.377854+0000","last_active":"2024-09-15T12:22:40.587715+0000","last_peered":"2024-09-15T12:22:40.587715+0000","last_clean":"2024-09-15T12:22:40.587715+0000","last_became_active":"2024-09-15T12:22:00.359790+0000","last_became_peered":"2024-09-15T12:22:00.359790+0000","last_unstale":"2024-09-15T12:22:40.587715+0000","last_undegraded":"2024-09-15T12:22:40.587715+0000","last_fullsized":"2024-09-15T12:22:40.587715+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35586048,"num_objects":543,"num_object_clones":0,"num_object_copies":1629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":543,"num_write_kb":34752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"41'542","reported_seq":575,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.596341+0000","last_change":"2024-09-15T12:22:00.383291+0000","last_active":"2024-09-15T12:22:40.596341+0000","last_peered":"2024-09-15T12:22:40.596341+0000","last_clean":"2024-09-15T12:22:40.596341+0000","last_became_active":"2024-09-15T12:22:00.376330+0000","last_became_peered":"2024-09-15T12:22:00.376330+0000","last_unstale":"2024-09-15T12:22:40.596341+0000","last_undegraded":"2024-09-15T12:22:40.596341+0000","last_fullsized":"2024-09-15T12:22:40.596341+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35520512,"num_objects":542,"num_object_clones":0,"num_object_copies":1626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":542,"num_write_kb":34688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"41'553","reported_seq":586,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.645107+0000","last_change":"2024-09-15T12:22:00.413467+0000","last_active":"2024-09-15T12:22:40.645107+0000","last_peered":"2024-09-15T12:22:40.645107+0000","last_clean":"2024-09-15T12:22:40.645107+0000","last_became_active":"2024-09-15T12:22:00.399293+0000","last_became_peered":"2024-09-15T12:22:00.399293+0000","last_unstale":"2024-09-15T12:22:40.645107+0000","last_undegraded":"2024-09-15T12:22:40.645107+0000","last_fullsized":"2024-09-15T12:22:40.645107+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"38'135","reported_seq":159,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:11.540954+0000","last_change":"2024-09-15T12:22:00.397700+0000","last_active":"2024-09-15T12:22:11.540954+0000","last_peered":"2024-09-15T12:22:11.540954+0000","last_clean":"2024-09-15T12:22:11.540954+0000","last_became_active":"2024-09-15T12:22:00.388314+0000","last_became_peered":"2024-09-15T12:22:00.388314+0000","last_unstale":"2024-09-15T12:22:11.540954+0000","last_undegraded":"2024-09-15T12:22:11.540954+0000","last_fullsized":"2024-09-15T12:22:11.540954+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"41'497","reported_seq":530,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.686178+0000","last_change":"2024-09-15T12:22:00.418610+0000","last_active":"2024-09-15T12:22:40.686178+0000","last_peered":"2024-09-15T12:22:40.686178+0000","last_clean":"2024-09-15T12:22:40.686178+0000","last_became_active":"2024-09-15T12:22:00.404352+0000","last_became_peered":"2024-09-15T12:22:00.404352+0000","last_unstale":"2024-09-15T12:22:40.686178+0000","last_undegraded":"2024-09-15T12:22:40.686178+0000","last_fullsized":"2024-09-15T12:22:40.686178+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32571392,"num_objects":497,"num_object_clones":0,"num_object_copies":1491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":497,"num_write_kb":31808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"41'516","reported_seq":549,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.699702+0000","last_change":"2024-09-15T12:22:00.408893+0000","last_active":"2024-09-15T12:22:40.699702+0000","last_peered":"2024-09-15T12:22:40.699702+0000","last_clean":"2024-09-15T12:22:40.699702+0000","last_became_active":"2024-09-15T12:22:00.399557+0000","last_became_peered":"2024-09-15T12:22:00.399557+0000","last_unstale":"2024-09-15T12:22:40.699702+0000","last_undegraded":"2024-09-15T12:22:40.699702+0000","last_fullsized":"2024-09-15T12:22:40.699702+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":516,"log_dups_size":0,"ondisk_log_size":516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33816576,"num_objects":516,"num_object_clones":0,"num_object_copies":1548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":516,"num_write_kb":33024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"41'556","reported_seq":589,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.553546+0000","last_change":"2024-09-15T12:22:00.458263+0000","last_active":"2024-09-15T12:22:40.553546+0000","last_peered":"2024-09-15T12:22:40.553546+0000","last_clean":"2024-09-15T12:22:40.553546+0000","last_became_active":"2024-09-15T12:22:00.446629+0000","last_became_peered":"2024-09-15T12:22:00.446629+0000","last_unstale":"2024-09-15T12:22:40.553546+0000","last_undegraded":"2024-09-15T12:22:40.553546+0000","last_fullsized":"2024-09-15T12:22:40.553546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36438016,"num_objects":556,"num_object_clones":0,"num_object_copies":1668,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":556,"num_write_kb":35584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"41'545","reported_seq":578,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.586804+0000","last_change":"2024-09-15T12:22:00.432607+0000","last_active":"2024-09-15T12:22:40.586804+0000","last_peered":"2024-09-15T12:22:40.586804+0000","last_clean":"2024-09-15T12:22:40.586804+0000","last_became_active":"2024-09-15T12:22:00.422177+0000","last_became_peered":"2024-09-15T12:22:00.422177+0000","last_unstale":"2024-09-15T12:22:40.586804+0000","last_undegraded":"2024-09-15T12:22:40.586804+0000","last_fullsized":"2024-09-15T12:22:40.586804+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35717120,"num_objects":545,"num_object_clones":0,"num_object_copies":1635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":545,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"41'528","reported_seq":561,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.651148+0000","last_change":"2024-09-15T12:22:00.420197+0000","last_active":"2024-09-15T12:22:40.651148+0000","last_peered":"2024-09-15T12:22:40.651148+0000","last_clean":"2024-09-15T12:22:40.651148+0000","last_became_active":"2024-09-15T12:22:00.406666+0000","last_became_peered":"2024-09-15T12:22:00.406666+0000","last_unstale":"2024-09-15T12:22:40.651148+0000","last_undegraded":"2024-09-15T12:22:40.651148+0000","last_fullsized":"2024-09-15T12:22:40.651148+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34603008,"num_objects":528,"num_object_clones":0,"num_object_copies":1584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":33792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":157,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.329852+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:22:08.329852+0000","last_peered":"2024-09-15T12:22:08.329852+0000","last_clean":"2024-09-15T12:22:08.329852+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:22:08.329852+0000","last_undegraded":"2024-09-15T12:22:08.329852+0000","last_fullsized":"2024-09-15T12:22:08.329852+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":95,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.313486+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:22:40.313486+0000","last_peered":"2024-09-15T12:22:40.313486+0000","last_clean":"2024-09-15T12:22:40.313486+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:22:40.313486+0000","last_undegraded":"2024-09-15T12:22:40.313486+0000","last_fullsized":"2024-09-15T12:22:40.313486+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"41'552","reported_seq":585,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.626033+0000","last_change":"2024-09-15T12:22:00.381165+0000","last_active":"2024-09-15T12:22:40.626033+0000","last_peered":"2024-09-15T12:22:40.626033+0000","last_clean":"2024-09-15T12:22:40.626033+0000","last_became_active":"2024-09-15T12:22:00.374145+0000","last_became_peered":"2024-09-15T12:22:00.374145+0000","last_unstale":"2024-09-15T12:22:40.626033+0000","last_undegraded":"2024-09-15T12:22:40.626033+0000","last_fullsized":"2024-09-15T12:22:40.626033+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36175872,"num_objects":552,"num_object_clones":0,"num_object_copies":1656,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":35328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":94,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.318562+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:22:40.318562+0000","last_peered":"2024-09-15T12:22:40.318562+0000","last_clean":"2024-09-15T12:22:40.318562+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:22:40.318562+0000","last_undegraded":"2024-09-15T12:22:40.318562+0000","last_fullsized":"2024-09-15T12:22:40.318562+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"41'496","reported_seq":529,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.710009+0000","last_change":"2024-09-15T12:22:00.405131+0000","last_active":"2024-09-15T12:22:40.710009+0000","last_peered":"2024-09-15T12:22:40.710009+0000","last_clean":"2024-09-15T12:22:40.710009+0000","last_became_active":"2024-09-15T12:22:00.398288+0000","last_became_peered":"2024-09-15T12:22:00.398288+0000","last_unstale":"2024-09-15T12:22:40.710009+0000","last_undegraded":"2024-09-15T12:22:40.710009+0000","last_fullsized":"2024-09-15T12:22:40.710009+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32505856,"num_objects":496,"num_object_clones":0,"num_object_copies":1488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":94,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.294473+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:22:40.294473+0000","last_peered":"2024-09-15T12:22:40.294473+0000","last_clean":"2024-09-15T12:22:40.294473+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:22:40.294473+0000","last_undegraded":"2024-09-15T12:22:40.294473+0000","last_fullsized":"2024-09-15T12:22:40.294473+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"41'540","reported_seq":573,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.738388+0000","last_change":"2024-09-15T12:22:00.390143+0000","last_active":"2024-09-15T12:22:40.738388+0000","last_peered":"2024-09-15T12:22:40.738388+0000","last_clean":"2024-09-15T12:22:40.738388+0000","last_became_active":"2024-09-15T12:22:00.370049+0000","last_became_peered":"2024-09-15T12:22:00.370049+0000","last_unstale":"2024-09-15T12:22:40.738388+0000","last_undegraded":"2024-09-15T12:22:40.738388+0000","last_fullsized":"2024-09-15T12:22:40.738388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35389440,"num_objects":540,"num_object_clones":0,"num_object_copies":1620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":540,"num_write_kb":34560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":96,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.317662+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:22:40.317662+0000","last_peered":"2024-09-15T12:22:40.317662+0000","last_clean":"2024-09-15T12:22:40.317662+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:22:40.317662+0000","last_undegraded":"2024-09-15T12:22:40.317662+0000","last_fullsized":"2024-09-15T12:22:40.317662+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"41'515","reported_seq":548,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.713666+0000","last_change":"2024-09-15T12:22:00.450159+0000","last_active":"2024-09-15T12:22:40.713666+0000","last_peered":"2024-09-15T12:22:40.713666+0000","last_clean":"2024-09-15T12:22:40.713666+0000","last_became_active":"2024-09-15T12:22:00.437056+0000","last_became_peered":"2024-09-15T12:22:00.437056+0000","last_unstale":"2024-09-15T12:22:40.713666+0000","last_undegraded":"2024-09-15T12:22:40.713666+0000","last_fullsized":"2024-09-15T12:22:40.713666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33751040,"num_objects":515,"num_object_clones":0,"num_object_copies":1545,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":515,"num_write_kb":32960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":94,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.296473+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:22:40.296473+0000","last_peered":"2024-09-15T12:22:40.296473+0000","last_clean":"2024-09-15T12:22:40.296473+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:22:40.296473+0000","last_undegraded":"2024-09-15T12:22:40.296473+0000","last_fullsized":"2024-09-15T12:22:40.296473+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"41'526","reported_seq":559,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.635508+0000","last_change":"2024-09-15T12:22:00.364579+0000","last_active":"2024-09-15T12:22:40.635508+0000","last_peered":"2024-09-15T12:22:40.635508+0000","last_clean":"2024-09-15T12:22:40.635508+0000","last_became_active":"2024-09-15T12:22:00.353614+0000","last_became_peered":"2024-09-15T12:22:00.353614+0000","last_unstale":"2024-09-15T12:22:40.635508+0000","last_undegraded":"2024-09-15T12:22:40.635508+0000","last_fullsized":"2024-09-15T12:22:40.635508+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34471936,"num_objects":526,"num_object_clones":0,"num_object_copies":1578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":526,"num_write_kb":33664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.334782+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:22:08.334782+0000","last_peered":"2024-09-15T12:22:08.334782+0000","last_clean":"2024-09-15T12:22:08.334782+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:22:08.334782+0000","last_undegraded":"2024-09-15T12:22:08.334782+0000","last_fullsized":"2024-09-15T12:22:08.334782+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"41'529","reported_seq":562,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.690404+0000","last_change":"2024-09-15T12:22:00.384094+0000","last_active":"2024-09-15T12:22:40.690404+0000","last_peered":"2024-09-15T12:22:40.690404+0000","last_clean":"2024-09-15T12:22:40.690404+0000","last_became_active":"2024-09-15T12:22:00.377789+0000","last_became_peered":"2024-09-15T12:22:00.377789+0000","last_unstale":"2024-09-15T12:22:40.690404+0000","last_undegraded":"2024-09-15T12:22:40.690404+0000","last_fullsized":"2024-09-15T12:22:40.690404+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":33856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":94,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.298927+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:22:40.298927+0000","last_peered":"2024-09-15T12:22:40.298927+0000","last_clean":"2024-09-15T12:22:40.298927+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:22:40.298927+0000","last_undegraded":"2024-09-15T12:22:40.298927+0000","last_fullsized":"2024-09-15T12:22:40.298927+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"41'560","reported_seq":593,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.358895+0000","last_change":"2024-09-15T12:22:00.394121+0000","last_active":"2024-09-15T12:22:40.358895+0000","last_peered":"2024-09-15T12:22:40.358895+0000","last_clean":"2024-09-15T12:22:40.358895+0000","last_became_active":"2024-09-15T12:22:00.388183+0000","last_became_peered":"2024-09-15T12:22:00.388183+0000","last_unstale":"2024-09-15T12:22:40.358895+0000","last_undegraded":"2024-09-15T12:22:40.358895+0000","last_fullsized":"2024-09-15T12:22:40.358895+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36700160,"num_objects":560,"num_object_clones":0,"num_object_copies":1680,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":35840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":94,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.304824+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:22:40.304824+0000","last_peered":"2024-09-15T12:22:40.304824+0000","last_clean":"2024-09-15T12:22:40.304824+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:22:40.304824+0000","last_undegraded":"2024-09-15T12:22:40.304824+0000","last_fullsized":"2024-09-15T12:22:40.304824+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":533004288,"num_objects":8133,"num_object_clones":0,"num_object_copies":24399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8133,"num_write_kb":520512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":84058112,"data_stored":1344929792,"data_compressed":63861134,"data_compressed_allocated":84058112,"data_compressed_original":1344929792,"omap_allocated":0,"internal_metadata":0},"log_size":8133,"ondisk_log_size":8133,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52376,"kb_used_data":7496,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94319464,"statfs":{"total":96636764160,"available":96583131136,"internally_reserved":0,"allocated":7675904,"data_stored":117421402,"data_compressed":5571588,"data_compressed_allocated":7335936,"data_compressed_original":117293056,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74444,"kb_used_data":21240,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94297396,"statfs":{"total":96636764160,"available":96560533504,"internally_reserved":0,"allocated":21749760,"data_stored":342281983,"data_compressed":16249098,"data_compressed_allocated":21389312,"data_compressed_original":342147072,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":76864,"kb_used_data":27824,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94294976,"statfs":{"total":96636764160,"available":96558055424,"internally_reserved":0,"allocated":28491776,"data_stored":450419112,"data_compressed":21381651,"data_compressed_allocated":28143616,"data_compressed_original":450297856,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":78996,"kb_used_data":25792,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94292844,"statfs":{"total":96636764160,"available":96555872256,"internally_reserved":0,"allocated":26411008,"data_stored":416861951,"data_compressed":19790397,"data_compressed_allocated":26050560,"data_compressed_original":416727040,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26300416,"data_stored":420806656,"data_compressed":19981317,"data_compressed_allocated":26300416,"data_compressed_original":420806656,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28401664,"data_stored":454426624,"data_compressed":21577707,"data_compressed_allocated":28401664,"data_compressed_original":454426624,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21622784,"data_stored":345964544,"data_compressed":16427570,"data_compressed_allocated":21622784,"data_compressed_original":345964544,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7733248,"data_stored":123731968,"data_compressed":5874540,"data_compressed_allocated":7733248,"data_compressed_original":123731968,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:22:42.349 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-15T12:22:42.349 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:22:42.350 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:22:42.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:42.508+0000 7f9fab791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:42.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:42.522+0000 7f9fab791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:42.893 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:22:42.893 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:22:42.915 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-09-15T12:22:41.749967+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":533594675,"num_objects":8137,"num_object_clones":0,"num_object_copies":24411,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8214,"num_write_kb":521620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8188,"ondisk_log_size":8188,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":282680,"kb_used_data":82352,"kb_used_omap":0,"kb_used_meta":200256,"kb_avail":377204680,"statfs":{"total":386547056640,"available":386257592320,"internally_reserved":0,"allocated":84328448,"data_stored":1326984448,"data_compressed":62992734,"data_compressed_allocated":82919424,"data_compressed_original":1326465024,"omap_allocated":0,"internal_metadata":205062144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":396951552,"num_objects":6057,"num_object_clones":0,"num_object_copies":18171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6057,"num_write_kb":387648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000777"},"pg_stats":[{"pgid":"4.f","version":"41'543","reported_seq":576,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.587715+0000","last_change":"2024-09-15T12:22:00.377854+0000","last_active":"2024-09-15T12:22:40.587715+0000","last_peered":"2024-09-15T12:22:40.587715+0000","last_clean":"2024-09-15T12:22:40.587715+0000","last_became_active":"2024-09-15T12:22:00.359790+0000","last_became_peered":"2024-09-15T12:22:00.359790+0000","last_unstale":"2024-09-15T12:22:40.587715+0000","last_undegraded":"2024-09-15T12:22:40.587715+0000","last_fullsized":"2024-09-15T12:22:40.587715+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35586048,"num_objects":543,"num_object_clones":0,"num_object_copies":1629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":543,"num_write_kb":34752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"41'542","reported_seq":575,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.596341+0000","last_change":"2024-09-15T12:22:00.383291+0000","last_active":"2024-09-15T12:22:40.596341+0000","last_peered":"2024-09-15T12:22:40.596341+0000","last_clean":"2024-09-15T12:22:40.596341+0000","last_became_active":"2024-09-15T12:22:00.376330+0000","last_became_peered":"2024-09-15T12:22:00.376330+0000","last_unstale":"2024-09-15T12:22:40.596341+0000","last_undegraded":"2024-09-15T12:22:40.596341+0000","last_fullsized":"2024-09-15T12:22:40.596341+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35520512,"num_objects":542,"num_object_clones":0,"num_object_copies":1626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":542,"num_write_kb":34688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"41'553","reported_seq":586,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.645107+0000","last_change":"2024-09-15T12:22:00.413467+0000","last_active":"2024-09-15T12:22:40.645107+0000","last_peered":"2024-09-15T12:22:40.645107+0000","last_clean":"2024-09-15T12:22:40.645107+0000","last_became_active":"2024-09-15T12:22:00.399293+0000","last_became_peered":"2024-09-15T12:22:00.399293+0000","last_unstale":"2024-09-15T12:22:40.645107+0000","last_undegraded":"2024-09-15T12:22:40.645107+0000","last_fullsized":"2024-09-15T12:22:40.645107+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"38'135","reported_seq":159,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:11.540954+0000","last_change":"2024-09-15T12:22:00.397700+0000","last_active":"2024-09-15T12:22:11.540954+0000","last_peered":"2024-09-15T12:22:11.540954+0000","last_clean":"2024-09-15T12:22:11.540954+0000","last_became_active":"2024-09-15T12:22:00.388314+0000","last_became_peered":"2024-09-15T12:22:00.388314+0000","last_unstale":"2024-09-15T12:22:11.540954+0000","last_undegraded":"2024-09-15T12:22:11.540954+0000","last_fullsized":"2024-09-15T12:22:11.540954+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"41'497","reported_seq":530,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.686178+0000","last_change":"2024-09-15T12:22:00.418610+0000","last_active":"2024-09-15T12:22:40.686178+0000","last_peered":"2024-09-15T12:22:40.686178+0000","last_clean":"2024-09-15T12:22:40.686178+0000","last_became_active":"2024-09-15T12:22:00.404352+0000","last_became_peered":"2024-09-15T12:22:00.404352+0000","last_unstale":"2024-09-15T12:22:40.686178+0000","last_undegraded":"2024-09-15T12:22:40.686178+0000","last_fullsized":"2024-09-15T12:22:40.686178+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32571392,"num_objects":497,"num_object_clones":0,"num_object_copies":1491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":497,"num_write_kb":31808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"41'516","reported_seq":549,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.699702+0000","last_change":"2024-09-15T12:22:00.408893+0000","last_active":"2024-09-15T12:22:40.699702+0000","last_peered":"2024-09-15T12:22:40.699702+0000","last_clean":"2024-09-15T12:22:40.699702+0000","last_became_active":"2024-09-15T12:22:00.399557+0000","last_became_peered":"2024-09-15T12:22:00.399557+0000","last_unstale":"2024-09-15T12:22:40.699702+0000","last_undegraded":"2024-09-15T12:22:40.699702+0000","last_fullsized":"2024-09-15T12:22:40.699702+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":516,"log_dups_size":0,"ondisk_log_size":516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33816576,"num_objects":516,"num_object_clones":0,"num_object_copies":1548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":516,"num_write_kb":33024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"41'556","reported_seq":589,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.553546+0000","last_change":"2024-09-15T12:22:00.458263+0000","last_active":"2024-09-15T12:22:40.553546+0000","last_peered":"2024-09-15T12:22:40.553546+0000","last_clean":"2024-09-15T12:22:40.553546+0000","last_became_active":"2024-09-15T12:22:00.446629+0000","last_became_peered":"2024-09-15T12:22:00.446629+0000","last_unstale":"2024-09-15T12:22:40.553546+0000","last_undegraded":"2024-09-15T12:22:40.553546+0000","last_fullsized":"2024-09-15T12:22:40.553546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36438016,"num_objects":556,"num_object_clones":0,"num_object_copies":1668,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":556,"num_write_kb":35584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"41'545","reported_seq":578,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.586804+0000","last_change":"2024-09-15T12:22:00.432607+0000","last_active":"2024-09-15T12:22:40.586804+0000","last_peered":"2024-09-15T12:22:40.586804+0000","last_clean":"2024-09-15T12:22:40.586804+0000","last_became_active":"2024-09-15T12:22:00.422177+0000","last_became_peered":"2024-09-15T12:22:00.422177+0000","last_unstale":"2024-09-15T12:22:40.586804+0000","last_undegraded":"2024-09-15T12:22:40.586804+0000","last_fullsized":"2024-09-15T12:22:40.586804+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35717120,"num_objects":545,"num_object_clones":0,"num_object_copies":1635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":545,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"41'528","reported_seq":561,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.651148+0000","last_change":"2024-09-15T12:22:00.420197+0000","last_active":"2024-09-15T12:22:40.651148+0000","last_peered":"2024-09-15T12:22:40.651148+0000","last_clean":"2024-09-15T12:22:40.651148+0000","last_became_active":"2024-09-15T12:22:00.406666+0000","last_became_peered":"2024-09-15T12:22:00.406666+0000","last_unstale":"2024-09-15T12:22:40.651148+0000","last_undegraded":"2024-09-15T12:22:40.651148+0000","last_fullsized":"2024-09-15T12:22:40.651148+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34603008,"num_objects":528,"num_object_clones":0,"num_object_copies":1584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":33792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":157,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.329852+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:22:08.329852+0000","last_peered":"2024-09-15T12:22:08.329852+0000","last_clean":"2024-09-15T12:22:08.329852+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:22:08.329852+0000","last_undegraded":"2024-09-15T12:22:08.329852+0000","last_fullsized":"2024-09-15T12:22:08.329852+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":95,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.313486+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:22:40.313486+0000","last_peered":"2024-09-15T12:22:40.313486+0000","last_clean":"2024-09-15T12:22:40.313486+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:22:40.313486+0000","last_undegraded":"2024-09-15T12:22:40.313486+0000","last_fullsized":"2024-09-15T12:22:40.313486+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"41'552","reported_seq":585,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.626033+0000","last_change":"2024-09-15T12:22:00.381165+0000","last_active":"2024-09-15T12:22:40.626033+0000","last_peered":"2024-09-15T12:22:40.626033+0000","last_clean":"2024-09-15T12:22:40.626033+0000","last_became_active":"2024-09-15T12:22:00.374145+0000","last_became_peered":"2024-09-15T12:22:00.374145+0000","last_unstale":"2024-09-15T12:22:40.626033+0000","last_undegraded":"2024-09-15T12:22:40.626033+0000","last_fullsized":"2024-09-15T12:22:40.626033+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36175872,"num_objects":552,"num_object_clones":0,"num_object_copies":1656,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":35328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":94,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.318562+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:22:40.318562+0000","last_peered":"2024-09-15T12:22:40.318562+0000","last_clean":"2024-09-15T12:22:40.318562+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:22:40.318562+0000","last_undegraded":"2024-09-15T12:22:40.318562+0000","last_fullsized":"2024-09-15T12:22:40.318562+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"41'496","reported_seq":529,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.710009+0000","last_change":"2024-09-15T12:22:00.405131+0000","last_active":"2024-09-15T12:22:40.710009+0000","last_peered":"2024-09-15T12:22:40.710009+0000","last_clean":"2024-09-15T12:22:40.710009+0000","last_became_active":"2024-09-15T12:22:00.398288+0000","last_became_peered":"2024-09-15T12:22:00.398288+0000","last_unstale":"2024-09-15T12:22:40.710009+0000","last_undegraded":"2024-09-15T12:22:40.710009+0000","last_fullsized":"2024-09-15T12:22:40.710009+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32505856,"num_objects":496,"num_object_clones":0,"num_object_copies":1488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":94,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.294473+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:22:40.294473+0000","last_peered":"2024-09-15T12:22:40.294473+0000","last_clean":"2024-09-15T12:22:40.294473+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:22:40.294473+0000","last_undegraded":"2024-09-15T12:22:40.294473+0000","last_fullsized":"2024-09-15T12:22:40.294473+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"41'540","reported_seq":573,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.738388+0000","last_change":"2024-09-15T12:22:00.390143+0000","last_active":"2024-09-15T12:22:40.738388+0000","last_peered":"2024-09-15T12:22:40.738388+0000","last_clean":"2024-09-15T12:22:40.738388+0000","last_became_active":"2024-09-15T12:22:00.370049+0000","last_became_peered":"2024-09-15T12:22:00.370049+0000","last_unstale":"2024-09-15T12:22:40.738388+0000","last_undegraded":"2024-09-15T12:22:40.738388+0000","last_fullsized":"2024-09-15T12:22:40.738388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35389440,"num_objects":540,"num_object_clones":0,"num_object_copies":1620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":540,"num_write_kb":34560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":96,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.317662+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:22:40.317662+0000","last_peered":"2024-09-15T12:22:40.317662+0000","last_clean":"2024-09-15T12:22:40.317662+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:22:40.317662+0000","last_undegraded":"2024-09-15T12:22:40.317662+0000","last_fullsized":"2024-09-15T12:22:40.317662+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"41'515","reported_seq":548,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.713666+0000","last_change":"2024-09-15T12:22:00.450159+0000","last_active":"2024-09-15T12:22:40.713666+0000","last_peered":"2024-09-15T12:22:40.713666+0000","last_clean":"2024-09-15T12:22:40.713666+0000","last_became_active":"2024-09-15T12:22:00.437056+0000","last_became_peered":"2024-09-15T12:22:00.437056+0000","last_unstale":"2024-09-15T12:22:40.713666+0000","last_undegraded":"2024-09-15T12:22:40.713666+0000","last_fullsized":"2024-09-15T12:22:40.713666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33751040,"num_objects":515,"num_object_clones":0,"num_object_copies":1545,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":515,"num_write_kb":32960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":94,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.296473+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:22:40.296473+0000","last_peered":"2024-09-15T12:22:40.296473+0000","last_clean":"2024-09-15T12:22:40.296473+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:22:40.296473+0000","last_undegraded":"2024-09-15T12:22:40.296473+0000","last_fullsized":"2024-09-15T12:22:40.296473+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"41'526","reported_seq":559,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.635508+0000","last_change":"2024-09-15T12:22:00.364579+0000","last_active":"2024-09-15T12:22:40.635508+0000","last_peered":"2024-09-15T12:22:40.635508+0000","last_clean":"2024-09-15T12:22:40.635508+0000","last_became_active":"2024-09-15T12:22:00.353614+0000","last_became_peered":"2024-09-15T12:22:00.353614+0000","last_unstale":"2024-09-15T12:22:40.635508+0000","last_undegraded":"2024-09-15T12:22:40.635508+0000","last_fullsized":"2024-09-15T12:22:40.635508+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34471936,"num_objects":526,"num_object_clones":0,"num_object_copies":1578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":526,"num_write_kb":33664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-15T12:22:08.334782+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:22:08.334782+0000","last_peered":"2024-09-15T12:22:08.334782+0000","last_clean":"2024-09-15T12:22:08.334782+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:22:08.334782+0000","last_undegraded":"2024-09-15T12:22:08.334782+0000","last_fullsized":"2024-09-15T12:22:08.334782+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"41'529","reported_seq":562,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.690404+0000","last_change":"2024-09-15T12:22:00.384094+0000","last_active":"2024-09-15T12:22:40.690404+0000","last_peered":"2024-09-15T12:22:40.690404+0000","last_clean":"2024-09-15T12:22:40.690404+0000","last_became_active":"2024-09-15T12:22:00.377789+0000","last_became_peered":"2024-09-15T12:22:00.377789+0000","last_unstale":"2024-09-15T12:22:40.690404+0000","last_undegraded":"2024-09-15T12:22:40.690404+0000","last_fullsized":"2024-09-15T12:22:40.690404+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":33856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":94,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.298927+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:22:40.298927+0000","last_peered":"2024-09-15T12:22:40.298927+0000","last_clean":"2024-09-15T12:22:40.298927+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:22:40.298927+0000","last_undegraded":"2024-09-15T12:22:40.298927+0000","last_fullsized":"2024-09-15T12:22:40.298927+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"41'560","reported_seq":593,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.358895+0000","last_change":"2024-09-15T12:22:00.394121+0000","last_active":"2024-09-15T12:22:40.358895+0000","last_peered":"2024-09-15T12:22:40.358895+0000","last_clean":"2024-09-15T12:22:40.358895+0000","last_became_active":"2024-09-15T12:22:00.388183+0000","last_became_peered":"2024-09-15T12:22:00.388183+0000","last_unstale":"2024-09-15T12:22:40.358895+0000","last_undegraded":"2024-09-15T12:22:40.358895+0000","last_fullsized":"2024-09-15T12:22:40.358895+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36700160,"num_objects":560,"num_object_clones":0,"num_object_copies":1680,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":35840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":94,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.304824+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:22:40.304824+0000","last_peered":"2024-09-15T12:22:40.304824+0000","last_clean":"2024-09-15T12:22:40.304824+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:22:40.304824+0000","last_undegraded":"2024-09-15T12:22:40.304824+0000","last_fullsized":"2024-09-15T12:22:40.304824+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":533004288,"num_objects":8133,"num_object_clones":0,"num_object_copies":24399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8133,"num_write_kb":520512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":84058112,"data_stored":1344929792,"data_compressed":63861134,"data_compressed_allocated":84058112,"data_compressed_original":1344929792,"omap_allocated":0,"internal_metadata":0},"log_size":8133,"ondisk_log_size":8133,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52376,"kb_used_data":7496,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94319464,"statfs":{"total":96636764160,"available":96583131136,"internally_reserved":0,"allocated":7675904,"data_stored":117421402,"data_compressed":5571588,"data_compressed_allocated":7335936,"data_compressed_original":117293056,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74444,"kb_used_data":21240,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94297396,"statfs":{"total":96636764160,"available":96560533504,"internally_reserved":0,"allocated":21749760,"data_stored":342281983,"data_compressed":16249098,"data_compressed_allocated":21389312,"data_compressed_original":342147072,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":76864,"kb_used_data":27824,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94294976,"statfs":{"total":96636764160,"available":96558055424,"internally_reserved":0,"allocated":28491776,"data_stored":450419112,"data_compressed":21381651,"data_compressed_allocated":28143616,"data_compressed_original":450297856,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":78996,"kb_used_data":25792,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94292844,"statfs":{"total":96636764160,"available":96555872256,"internally_reserved":0,"allocated":26411008,"data_stored":416861951,"data_compressed":19790397,"data_compressed_allocated":26050560,"data_compressed_original":416727040,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26300416,"data_stored":420806656,"data_compressed":19981317,"data_compressed_allocated":26300416,"data_compressed_original":420806656,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28401664,"data_stored":454426624,"data_compressed":21577707,"data_compressed_allocated":28401664,"data_compressed_original":454426624,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21622784,"data_stored":345964544,"data_compressed":16427570,"data_compressed_allocated":21622784,"data_compressed_original":345964544,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7733248,"data_stored":123731968,"data_compressed":5874540,"data_compressed_allocated":7733248,"data_compressed_original":123731968,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:22:43.339 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 42 16 9035 9019 13.4199 12.5 0.138574 0.0744144 2024-09-15T12:22:44.130 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:22:44.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:44.292+0000 7f9258463640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:44.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:44.305+0000 7f9258463640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:44.340 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 43 16 9248 9232 13.4174 13.3125 0.0706928 0.0744629 2024-09-15T12:22:45.339 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 44 16 9449 9433 13.398 12.5625 0.0634852 0.0745617 2024-09-15T12:22:46.340 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 45 16 9667 9651 13.403 13.625 0.076499 0.0745341 2024-09-15T12:22:46.874 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:22:47.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:47.031+0000 7f9707cac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:47.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:47.041+0000 7f9707cac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:47.340 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 46 16 9880 9864 13.401 13.3125 0.0971973 0.0745368 2024-09-15T12:22:47.917 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:22:47.917 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-15T12:22:48.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:48.082+0000 7f695f911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:48.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:48.101+0000 7f695f911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:48.340 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 47 16 10081 10065 13.3831 12.5625 0.157146 0.0746281 2024-09-15T12:22:49.232 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.0 to 1 (10000) 2024-09-15T12:22:49.255 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-15T12:22:49.340 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 48 16 10284 10268 13.3686 12.6875 0.0650602 0.0747614 2024-09-15T12:22:49.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:49.410+0000 7f4f0a191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:49.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:49.426+0000 7f4f0a191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:49.570 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:22:49.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:49.732+0000 7f6ad7b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:49.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:49.745+0000 7f6ad7b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:50.238 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.1 to 1 (10000) 2024-09-15T12:22:50.262 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-15T12:22:50.340 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 49 16 10479 10463 13.3445 12.1875 0.101195 0.0748923 2024-09-15T12:22:50.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:50.422+0000 7f7a7d591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:50.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:50.442+0000 7f7a7d591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:51.244 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.2 to 1 (10000) 2024-09-15T12:22:51.270 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-15T12:22:51.340 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 50 16 10668 10652 13.3138 11.8125 0.0583862 0.0750016 2024-09-15T12:22:51.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:51.424+0000 7fdac68bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:51.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:51.445+0000 7fdac68bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:52.251 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.3 to 1 (10000) 2024-09-15T12:22:52.279 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-15T12:22:52.279 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:22:52.340 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 51 16 10867 10851 13.2966 12.4375 0.128267 0.075136 2024-09-15T12:22:52.447 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:22:52.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:52.441+0000 7f1cc2391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:52.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:52.456+0000 7f1cc2391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:52.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:52.637+0000 7f9f7f391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:52.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:52.654+0000 7f9f7f391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:52.805 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:22:52.806 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:22:52.828 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":164,"stamp":"2024-09-15T12:22:52.253934+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":560661043,"num_objects":8550,"num_object_clones":0,"num_object_copies":25650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8627,"num_write_kb":548052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8601,"ondisk_log_size":8601,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":307940,"kb_used_data":103452,"kb_used_omap":0,"kb_used_meta":204416,"kb_avail":377179420,"statfs":{"total":386547056640,"available":386231726080,"internally_reserved":0,"allocated":105934848,"data_stored":1672175652,"data_compressed":79383638,"data_compressed_allocated":104493056,"data_compressed_original":1671643136,"omap_allocated":0,"internal_metadata":209321984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.502660"},"pg_stats":[{"pgid":"4.f","version":"41'543","reported_seq":576,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.587715+0000","last_change":"2024-09-15T12:22:00.377854+0000","last_active":"2024-09-15T12:22:40.587715+0000","last_peered":"2024-09-15T12:22:40.587715+0000","last_clean":"2024-09-15T12:22:40.587715+0000","last_became_active":"2024-09-15T12:22:00.359790+0000","last_became_peered":"2024-09-15T12:22:00.359790+0000","last_unstale":"2024-09-15T12:22:40.587715+0000","last_undegraded":"2024-09-15T12:22:40.587715+0000","last_fullsized":"2024-09-15T12:22:40.587715+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35586048,"num_objects":543,"num_object_clones":0,"num_object_copies":1629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":543,"num_write_kb":34752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"41'542","reported_seq":575,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.596341+0000","last_change":"2024-09-15T12:22:00.383291+0000","last_active":"2024-09-15T12:22:40.596341+0000","last_peered":"2024-09-15T12:22:40.596341+0000","last_clean":"2024-09-15T12:22:40.596341+0000","last_became_active":"2024-09-15T12:22:00.376330+0000","last_became_peered":"2024-09-15T12:22:00.376330+0000","last_unstale":"2024-09-15T12:22:40.596341+0000","last_undegraded":"2024-09-15T12:22:40.596341+0000","last_fullsized":"2024-09-15T12:22:40.596341+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35520512,"num_objects":542,"num_object_clones":0,"num_object_copies":1626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":542,"num_write_kb":34688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"41'553","reported_seq":586,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.645107+0000","last_change":"2024-09-15T12:22:00.413467+0000","last_active":"2024-09-15T12:22:40.645107+0000","last_peered":"2024-09-15T12:22:40.645107+0000","last_clean":"2024-09-15T12:22:40.645107+0000","last_became_active":"2024-09-15T12:22:00.399293+0000","last_became_peered":"2024-09-15T12:22:00.399293+0000","last_unstale":"2024-09-15T12:22:40.645107+0000","last_undegraded":"2024-09-15T12:22:40.645107+0000","last_fullsized":"2024-09-15T12:22:40.645107+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"42'548","reported_seq":584,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T12:22:41.771786+0000","last_change":"2024-09-15T12:22:00.397700+0000","last_active":"2024-09-15T12:22:41.771786+0000","last_peered":"2024-09-15T12:22:41.771786+0000","last_clean":"2024-09-15T12:22:41.771786+0000","last_became_active":"2024-09-15T12:22:00.388314+0000","last_became_peered":"2024-09-15T12:22:00.388314+0000","last_unstale":"2024-09-15T12:22:41.771786+0000","last_undegraded":"2024-09-15T12:22:41.771786+0000","last_fullsized":"2024-09-15T12:22:41.771786+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":548,"log_dups_size":0,"ondisk_log_size":548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35913728,"num_objects":548,"num_object_clones":0,"num_object_copies":1644,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":548,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"41'497","reported_seq":530,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.686178+0000","last_change":"2024-09-15T12:22:00.418610+0000","last_active":"2024-09-15T12:22:40.686178+0000","last_peered":"2024-09-15T12:22:40.686178+0000","last_clean":"2024-09-15T12:22:40.686178+0000","last_became_active":"2024-09-15T12:22:00.404352+0000","last_became_peered":"2024-09-15T12:22:00.404352+0000","last_unstale":"2024-09-15T12:22:40.686178+0000","last_undegraded":"2024-09-15T12:22:40.686178+0000","last_fullsized":"2024-09-15T12:22:40.686178+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32571392,"num_objects":497,"num_object_clones":0,"num_object_copies":1491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":497,"num_write_kb":31808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"41'516","reported_seq":549,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.699702+0000","last_change":"2024-09-15T12:22:00.408893+0000","last_active":"2024-09-15T12:22:40.699702+0000","last_peered":"2024-09-15T12:22:40.699702+0000","last_clean":"2024-09-15T12:22:40.699702+0000","last_became_active":"2024-09-15T12:22:00.399557+0000","last_became_peered":"2024-09-15T12:22:00.399557+0000","last_unstale":"2024-09-15T12:22:40.699702+0000","last_undegraded":"2024-09-15T12:22:40.699702+0000","last_fullsized":"2024-09-15T12:22:40.699702+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":516,"log_dups_size":0,"ondisk_log_size":516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33816576,"num_objects":516,"num_object_clones":0,"num_object_copies":1548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":516,"num_write_kb":33024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"41'556","reported_seq":589,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.553546+0000","last_change":"2024-09-15T12:22:00.458263+0000","last_active":"2024-09-15T12:22:40.553546+0000","last_peered":"2024-09-15T12:22:40.553546+0000","last_clean":"2024-09-15T12:22:40.553546+0000","last_became_active":"2024-09-15T12:22:00.446629+0000","last_became_peered":"2024-09-15T12:22:00.446629+0000","last_unstale":"2024-09-15T12:22:40.553546+0000","last_undegraded":"2024-09-15T12:22:40.553546+0000","last_fullsized":"2024-09-15T12:22:40.553546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36438016,"num_objects":556,"num_object_clones":0,"num_object_copies":1668,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":556,"num_write_kb":35584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"41'545","reported_seq":578,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.586804+0000","last_change":"2024-09-15T12:22:00.432607+0000","last_active":"2024-09-15T12:22:40.586804+0000","last_peered":"2024-09-15T12:22:40.586804+0000","last_clean":"2024-09-15T12:22:40.586804+0000","last_became_active":"2024-09-15T12:22:00.422177+0000","last_became_peered":"2024-09-15T12:22:00.422177+0000","last_unstale":"2024-09-15T12:22:40.586804+0000","last_undegraded":"2024-09-15T12:22:40.586804+0000","last_fullsized":"2024-09-15T12:22:40.586804+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35717120,"num_objects":545,"num_object_clones":0,"num_object_copies":1635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":545,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"41'528","reported_seq":561,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.651148+0000","last_change":"2024-09-15T12:22:00.420197+0000","last_active":"2024-09-15T12:22:40.651148+0000","last_peered":"2024-09-15T12:22:40.651148+0000","last_clean":"2024-09-15T12:22:40.651148+0000","last_became_active":"2024-09-15T12:22:00.406666+0000","last_became_peered":"2024-09-15T12:22:00.406666+0000","last_unstale":"2024-09-15T12:22:40.651148+0000","last_undegraded":"2024-09-15T12:22:40.651148+0000","last_fullsized":"2024-09-15T12:22:40.651148+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34603008,"num_objects":528,"num_object_clones":0,"num_object_copies":1584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":33792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":169,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T12:22:41.285455+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:22:41.285455+0000","last_peered":"2024-09-15T12:22:41.285455+0000","last_clean":"2024-09-15T12:22:41.285455+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:22:41.285455+0000","last_undegraded":"2024-09-15T12:22:41.285455+0000","last_fullsized":"2024-09-15T12:22:41.285455+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":95,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.313486+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:22:40.313486+0000","last_peered":"2024-09-15T12:22:40.313486+0000","last_clean":"2024-09-15T12:22:40.313486+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:22:40.313486+0000","last_undegraded":"2024-09-15T12:22:40.313486+0000","last_fullsized":"2024-09-15T12:22:40.313486+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"41'552","reported_seq":585,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.626033+0000","last_change":"2024-09-15T12:22:00.381165+0000","last_active":"2024-09-15T12:22:40.626033+0000","last_peered":"2024-09-15T12:22:40.626033+0000","last_clean":"2024-09-15T12:22:40.626033+0000","last_became_active":"2024-09-15T12:22:00.374145+0000","last_became_peered":"2024-09-15T12:22:00.374145+0000","last_unstale":"2024-09-15T12:22:40.626033+0000","last_undegraded":"2024-09-15T12:22:40.626033+0000","last_fullsized":"2024-09-15T12:22:40.626033+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36175872,"num_objects":552,"num_object_clones":0,"num_object_copies":1656,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":35328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":94,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.318562+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:22:40.318562+0000","last_peered":"2024-09-15T12:22:40.318562+0000","last_clean":"2024-09-15T12:22:40.318562+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:22:40.318562+0000","last_undegraded":"2024-09-15T12:22:40.318562+0000","last_fullsized":"2024-09-15T12:22:40.318562+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"41'496","reported_seq":529,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.710009+0000","last_change":"2024-09-15T12:22:00.405131+0000","last_active":"2024-09-15T12:22:40.710009+0000","last_peered":"2024-09-15T12:22:40.710009+0000","last_clean":"2024-09-15T12:22:40.710009+0000","last_became_active":"2024-09-15T12:22:00.398288+0000","last_became_peered":"2024-09-15T12:22:00.398288+0000","last_unstale":"2024-09-15T12:22:40.710009+0000","last_undegraded":"2024-09-15T12:22:40.710009+0000","last_fullsized":"2024-09-15T12:22:40.710009+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32505856,"num_objects":496,"num_object_clones":0,"num_object_copies":1488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":94,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.294473+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:22:40.294473+0000","last_peered":"2024-09-15T12:22:40.294473+0000","last_clean":"2024-09-15T12:22:40.294473+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:22:40.294473+0000","last_undegraded":"2024-09-15T12:22:40.294473+0000","last_fullsized":"2024-09-15T12:22:40.294473+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"41'540","reported_seq":573,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.738388+0000","last_change":"2024-09-15T12:22:00.390143+0000","last_active":"2024-09-15T12:22:40.738388+0000","last_peered":"2024-09-15T12:22:40.738388+0000","last_clean":"2024-09-15T12:22:40.738388+0000","last_became_active":"2024-09-15T12:22:00.370049+0000","last_became_peered":"2024-09-15T12:22:00.370049+0000","last_unstale":"2024-09-15T12:22:40.738388+0000","last_undegraded":"2024-09-15T12:22:40.738388+0000","last_fullsized":"2024-09-15T12:22:40.738388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35389440,"num_objects":540,"num_object_clones":0,"num_object_copies":1620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":540,"num_write_kb":34560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":96,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.317662+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:22:40.317662+0000","last_peered":"2024-09-15T12:22:40.317662+0000","last_clean":"2024-09-15T12:22:40.317662+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:22:40.317662+0000","last_undegraded":"2024-09-15T12:22:40.317662+0000","last_fullsized":"2024-09-15T12:22:40.317662+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"41'515","reported_seq":548,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.713666+0000","last_change":"2024-09-15T12:22:00.450159+0000","last_active":"2024-09-15T12:22:40.713666+0000","last_peered":"2024-09-15T12:22:40.713666+0000","last_clean":"2024-09-15T12:22:40.713666+0000","last_became_active":"2024-09-15T12:22:00.437056+0000","last_became_peered":"2024-09-15T12:22:00.437056+0000","last_unstale":"2024-09-15T12:22:40.713666+0000","last_undegraded":"2024-09-15T12:22:40.713666+0000","last_fullsized":"2024-09-15T12:22:40.713666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33751040,"num_objects":515,"num_object_clones":0,"num_object_copies":1545,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":515,"num_write_kb":32960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":94,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.296473+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:22:40.296473+0000","last_peered":"2024-09-15T12:22:40.296473+0000","last_clean":"2024-09-15T12:22:40.296473+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:22:40.296473+0000","last_undegraded":"2024-09-15T12:22:40.296473+0000","last_fullsized":"2024-09-15T12:22:40.296473+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"41'526","reported_seq":559,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.635508+0000","last_change":"2024-09-15T12:22:00.364579+0000","last_active":"2024-09-15T12:22:40.635508+0000","last_peered":"2024-09-15T12:22:40.635508+0000","last_clean":"2024-09-15T12:22:40.635508+0000","last_became_active":"2024-09-15T12:22:00.353614+0000","last_became_peered":"2024-09-15T12:22:00.353614+0000","last_unstale":"2024-09-15T12:22:40.635508+0000","last_undegraded":"2024-09-15T12:22:40.635508+0000","last_fullsized":"2024-09-15T12:22:40.635508+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34471936,"num_objects":526,"num_object_clones":0,"num_object_copies":1578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":526,"num_write_kb":33664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T12:22:41.291379+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:22:41.291379+0000","last_peered":"2024-09-15T12:22:41.291379+0000","last_clean":"2024-09-15T12:22:41.291379+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:22:41.291379+0000","last_undegraded":"2024-09-15T12:22:41.291379+0000","last_fullsized":"2024-09-15T12:22:41.291379+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"41'529","reported_seq":562,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.690404+0000","last_change":"2024-09-15T12:22:00.384094+0000","last_active":"2024-09-15T12:22:40.690404+0000","last_peered":"2024-09-15T12:22:40.690404+0000","last_clean":"2024-09-15T12:22:40.690404+0000","last_became_active":"2024-09-15T12:22:00.377789+0000","last_became_peered":"2024-09-15T12:22:00.377789+0000","last_unstale":"2024-09-15T12:22:40.690404+0000","last_undegraded":"2024-09-15T12:22:40.690404+0000","last_fullsized":"2024-09-15T12:22:40.690404+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":33856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":94,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.298927+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:22:40.298927+0000","last_peered":"2024-09-15T12:22:40.298927+0000","last_clean":"2024-09-15T12:22:40.298927+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:22:40.298927+0000","last_undegraded":"2024-09-15T12:22:40.298927+0000","last_fullsized":"2024-09-15T12:22:40.298927+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"41'560","reported_seq":593,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.358895+0000","last_change":"2024-09-15T12:22:00.394121+0000","last_active":"2024-09-15T12:22:40.358895+0000","last_peered":"2024-09-15T12:22:40.358895+0000","last_clean":"2024-09-15T12:22:40.358895+0000","last_became_active":"2024-09-15T12:22:00.388183+0000","last_became_peered":"2024-09-15T12:22:00.388183+0000","last_unstale":"2024-09-15T12:22:40.358895+0000","last_undegraded":"2024-09-15T12:22:40.358895+0000","last_fullsized":"2024-09-15T12:22:40.358895+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36700160,"num_objects":560,"num_object_clones":0,"num_object_copies":1680,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":35840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":94,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.304824+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:22:40.304824+0000","last_peered":"2024-09-15T12:22:40.304824+0000","last_clean":"2024-09-15T12:22:40.304824+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:22:40.304824+0000","last_undegraded":"2024-09-15T12:22:40.304824+0000","last_fullsized":"2024-09-15T12:22:40.304824+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":560070656,"num_objects":8546,"num_object_clones":0,"num_object_copies":25638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8546,"num_write_kb":546944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":105496576,"data_stored":1687945216,"data_compressed":80149342,"data_compressed_allocated":105496576,"data_compressed_original":1687945216,"omap_allocated":0,"internal_metadata":0},"log_size":8546,"ondisk_log_size":8546,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673199,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":77636,"kb_used_data":28596,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94294204,"statfs":{"total":96636764160,"available":96557264896,"internally_reserved":0,"allocated":29282304,"data_stored":462612606,"data_compressed":21962492,"data_compressed_allocated":28909568,"data_compressed_original":462471168,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74444,"kb_used_data":21240,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94297396,"statfs":{"total":96636764160,"available":96560533504,"internally_reserved":0,"allocated":21749760,"data_stored":342281983,"data_compressed":16249098,"data_compressed_allocated":21389312,"data_compressed_original":342147072,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":76864,"kb_used_data":27824,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94294976,"statfs":{"total":96636764160,"available":96558055424,"internally_reserved":0,"allocated":28491776,"data_stored":450419112,"data_compressed":21381651,"data_compressed_allocated":28143616,"data_compressed_original":450297856,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":78996,"kb_used_data":25792,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94292844,"statfs":{"total":96636764160,"available":96555872256,"internally_reserved":0,"allocated":26411008,"data_stored":416861951,"data_compressed":19790397,"data_compressed_allocated":26050560,"data_compressed_original":416727040,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26300416,"data_stored":420806656,"data_compressed":19981317,"data_compressed_allocated":26300416,"data_compressed_original":420806656,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28401664,"data_stored":454426624,"data_compressed":21577707,"data_compressed_allocated":28401664,"data_compressed_original":454426624,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21622784,"data_stored":345964544,"data_compressed":16427570,"data_compressed_allocated":21622784,"data_compressed_original":345964544,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29171712,"data_stored":466747392,"data_compressed":22162748,"data_compressed_allocated":29171712,"data_compressed_original":466747392,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:22:52.830 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:22:53.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:53.035+0000 7f4b42d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:53.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:53.047+0000 7f4b42d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:53.340 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 52 16 11040 11024 13.2488 10.8125 0.10415 0.0753817 2024-09-15T12:22:53.433 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:22:53.433 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:22:53.453 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":164,"stamp":"2024-09-15T12:22:52.253934+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":560661043,"num_objects":8550,"num_object_clones":0,"num_object_copies":25650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8627,"num_write_kb":548052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8601,"ondisk_log_size":8601,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":307940,"kb_used_data":103452,"kb_used_omap":0,"kb_used_meta":204416,"kb_avail":377179420,"statfs":{"total":386547056640,"available":386231726080,"internally_reserved":0,"allocated":105934848,"data_stored":1672175652,"data_compressed":79383638,"data_compressed_allocated":104493056,"data_compressed_original":1671643136,"omap_allocated":0,"internal_metadata":209321984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.502660"},"pg_stats":[{"pgid":"4.f","version":"41'543","reported_seq":576,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.587715+0000","last_change":"2024-09-15T12:22:00.377854+0000","last_active":"2024-09-15T12:22:40.587715+0000","last_peered":"2024-09-15T12:22:40.587715+0000","last_clean":"2024-09-15T12:22:40.587715+0000","last_became_active":"2024-09-15T12:22:00.359790+0000","last_became_peered":"2024-09-15T12:22:00.359790+0000","last_unstale":"2024-09-15T12:22:40.587715+0000","last_undegraded":"2024-09-15T12:22:40.587715+0000","last_fullsized":"2024-09-15T12:22:40.587715+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35586048,"num_objects":543,"num_object_clones":0,"num_object_copies":1629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":543,"num_write_kb":34752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"41'542","reported_seq":575,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.596341+0000","last_change":"2024-09-15T12:22:00.383291+0000","last_active":"2024-09-15T12:22:40.596341+0000","last_peered":"2024-09-15T12:22:40.596341+0000","last_clean":"2024-09-15T12:22:40.596341+0000","last_became_active":"2024-09-15T12:22:00.376330+0000","last_became_peered":"2024-09-15T12:22:00.376330+0000","last_unstale":"2024-09-15T12:22:40.596341+0000","last_undegraded":"2024-09-15T12:22:40.596341+0000","last_fullsized":"2024-09-15T12:22:40.596341+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35520512,"num_objects":542,"num_object_clones":0,"num_object_copies":1626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":542,"num_write_kb":34688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"41'553","reported_seq":586,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.645107+0000","last_change":"2024-09-15T12:22:00.413467+0000","last_active":"2024-09-15T12:22:40.645107+0000","last_peered":"2024-09-15T12:22:40.645107+0000","last_clean":"2024-09-15T12:22:40.645107+0000","last_became_active":"2024-09-15T12:22:00.399293+0000","last_became_peered":"2024-09-15T12:22:00.399293+0000","last_unstale":"2024-09-15T12:22:40.645107+0000","last_undegraded":"2024-09-15T12:22:40.645107+0000","last_fullsized":"2024-09-15T12:22:40.645107+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"42'548","reported_seq":584,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T12:22:41.771786+0000","last_change":"2024-09-15T12:22:00.397700+0000","last_active":"2024-09-15T12:22:41.771786+0000","last_peered":"2024-09-15T12:22:41.771786+0000","last_clean":"2024-09-15T12:22:41.771786+0000","last_became_active":"2024-09-15T12:22:00.388314+0000","last_became_peered":"2024-09-15T12:22:00.388314+0000","last_unstale":"2024-09-15T12:22:41.771786+0000","last_undegraded":"2024-09-15T12:22:41.771786+0000","last_fullsized":"2024-09-15T12:22:41.771786+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":548,"log_dups_size":0,"ondisk_log_size":548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35913728,"num_objects":548,"num_object_clones":0,"num_object_copies":1644,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":548,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"41'497","reported_seq":530,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.686178+0000","last_change":"2024-09-15T12:22:00.418610+0000","last_active":"2024-09-15T12:22:40.686178+0000","last_peered":"2024-09-15T12:22:40.686178+0000","last_clean":"2024-09-15T12:22:40.686178+0000","last_became_active":"2024-09-15T12:22:00.404352+0000","last_became_peered":"2024-09-15T12:22:00.404352+0000","last_unstale":"2024-09-15T12:22:40.686178+0000","last_undegraded":"2024-09-15T12:22:40.686178+0000","last_fullsized":"2024-09-15T12:22:40.686178+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32571392,"num_objects":497,"num_object_clones":0,"num_object_copies":1491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":497,"num_write_kb":31808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"41'516","reported_seq":549,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.699702+0000","last_change":"2024-09-15T12:22:00.408893+0000","last_active":"2024-09-15T12:22:40.699702+0000","last_peered":"2024-09-15T12:22:40.699702+0000","last_clean":"2024-09-15T12:22:40.699702+0000","last_became_active":"2024-09-15T12:22:00.399557+0000","last_became_peered":"2024-09-15T12:22:00.399557+0000","last_unstale":"2024-09-15T12:22:40.699702+0000","last_undegraded":"2024-09-15T12:22:40.699702+0000","last_fullsized":"2024-09-15T12:22:40.699702+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":516,"log_dups_size":0,"ondisk_log_size":516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33816576,"num_objects":516,"num_object_clones":0,"num_object_copies":1548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":516,"num_write_kb":33024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"41'556","reported_seq":589,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.553546+0000","last_change":"2024-09-15T12:22:00.458263+0000","last_active":"2024-09-15T12:22:40.553546+0000","last_peered":"2024-09-15T12:22:40.553546+0000","last_clean":"2024-09-15T12:22:40.553546+0000","last_became_active":"2024-09-15T12:22:00.446629+0000","last_became_peered":"2024-09-15T12:22:00.446629+0000","last_unstale":"2024-09-15T12:22:40.553546+0000","last_undegraded":"2024-09-15T12:22:40.553546+0000","last_fullsized":"2024-09-15T12:22:40.553546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36438016,"num_objects":556,"num_object_clones":0,"num_object_copies":1668,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":556,"num_write_kb":35584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"41'545","reported_seq":578,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.586804+0000","last_change":"2024-09-15T12:22:00.432607+0000","last_active":"2024-09-15T12:22:40.586804+0000","last_peered":"2024-09-15T12:22:40.586804+0000","last_clean":"2024-09-15T12:22:40.586804+0000","last_became_active":"2024-09-15T12:22:00.422177+0000","last_became_peered":"2024-09-15T12:22:00.422177+0000","last_unstale":"2024-09-15T12:22:40.586804+0000","last_undegraded":"2024-09-15T12:22:40.586804+0000","last_fullsized":"2024-09-15T12:22:40.586804+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35717120,"num_objects":545,"num_object_clones":0,"num_object_copies":1635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":545,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"41'528","reported_seq":561,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.651148+0000","last_change":"2024-09-15T12:22:00.420197+0000","last_active":"2024-09-15T12:22:40.651148+0000","last_peered":"2024-09-15T12:22:40.651148+0000","last_clean":"2024-09-15T12:22:40.651148+0000","last_became_active":"2024-09-15T12:22:00.406666+0000","last_became_peered":"2024-09-15T12:22:00.406666+0000","last_unstale":"2024-09-15T12:22:40.651148+0000","last_undegraded":"2024-09-15T12:22:40.651148+0000","last_fullsized":"2024-09-15T12:22:40.651148+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34603008,"num_objects":528,"num_object_clones":0,"num_object_copies":1584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":33792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":169,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T12:22:41.285455+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:22:41.285455+0000","last_peered":"2024-09-15T12:22:41.285455+0000","last_clean":"2024-09-15T12:22:41.285455+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:22:41.285455+0000","last_undegraded":"2024-09-15T12:22:41.285455+0000","last_fullsized":"2024-09-15T12:22:41.285455+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":95,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.313486+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:22:40.313486+0000","last_peered":"2024-09-15T12:22:40.313486+0000","last_clean":"2024-09-15T12:22:40.313486+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:22:40.313486+0000","last_undegraded":"2024-09-15T12:22:40.313486+0000","last_fullsized":"2024-09-15T12:22:40.313486+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"41'552","reported_seq":585,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.626033+0000","last_change":"2024-09-15T12:22:00.381165+0000","last_active":"2024-09-15T12:22:40.626033+0000","last_peered":"2024-09-15T12:22:40.626033+0000","last_clean":"2024-09-15T12:22:40.626033+0000","last_became_active":"2024-09-15T12:22:00.374145+0000","last_became_peered":"2024-09-15T12:22:00.374145+0000","last_unstale":"2024-09-15T12:22:40.626033+0000","last_undegraded":"2024-09-15T12:22:40.626033+0000","last_fullsized":"2024-09-15T12:22:40.626033+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36175872,"num_objects":552,"num_object_clones":0,"num_object_copies":1656,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":35328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":94,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.318562+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:22:40.318562+0000","last_peered":"2024-09-15T12:22:40.318562+0000","last_clean":"2024-09-15T12:22:40.318562+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:22:40.318562+0000","last_undegraded":"2024-09-15T12:22:40.318562+0000","last_fullsized":"2024-09-15T12:22:40.318562+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"41'496","reported_seq":529,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.710009+0000","last_change":"2024-09-15T12:22:00.405131+0000","last_active":"2024-09-15T12:22:40.710009+0000","last_peered":"2024-09-15T12:22:40.710009+0000","last_clean":"2024-09-15T12:22:40.710009+0000","last_became_active":"2024-09-15T12:22:00.398288+0000","last_became_peered":"2024-09-15T12:22:00.398288+0000","last_unstale":"2024-09-15T12:22:40.710009+0000","last_undegraded":"2024-09-15T12:22:40.710009+0000","last_fullsized":"2024-09-15T12:22:40.710009+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32505856,"num_objects":496,"num_object_clones":0,"num_object_copies":1488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":94,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.294473+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:22:40.294473+0000","last_peered":"2024-09-15T12:22:40.294473+0000","last_clean":"2024-09-15T12:22:40.294473+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:22:40.294473+0000","last_undegraded":"2024-09-15T12:22:40.294473+0000","last_fullsized":"2024-09-15T12:22:40.294473+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"41'540","reported_seq":573,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.738388+0000","last_change":"2024-09-15T12:22:00.390143+0000","last_active":"2024-09-15T12:22:40.738388+0000","last_peered":"2024-09-15T12:22:40.738388+0000","last_clean":"2024-09-15T12:22:40.738388+0000","last_became_active":"2024-09-15T12:22:00.370049+0000","last_became_peered":"2024-09-15T12:22:00.370049+0000","last_unstale":"2024-09-15T12:22:40.738388+0000","last_undegraded":"2024-09-15T12:22:40.738388+0000","last_fullsized":"2024-09-15T12:22:40.738388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35389440,"num_objects":540,"num_object_clones":0,"num_object_copies":1620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":540,"num_write_kb":34560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":96,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.317662+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:22:40.317662+0000","last_peered":"2024-09-15T12:22:40.317662+0000","last_clean":"2024-09-15T12:22:40.317662+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:22:40.317662+0000","last_undegraded":"2024-09-15T12:22:40.317662+0000","last_fullsized":"2024-09-15T12:22:40.317662+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"41'515","reported_seq":548,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.713666+0000","last_change":"2024-09-15T12:22:00.450159+0000","last_active":"2024-09-15T12:22:40.713666+0000","last_peered":"2024-09-15T12:22:40.713666+0000","last_clean":"2024-09-15T12:22:40.713666+0000","last_became_active":"2024-09-15T12:22:00.437056+0000","last_became_peered":"2024-09-15T12:22:00.437056+0000","last_unstale":"2024-09-15T12:22:40.713666+0000","last_undegraded":"2024-09-15T12:22:40.713666+0000","last_fullsized":"2024-09-15T12:22:40.713666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33751040,"num_objects":515,"num_object_clones":0,"num_object_copies":1545,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":515,"num_write_kb":32960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":94,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.296473+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:22:40.296473+0000","last_peered":"2024-09-15T12:22:40.296473+0000","last_clean":"2024-09-15T12:22:40.296473+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:22:40.296473+0000","last_undegraded":"2024-09-15T12:22:40.296473+0000","last_fullsized":"2024-09-15T12:22:40.296473+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"41'526","reported_seq":559,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.635508+0000","last_change":"2024-09-15T12:22:00.364579+0000","last_active":"2024-09-15T12:22:40.635508+0000","last_peered":"2024-09-15T12:22:40.635508+0000","last_clean":"2024-09-15T12:22:40.635508+0000","last_became_active":"2024-09-15T12:22:00.353614+0000","last_became_peered":"2024-09-15T12:22:00.353614+0000","last_unstale":"2024-09-15T12:22:40.635508+0000","last_undegraded":"2024-09-15T12:22:40.635508+0000","last_fullsized":"2024-09-15T12:22:40.635508+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34471936,"num_objects":526,"num_object_clones":0,"num_object_copies":1578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":526,"num_write_kb":33664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T12:22:41.291379+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:22:41.291379+0000","last_peered":"2024-09-15T12:22:41.291379+0000","last_clean":"2024-09-15T12:22:41.291379+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:22:41.291379+0000","last_undegraded":"2024-09-15T12:22:41.291379+0000","last_fullsized":"2024-09-15T12:22:41.291379+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"41'529","reported_seq":562,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.690404+0000","last_change":"2024-09-15T12:22:00.384094+0000","last_active":"2024-09-15T12:22:40.690404+0000","last_peered":"2024-09-15T12:22:40.690404+0000","last_clean":"2024-09-15T12:22:40.690404+0000","last_became_active":"2024-09-15T12:22:00.377789+0000","last_became_peered":"2024-09-15T12:22:00.377789+0000","last_unstale":"2024-09-15T12:22:40.690404+0000","last_undegraded":"2024-09-15T12:22:40.690404+0000","last_fullsized":"2024-09-15T12:22:40.690404+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":33856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":94,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.298927+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:22:40.298927+0000","last_peered":"2024-09-15T12:22:40.298927+0000","last_clean":"2024-09-15T12:22:40.298927+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:22:40.298927+0000","last_undegraded":"2024-09-15T12:22:40.298927+0000","last_fullsized":"2024-09-15T12:22:40.298927+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"41'560","reported_seq":593,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.358895+0000","last_change":"2024-09-15T12:22:00.394121+0000","last_active":"2024-09-15T12:22:40.358895+0000","last_peered":"2024-09-15T12:22:40.358895+0000","last_clean":"2024-09-15T12:22:40.358895+0000","last_became_active":"2024-09-15T12:22:00.388183+0000","last_became_peered":"2024-09-15T12:22:00.388183+0000","last_unstale":"2024-09-15T12:22:40.358895+0000","last_undegraded":"2024-09-15T12:22:40.358895+0000","last_fullsized":"2024-09-15T12:22:40.358895+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36700160,"num_objects":560,"num_object_clones":0,"num_object_copies":1680,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":35840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":94,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.304824+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:22:40.304824+0000","last_peered":"2024-09-15T12:22:40.304824+0000","last_clean":"2024-09-15T12:22:40.304824+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:22:40.304824+0000","last_undegraded":"2024-09-15T12:22:40.304824+0000","last_fullsized":"2024-09-15T12:22:40.304824+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":560070656,"num_objects":8546,"num_object_clones":0,"num_object_copies":25638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8546,"num_write_kb":546944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":105496576,"data_stored":1687945216,"data_compressed":80149342,"data_compressed_allocated":105496576,"data_compressed_original":1687945216,"omap_allocated":0,"internal_metadata":0},"log_size":8546,"ondisk_log_size":8546,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673199,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":77636,"kb_used_data":28596,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94294204,"statfs":{"total":96636764160,"available":96557264896,"internally_reserved":0,"allocated":29282304,"data_stored":462612606,"data_compressed":21962492,"data_compressed_allocated":28909568,"data_compressed_original":462471168,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74444,"kb_used_data":21240,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94297396,"statfs":{"total":96636764160,"available":96560533504,"internally_reserved":0,"allocated":21749760,"data_stored":342281983,"data_compressed":16249098,"data_compressed_allocated":21389312,"data_compressed_original":342147072,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":76864,"kb_used_data":27824,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94294976,"statfs":{"total":96636764160,"available":96558055424,"internally_reserved":0,"allocated":28491776,"data_stored":450419112,"data_compressed":21381651,"data_compressed_allocated":28143616,"data_compressed_original":450297856,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":78996,"kb_used_data":25792,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94292844,"statfs":{"total":96636764160,"available":96555872256,"internally_reserved":0,"allocated":26411008,"data_stored":416861951,"data_compressed":19790397,"data_compressed_allocated":26050560,"data_compressed_original":416727040,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26300416,"data_stored":420806656,"data_compressed":19981317,"data_compressed_allocated":26300416,"data_compressed_original":420806656,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28401664,"data_stored":454426624,"data_compressed":21577707,"data_compressed_allocated":28401664,"data_compressed_original":454426624,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21622784,"data_stored":345964544,"data_compressed":16427570,"data_compressed_allocated":21622784,"data_compressed_original":345964544,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29171712,"data_stored":466747392,"data_compressed":22162748,"data_compressed_allocated":29171712,"data_compressed_original":466747392,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:22:53.454 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-15T12:22:53.454 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:22:53.454 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:22:53.454 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:22:53.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:53.616+0000 7fdf0fcd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:53.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:53.631+0000 7fdf0fcd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:53.843 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:22:53.843 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:22:53.843 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:22:53.843 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:22:53.843 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:22:53.843 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:22:53.843 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:22:53.843 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:22:53.843 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:22:53.843 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:22:53.843 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:22:53.844 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:22:53.848 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:22:53.849 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:22:53.849 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:22:54.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:54.010+0000 7fc5630fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:54.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:54.031+0000 7fc5630fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:54.222 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:22:54.222 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:22:54.222 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:22:54.222 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:22:54.222 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:22:54.222 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:22:54.223 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:22:54.223 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:22:54.223 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:22:54.223 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:22:54.223 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:22:54.223 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:22:54.228 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:22:54.228 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:22:54.228 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:22:54.340 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 53 16 11244 11228 13.2394 12.75 0.0769594 0.075489 2024-09-15T12:22:54.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:54.395+0000 7fe13d551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:54.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:54.412+0000 7fe13d551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:54.454 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:22:54.454 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:22:54.454 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:22:54.454 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:22:54.455 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:22:54.455 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:22:54.455 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:22:54.455 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:22:54.455 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:22:54.455 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:22:54.455 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:22:54.455 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:22:54.460 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:22:54.460 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:22:54.460 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:22:54.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:54.618+0000 7f11e72bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:54.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:54.640+0000 7f11e72bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:54.814 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:22:54.814 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:22:54.814 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:22:54.814 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:22:54.814 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:22:54.814 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:22:54.814 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:22:54.814 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:22:54.815 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:22:54.815 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:22:54.815 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:22:54.815 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:22:54.817 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:22:54.818 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:22:55.138 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:22:55.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:55.297+0000 7fd79ab51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:55.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:55.305+0000 7fd79ab51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:55.341 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 54 16 11427 11411 13.206 11.4375 0.0792477 0.0756572 2024-09-15T12:22:56.341 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 55 16 11622 11606 13.1874 12.1875 0.065415 0.075768 2024-09-15T12:22:57.341 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 56 16 11819 11803 13.1718 12.3125 0.0944069 0.0758499 2024-09-15T12:22:57.619 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:22:57.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:57.784+0000 7fc909b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:57.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:57.791+0000 7fc909b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:58.341 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 57 16 12005 11989 13.1446 11.625 0.0631369 0.0760116 2024-09-15T12:22:59.341 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 58 16 12215 12199 13.1443 13.125 0.0777053 0.0760301 2024-09-15T12:22:59.819 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:22:59.819 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:22:59.819 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:22:59.820 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:22:59.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:59.978+0000 7f1993abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:22:59.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:22:59.991+0000 7f1993abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:00.207 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:23:00.208 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:23:00.208 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:23:00.208 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:23:00.208 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:23:00.208 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:23:00.208 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:23:00.208 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:23:00.208 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:23:00.208 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:23:00.208 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:23:00.208 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:23:00.212 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:23:00.213 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:23:00.213 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:23:00.343 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 59 16 12391 12375 13.1075 11 0.14095 0.0762107 2024-09-15T12:23:00.363 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:23:00.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:00.384+0000 7f9c13591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:00.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:00.400+0000 7f9c13591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:00.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:00.520+0000 7f5cc2f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:00.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:00.530+0000 7f5cc2f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:00.613 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:23:00.613 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:23:00.613 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:23:00.613 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:23:00.614 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:23:00.614 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:23:00.614 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:23:00.614 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:23:00.614 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:23:00.614 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:23:00.614 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:23:00.614 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:23:00.617 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:23:00.618 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:23:00.618 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:23:00.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:00.818+0000 7fea48f48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:00.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:00.837+0000 7fea48f48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:00.897 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:23:00.897 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:23:00.897 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:23:00.898 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:23:00.898 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:23:00.898 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:23:00.898 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:23:00.898 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:23:00.898 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:23:00.898 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:23:00.898 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:23:00.898 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:23:00.903 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:23:00.903 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:23:00.904 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:23:01.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:01.050+0000 7f2b5b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:01.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:01.065+0000 7f2b5b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:01.279 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:23:01.280 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:23:01.280 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:23:01.280 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:23:01.280 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:23:01.280 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:23:01.280 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:23:01.280 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:23:01.280 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:23:01.280 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:23:01.280 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:23:01.280 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:23:01.283 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:23:01.284 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:23:01.343 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:2024-09-15T12:23:01.342746+0000 min lat: 0.0169163 max lat: 0.203393 avg lat: 0.0763711 2024-09-15T12:23:01.343 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-15T12:23:01.343 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 60 16 12577 12561 13.0828 11.625 0.0951724 0.0763711 2024-09-15T12:23:02.343 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 61 16 12779 12763 13.0753 12.625 0.0924426 0.0764233 2024-09-15T12:23:03.059 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:23:03.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:03.220+0000 7feb8fe88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:03.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:03.236+0000 7feb8fe88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:03.343 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 62 16 12976 12960 13.063 12.3125 0.0874559 0.0765111 2024-09-15T12:23:04.343 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 63 16 13168 13152 13.0461 12 0.0734083 0.0766032 2024-09-15T12:23:05.343 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 64 16 13368 13352 13.0375 12.5 0.0685874 0.0766674 2024-09-15T12:23:05.742 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:23:05.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:05.906+0000 7f4a4d65c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:05.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:05.918+0000 7f4a4d65c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:06.285 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:23:06.285 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:23:06.286 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:23:06.343 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 65 16 13553 13537 13.0148 11.5625 0.0408071 0.0767411 2024-09-15T12:23:06.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:06.447+0000 7f075e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:06.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:06.463+0000 7f075e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:06.754 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:23:06.754 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:23:06.779 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":171,"stamp":"2024-09-15T12:23:05.754855+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":560661043,"num_objects":8550,"num_object_clones":0,"num_object_copies":25650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":8627,"num_write_kb":548052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8601,"ondisk_log_size":8601,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":307940,"kb_used_data":103452,"kb_used_omap":0,"kb_used_meta":204416,"kb_avail":377179420,"statfs":{"total":386547056640,"available":386231726080,"internally_reserved":0,"allocated":105934848,"data_stored":1672175652,"data_compressed":79383638,"data_compressed_allocated":104493056,"data_compressed_original":1671643136,"omap_allocated":0,"internal_metadata":209321984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002297"},"pg_stats":[{"pgid":"4.f","version":"41'543","reported_seq":576,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.587715+0000","last_change":"2024-09-15T12:22:00.377854+0000","last_active":"2024-09-15T12:22:40.587715+0000","last_peered":"2024-09-15T12:22:40.587715+0000","last_clean":"2024-09-15T12:22:40.587715+0000","last_became_active":"2024-09-15T12:22:00.359790+0000","last_became_peered":"2024-09-15T12:22:00.359790+0000","last_unstale":"2024-09-15T12:22:40.587715+0000","last_undegraded":"2024-09-15T12:22:40.587715+0000","last_fullsized":"2024-09-15T12:22:40.587715+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35586048,"num_objects":543,"num_object_clones":0,"num_object_copies":1629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":543,"num_write_kb":34752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"41'542","reported_seq":575,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.596341+0000","last_change":"2024-09-15T12:22:00.383291+0000","last_active":"2024-09-15T12:22:40.596341+0000","last_peered":"2024-09-15T12:22:40.596341+0000","last_clean":"2024-09-15T12:22:40.596341+0000","last_became_active":"2024-09-15T12:22:00.376330+0000","last_became_peered":"2024-09-15T12:22:00.376330+0000","last_unstale":"2024-09-15T12:22:40.596341+0000","last_undegraded":"2024-09-15T12:22:40.596341+0000","last_fullsized":"2024-09-15T12:22:40.596341+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35520512,"num_objects":542,"num_object_clones":0,"num_object_copies":1626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":542,"num_write_kb":34688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"41'553","reported_seq":586,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.645107+0000","last_change":"2024-09-15T12:22:00.413467+0000","last_active":"2024-09-15T12:22:40.645107+0000","last_peered":"2024-09-15T12:22:40.645107+0000","last_clean":"2024-09-15T12:22:40.645107+0000","last_became_active":"2024-09-15T12:22:00.399293+0000","last_became_peered":"2024-09-15T12:22:00.399293+0000","last_unstale":"2024-09-15T12:22:40.645107+0000","last_undegraded":"2024-09-15T12:22:40.645107+0000","last_fullsized":"2024-09-15T12:22:40.645107+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36241408,"num_objects":553,"num_object_clones":0,"num_object_copies":1659,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":553,"num_write_kb":35392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"42'548","reported_seq":584,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T12:22:41.771786+0000","last_change":"2024-09-15T12:22:00.397700+0000","last_active":"2024-09-15T12:22:41.771786+0000","last_peered":"2024-09-15T12:22:41.771786+0000","last_clean":"2024-09-15T12:22:41.771786+0000","last_became_active":"2024-09-15T12:22:00.388314+0000","last_became_peered":"2024-09-15T12:22:00.388314+0000","last_unstale":"2024-09-15T12:22:41.771786+0000","last_undegraded":"2024-09-15T12:22:41.771786+0000","last_fullsized":"2024-09-15T12:22:41.771786+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":548,"log_dups_size":0,"ondisk_log_size":548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35913728,"num_objects":548,"num_object_clones":0,"num_object_copies":1644,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":548,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"41'497","reported_seq":530,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.686178+0000","last_change":"2024-09-15T12:22:00.418610+0000","last_active":"2024-09-15T12:22:40.686178+0000","last_peered":"2024-09-15T12:22:40.686178+0000","last_clean":"2024-09-15T12:22:40.686178+0000","last_became_active":"2024-09-15T12:22:00.404352+0000","last_became_peered":"2024-09-15T12:22:00.404352+0000","last_unstale":"2024-09-15T12:22:40.686178+0000","last_undegraded":"2024-09-15T12:22:40.686178+0000","last_fullsized":"2024-09-15T12:22:40.686178+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32571392,"num_objects":497,"num_object_clones":0,"num_object_copies":1491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":497,"num_write_kb":31808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"41'516","reported_seq":549,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.699702+0000","last_change":"2024-09-15T12:22:00.408893+0000","last_active":"2024-09-15T12:22:40.699702+0000","last_peered":"2024-09-15T12:22:40.699702+0000","last_clean":"2024-09-15T12:22:40.699702+0000","last_became_active":"2024-09-15T12:22:00.399557+0000","last_became_peered":"2024-09-15T12:22:00.399557+0000","last_unstale":"2024-09-15T12:22:40.699702+0000","last_undegraded":"2024-09-15T12:22:40.699702+0000","last_fullsized":"2024-09-15T12:22:40.699702+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":516,"log_dups_size":0,"ondisk_log_size":516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33816576,"num_objects":516,"num_object_clones":0,"num_object_copies":1548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":516,"num_write_kb":33024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"41'556","reported_seq":589,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.553546+0000","last_change":"2024-09-15T12:22:00.458263+0000","last_active":"2024-09-15T12:22:40.553546+0000","last_peered":"2024-09-15T12:22:40.553546+0000","last_clean":"2024-09-15T12:22:40.553546+0000","last_became_active":"2024-09-15T12:22:00.446629+0000","last_became_peered":"2024-09-15T12:22:00.446629+0000","last_unstale":"2024-09-15T12:22:40.553546+0000","last_undegraded":"2024-09-15T12:22:40.553546+0000","last_fullsized":"2024-09-15T12:22:40.553546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36438016,"num_objects":556,"num_object_clones":0,"num_object_copies":1668,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":556,"num_write_kb":35584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"41'545","reported_seq":578,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.586804+0000","last_change":"2024-09-15T12:22:00.432607+0000","last_active":"2024-09-15T12:22:40.586804+0000","last_peered":"2024-09-15T12:22:40.586804+0000","last_clean":"2024-09-15T12:22:40.586804+0000","last_became_active":"2024-09-15T12:22:00.422177+0000","last_became_peered":"2024-09-15T12:22:00.422177+0000","last_unstale":"2024-09-15T12:22:40.586804+0000","last_undegraded":"2024-09-15T12:22:40.586804+0000","last_fullsized":"2024-09-15T12:22:40.586804+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35717120,"num_objects":545,"num_object_clones":0,"num_object_copies":1635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":545,"num_write_kb":34880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"41'528","reported_seq":561,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.651148+0000","last_change":"2024-09-15T12:22:00.420197+0000","last_active":"2024-09-15T12:22:40.651148+0000","last_peered":"2024-09-15T12:22:40.651148+0000","last_clean":"2024-09-15T12:22:40.651148+0000","last_became_active":"2024-09-15T12:22:00.406666+0000","last_became_peered":"2024-09-15T12:22:00.406666+0000","last_unstale":"2024-09-15T12:22:40.651148+0000","last_undegraded":"2024-09-15T12:22:40.651148+0000","last_fullsized":"2024-09-15T12:22:40.651148+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34603008,"num_objects":528,"num_object_clones":0,"num_object_copies":1584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":528,"num_write_kb":33792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":169,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T12:22:41.285455+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:22:41.285455+0000","last_peered":"2024-09-15T12:22:41.285455+0000","last_clean":"2024-09-15T12:22:41.285455+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:22:41.285455+0000","last_undegraded":"2024-09-15T12:22:41.285455+0000","last_fullsized":"2024-09-15T12:22:41.285455+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":95,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.313486+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:22:40.313486+0000","last_peered":"2024-09-15T12:22:40.313486+0000","last_clean":"2024-09-15T12:22:40.313486+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:22:40.313486+0000","last_undegraded":"2024-09-15T12:22:40.313486+0000","last_fullsized":"2024-09-15T12:22:40.313486+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"41'552","reported_seq":585,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.626033+0000","last_change":"2024-09-15T12:22:00.381165+0000","last_active":"2024-09-15T12:22:40.626033+0000","last_peered":"2024-09-15T12:22:40.626033+0000","last_clean":"2024-09-15T12:22:40.626033+0000","last_became_active":"2024-09-15T12:22:00.374145+0000","last_became_peered":"2024-09-15T12:22:00.374145+0000","last_unstale":"2024-09-15T12:22:40.626033+0000","last_undegraded":"2024-09-15T12:22:40.626033+0000","last_fullsized":"2024-09-15T12:22:40.626033+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36175872,"num_objects":552,"num_object_clones":0,"num_object_copies":1656,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":35328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":94,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.318562+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:22:40.318562+0000","last_peered":"2024-09-15T12:22:40.318562+0000","last_clean":"2024-09-15T12:22:40.318562+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:22:40.318562+0000","last_undegraded":"2024-09-15T12:22:40.318562+0000","last_fullsized":"2024-09-15T12:22:40.318562+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"41'496","reported_seq":529,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.710009+0000","last_change":"2024-09-15T12:22:00.405131+0000","last_active":"2024-09-15T12:22:40.710009+0000","last_peered":"2024-09-15T12:22:40.710009+0000","last_clean":"2024-09-15T12:22:40.710009+0000","last_became_active":"2024-09-15T12:22:00.398288+0000","last_became_peered":"2024-09-15T12:22:00.398288+0000","last_unstale":"2024-09-15T12:22:40.710009+0000","last_undegraded":"2024-09-15T12:22:40.710009+0000","last_fullsized":"2024-09-15T12:22:40.710009+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32505856,"num_objects":496,"num_object_clones":0,"num_object_copies":1488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":496,"num_write_kb":31744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":94,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.294473+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:22:40.294473+0000","last_peered":"2024-09-15T12:22:40.294473+0000","last_clean":"2024-09-15T12:22:40.294473+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:22:40.294473+0000","last_undegraded":"2024-09-15T12:22:40.294473+0000","last_fullsized":"2024-09-15T12:22:40.294473+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"41'540","reported_seq":573,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.738388+0000","last_change":"2024-09-15T12:22:00.390143+0000","last_active":"2024-09-15T12:22:40.738388+0000","last_peered":"2024-09-15T12:22:40.738388+0000","last_clean":"2024-09-15T12:22:40.738388+0000","last_became_active":"2024-09-15T12:22:00.370049+0000","last_became_peered":"2024-09-15T12:22:00.370049+0000","last_unstale":"2024-09-15T12:22:40.738388+0000","last_undegraded":"2024-09-15T12:22:40.738388+0000","last_fullsized":"2024-09-15T12:22:40.738388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35389440,"num_objects":540,"num_object_clones":0,"num_object_copies":1620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":540,"num_write_kb":34560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":96,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.317662+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:22:40.317662+0000","last_peered":"2024-09-15T12:22:40.317662+0000","last_clean":"2024-09-15T12:22:40.317662+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:22:40.317662+0000","last_undegraded":"2024-09-15T12:22:40.317662+0000","last_fullsized":"2024-09-15T12:22:40.317662+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"41'515","reported_seq":548,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.713666+0000","last_change":"2024-09-15T12:22:00.450159+0000","last_active":"2024-09-15T12:22:40.713666+0000","last_peered":"2024-09-15T12:22:40.713666+0000","last_clean":"2024-09-15T12:22:40.713666+0000","last_became_active":"2024-09-15T12:22:00.437056+0000","last_became_peered":"2024-09-15T12:22:00.437056+0000","last_unstale":"2024-09-15T12:22:40.713666+0000","last_undegraded":"2024-09-15T12:22:40.713666+0000","last_fullsized":"2024-09-15T12:22:40.713666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33751040,"num_objects":515,"num_object_clones":0,"num_object_copies":1545,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":515,"num_write_kb":32960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":94,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.296473+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:22:40.296473+0000","last_peered":"2024-09-15T12:22:40.296473+0000","last_clean":"2024-09-15T12:22:40.296473+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:22:40.296473+0000","last_undegraded":"2024-09-15T12:22:40.296473+0000","last_fullsized":"2024-09-15T12:22:40.296473+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"41'526","reported_seq":559,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.635508+0000","last_change":"2024-09-15T12:22:00.364579+0000","last_active":"2024-09-15T12:22:40.635508+0000","last_peered":"2024-09-15T12:22:40.635508+0000","last_clean":"2024-09-15T12:22:40.635508+0000","last_became_active":"2024-09-15T12:22:00.353614+0000","last_became_peered":"2024-09-15T12:22:00.353614+0000","last_unstale":"2024-09-15T12:22:40.635508+0000","last_undegraded":"2024-09-15T12:22:40.635508+0000","last_fullsized":"2024-09-15T12:22:40.635508+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34471936,"num_objects":526,"num_object_clones":0,"num_object_copies":1578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":526,"num_write_kb":33664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T12:22:41.291379+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:22:41.291379+0000","last_peered":"2024-09-15T12:22:41.291379+0000","last_clean":"2024-09-15T12:22:41.291379+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:22:41.291379+0000","last_undegraded":"2024-09-15T12:22:41.291379+0000","last_fullsized":"2024-09-15T12:22:41.291379+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"41'529","reported_seq":562,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.690404+0000","last_change":"2024-09-15T12:22:00.384094+0000","last_active":"2024-09-15T12:22:40.690404+0000","last_peered":"2024-09-15T12:22:40.690404+0000","last_clean":"2024-09-15T12:22:40.690404+0000","last_became_active":"2024-09-15T12:22:00.377789+0000","last_became_peered":"2024-09-15T12:22:00.377789+0000","last_unstale":"2024-09-15T12:22:40.690404+0000","last_undegraded":"2024-09-15T12:22:40.690404+0000","last_fullsized":"2024-09-15T12:22:40.690404+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":529,"log_dups_size":0,"ondisk_log_size":529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34668544,"num_objects":529,"num_object_clones":0,"num_object_copies":1587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":529,"num_write_kb":33856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":94,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.298927+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:22:40.298927+0000","last_peered":"2024-09-15T12:22:40.298927+0000","last_clean":"2024-09-15T12:22:40.298927+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:22:40.298927+0000","last_undegraded":"2024-09-15T12:22:40.298927+0000","last_fullsized":"2024-09-15T12:22:40.298927+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"41'560","reported_seq":593,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.358895+0000","last_change":"2024-09-15T12:22:00.394121+0000","last_active":"2024-09-15T12:22:40.358895+0000","last_peered":"2024-09-15T12:22:40.358895+0000","last_clean":"2024-09-15T12:22:40.358895+0000","last_became_active":"2024-09-15T12:22:00.388183+0000","last_became_peered":"2024-09-15T12:22:00.388183+0000","last_unstale":"2024-09-15T12:22:40.358895+0000","last_undegraded":"2024-09-15T12:22:40.358895+0000","last_fullsized":"2024-09-15T12:22:40.358895+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36700160,"num_objects":560,"num_object_clones":0,"num_object_copies":1680,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":560,"num_write_kb":35840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":94,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-15T12:22:40.304824+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:22:40.304824+0000","last_peered":"2024-09-15T12:22:40.304824+0000","last_clean":"2024-09-15T12:22:40.304824+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:22:40.304824+0000","last_undegraded":"2024-09-15T12:22:40.304824+0000","last_fullsized":"2024-09-15T12:22:40.304824+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":560070656,"num_objects":8546,"num_object_clones":0,"num_object_copies":25638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8546,"num_write_kb":546944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":105496576,"data_stored":1687945216,"data_compressed":80149342,"data_compressed_allocated":105496576,"data_compressed_original":1687945216,"omap_allocated":0,"internal_metadata":0},"log_size":8546,"ondisk_log_size":8546,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673199,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":77636,"kb_used_data":28596,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94294204,"statfs":{"total":96636764160,"available":96557264896,"internally_reserved":0,"allocated":29282304,"data_stored":462612606,"data_compressed":21962492,"data_compressed_allocated":28909568,"data_compressed_original":462471168,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74444,"kb_used_data":21240,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94297396,"statfs":{"total":96636764160,"available":96560533504,"internally_reserved":0,"allocated":21749760,"data_stored":342281983,"data_compressed":16249098,"data_compressed_allocated":21389312,"data_compressed_original":342147072,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":76864,"kb_used_data":27824,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94294976,"statfs":{"total":96636764160,"available":96558055424,"internally_reserved":0,"allocated":28491776,"data_stored":450419112,"data_compressed":21381651,"data_compressed_allocated":28143616,"data_compressed_original":450297856,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":78996,"kb_used_data":25792,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94292844,"statfs":{"total":96636764160,"available":96555872256,"internally_reserved":0,"allocated":26411008,"data_stored":416861951,"data_compressed":19790397,"data_compressed_allocated":26050560,"data_compressed_original":416727040,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26300416,"data_stored":420806656,"data_compressed":19981317,"data_compressed_allocated":26300416,"data_compressed_original":420806656,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28401664,"data_stored":454426624,"data_compressed":21577707,"data_compressed_allocated":28401664,"data_compressed_original":454426624,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21622784,"data_stored":345964544,"data_compressed":16427570,"data_compressed_allocated":21622784,"data_compressed_original":345964544,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29171712,"data_stored":466747392,"data_compressed":22162748,"data_compressed_allocated":29171712,"data_compressed_original":466747392,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:23:07.343 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 66 16 13740 13724 12.9947 11.6875 0.0543295 0.0769085 2024-09-15T12:23:08.344 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 67 16 13939 13923 12.9863 12.4375 0.0674585 0.0769502 2024-09-15T12:23:08.442 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:23:08.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:08.596+0000 7f1a264ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:08.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:08.607+0000 7f1a264ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:09.344 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 68 16 14132 14116 12.9727 12.0625 0.0716325 0.0770389 2024-09-15T12:23:10.344 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 69 16 14327 14311 12.9613 12.1875 0.110561 0.0770869 2024-09-15T12:23:11.180 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:23:11.344 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 70 16 14524 14508 12.9521 12.3125 0.059382 0.0771438 2024-09-15T12:23:11.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:11.346+0000 7f57da991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:11.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:11.357+0000 7f57da991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:11.781 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:23:11.782 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:23:11.782 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:23:11.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:11.944+0000 7f8851afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:11.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:11.956+0000 7f8851afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:12.285 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:23:12.286 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:23:12.308 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2024-09-15T12:23:11.756177+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":921764403,"num_objects":14060,"num_object_clones":0,"num_object_copies":42180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":14137,"num_write_kb":900692,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14111,"ondisk_log_size":14111,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":355316,"kb_used_data":154996,"kb_used_omap":0,"kb_used_meta":200256,"kb_avail":377132044,"statfs":{"total":386547056640,"available":386183213056,"internally_reserved":0,"allocated":158715904,"data_stored":2514499965,"data_compressed":119379060,"data_compressed_allocated":157134848,"data_compressed_original":2513911808,"omap_allocated":0,"internal_metadata":205062144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":361103360,"num_objects":5510,"num_object_clones":0,"num_object_copies":16530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5510,"num_write_kb":352640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002464"},"pg_stats":[{"pgid":"4.f","version":"46'919","reported_seq":967,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.728004+0000","last_change":"2024-09-15T12:22:00.377854+0000","last_active":"2024-09-15T12:23:10.728004+0000","last_peered":"2024-09-15T12:23:10.728004+0000","last_clean":"2024-09-15T12:23:10.728004+0000","last_became_active":"2024-09-15T12:22:00.359790+0000","last_became_peered":"2024-09-15T12:22:00.359790+0000","last_unstale":"2024-09-15T12:23:10.728004+0000","last_undegraded":"2024-09-15T12:23:10.728004+0000","last_fullsized":"2024-09-15T12:23:10.728004+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":919,"log_dups_size":0,"ondisk_log_size":919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60227584,"num_objects":919,"num_object_clones":0,"num_object_copies":2757,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":919,"num_write_kb":58816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"46'888","reported_seq":936,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.668940+0000","last_change":"2024-09-15T12:22:00.383291+0000","last_active":"2024-09-15T12:23:10.668940+0000","last_peered":"2024-09-15T12:23:10.668940+0000","last_clean":"2024-09-15T12:23:10.668940+0000","last_became_active":"2024-09-15T12:22:00.376330+0000","last_became_peered":"2024-09-15T12:22:00.376330+0000","last_unstale":"2024-09-15T12:23:10.668940+0000","last_undegraded":"2024-09-15T12:23:10.668940+0000","last_fullsized":"2024-09-15T12:23:10.668940+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58195968,"num_objects":888,"num_object_clones":0,"num_object_copies":2664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":56832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"46'930","reported_seq":978,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.560765+0000","last_change":"2024-09-15T12:22:00.413467+0000","last_active":"2024-09-15T12:23:10.560765+0000","last_peered":"2024-09-15T12:23:10.560765+0000","last_clean":"2024-09-15T12:23:10.560765+0000","last_became_active":"2024-09-15T12:22:00.399293+0000","last_became_peered":"2024-09-15T12:22:00.399293+0000","last_unstale":"2024-09-15T12:23:10.560765+0000","last_undegraded":"2024-09-15T12:23:10.560765+0000","last_fullsized":"2024-09-15T12:23:10.560765+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":930,"log_dups_size":0,"ondisk_log_size":930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60948480,"num_objects":930,"num_object_clones":0,"num_object_copies":2790,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":930,"num_write_kb":59520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"42'548","reported_seq":584,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T12:22:41.771786+0000","last_change":"2024-09-15T12:22:00.397700+0000","last_active":"2024-09-15T12:22:41.771786+0000","last_peered":"2024-09-15T12:22:41.771786+0000","last_clean":"2024-09-15T12:22:41.771786+0000","last_became_active":"2024-09-15T12:22:00.388314+0000","last_became_peered":"2024-09-15T12:22:00.388314+0000","last_unstale":"2024-09-15T12:22:41.771786+0000","last_undegraded":"2024-09-15T12:22:41.771786+0000","last_fullsized":"2024-09-15T12:22:41.771786+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":548,"log_dups_size":0,"ondisk_log_size":548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35913728,"num_objects":548,"num_object_clones":0,"num_object_copies":1644,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":548,"num_write_kb":35072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"46'835","reported_seq":883,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.283424+0000","last_change":"2024-09-15T12:22:00.418610+0000","last_active":"2024-09-15T12:23:10.283424+0000","last_peered":"2024-09-15T12:23:10.283424+0000","last_clean":"2024-09-15T12:23:10.283424+0000","last_became_active":"2024-09-15T12:22:00.404352+0000","last_became_peered":"2024-09-15T12:22:00.404352+0000","last_unstale":"2024-09-15T12:23:10.283424+0000","last_undegraded":"2024-09-15T12:23:10.283424+0000","last_fullsized":"2024-09-15T12:23:10.283424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54722560,"num_objects":835,"num_object_clones":0,"num_object_copies":2505,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":835,"num_write_kb":53440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"46'881","reported_seq":929,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.596733+0000","last_change":"2024-09-15T12:22:00.408893+0000","last_active":"2024-09-15T12:23:10.596733+0000","last_peered":"2024-09-15T12:23:10.596733+0000","last_clean":"2024-09-15T12:23:10.596733+0000","last_became_active":"2024-09-15T12:22:00.399557+0000","last_became_peered":"2024-09-15T12:22:00.399557+0000","last_unstale":"2024-09-15T12:23:10.596733+0000","last_undegraded":"2024-09-15T12:23:10.596733+0000","last_fullsized":"2024-09-15T12:23:10.596733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57737216,"num_objects":881,"num_object_clones":0,"num_object_copies":2643,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":881,"num_write_kb":56384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"46'931","reported_seq":979,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.597932+0000","last_change":"2024-09-15T12:22:00.458263+0000","last_active":"2024-09-15T12:23:10.597932+0000","last_peered":"2024-09-15T12:23:10.597932+0000","last_clean":"2024-09-15T12:23:10.597932+0000","last_became_active":"2024-09-15T12:22:00.446629+0000","last_became_peered":"2024-09-15T12:22:00.446629+0000","last_unstale":"2024-09-15T12:23:10.597932+0000","last_undegraded":"2024-09-15T12:23:10.597932+0000","last_fullsized":"2024-09-15T12:23:10.597932+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":931,"log_dups_size":0,"ondisk_log_size":931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61014016,"num_objects":931,"num_object_clones":0,"num_object_copies":2793,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":931,"num_write_kb":59584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"46'941","reported_seq":989,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.708141+0000","last_change":"2024-09-15T12:22:00.432607+0000","last_active":"2024-09-15T12:23:10.708141+0000","last_peered":"2024-09-15T12:23:10.708141+0000","last_clean":"2024-09-15T12:23:10.708141+0000","last_became_active":"2024-09-15T12:22:00.422177+0000","last_became_peered":"2024-09-15T12:22:00.422177+0000","last_unstale":"2024-09-15T12:23:10.708141+0000","last_undegraded":"2024-09-15T12:23:10.708141+0000","last_fullsized":"2024-09-15T12:23:10.708141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":941,"log_dups_size":0,"ondisk_log_size":941,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61669376,"num_objects":941,"num_object_clones":0,"num_object_copies":2823,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":941,"num_write_kb":60224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"46'867","reported_seq":915,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.671056+0000","last_change":"2024-09-15T12:22:00.420197+0000","last_active":"2024-09-15T12:23:10.671056+0000","last_peered":"2024-09-15T12:23:10.671056+0000","last_clean":"2024-09-15T12:23:10.671056+0000","last_became_active":"2024-09-15T12:22:00.406666+0000","last_became_peered":"2024-09-15T12:22:00.406666+0000","last_unstale":"2024-09-15T12:23:10.671056+0000","last_undegraded":"2024-09-15T12:23:10.671056+0000","last_fullsized":"2024-09-15T12:23:10.671056+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56819712,"num_objects":867,"num_object_clones":0,"num_object_copies":2601,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":867,"num_write_kb":55488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":169,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T12:22:41.285455+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:22:41.285455+0000","last_peered":"2024-09-15T12:22:41.285455+0000","last_clean":"2024-09-15T12:22:41.285455+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:22:41.285455+0000","last_undegraded":"2024-09-15T12:22:41.285455+0000","last_fullsized":"2024-09-15T12:22:41.285455+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":110,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.305678+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:22:52.305678+0000","last_peered":"2024-09-15T12:22:52.305678+0000","last_clean":"2024-09-15T12:22:52.305678+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:22:52.305678+0000","last_undegraded":"2024-09-15T12:22:52.305678+0000","last_fullsized":"2024-09-15T12:22:52.305678+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"46'896","reported_seq":944,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.618027+0000","last_change":"2024-09-15T12:22:00.381165+0000","last_active":"2024-09-15T12:23:10.618027+0000","last_peered":"2024-09-15T12:23:10.618027+0000","last_clean":"2024-09-15T12:23:10.618027+0000","last_became_active":"2024-09-15T12:22:00.374145+0000","last_became_peered":"2024-09-15T12:22:00.374145+0000","last_unstale":"2024-09-15T12:23:10.618027+0000","last_undegraded":"2024-09-15T12:23:10.618027+0000","last_fullsized":"2024-09-15T12:23:10.618027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":896,"log_dups_size":0,"ondisk_log_size":896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":896,"num_object_clones":0,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.321345+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:22:52.321345+0000","last_peered":"2024-09-15T12:22:52.321345+0000","last_clean":"2024-09-15T12:22:52.321345+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:22:52.321345+0000","last_undegraded":"2024-09-15T12:22:52.321345+0000","last_fullsized":"2024-09-15T12:22:52.321345+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"46'873","reported_seq":921,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.559123+0000","last_change":"2024-09-15T12:22:00.405131+0000","last_active":"2024-09-15T12:23:10.559123+0000","last_peered":"2024-09-15T12:23:10.559123+0000","last_clean":"2024-09-15T12:23:10.559123+0000","last_became_active":"2024-09-15T12:22:00.398288+0000","last_became_peered":"2024-09-15T12:22:00.398288+0000","last_unstale":"2024-09-15T12:23:10.559123+0000","last_undegraded":"2024-09-15T12:23:10.559123+0000","last_fullsized":"2024-09-15T12:23:10.559123+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":873,"log_dups_size":0,"ondisk_log_size":873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57212928,"num_objects":873,"num_object_clones":0,"num_object_copies":2619,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":873,"num_write_kb":55872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.299731+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:22:52.299731+0000","last_peered":"2024-09-15T12:22:52.299731+0000","last_clean":"2024-09-15T12:22:52.299731+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:22:52.299731+0000","last_undegraded":"2024-09-15T12:22:52.299731+0000","last_fullsized":"2024-09-15T12:22:52.299731+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"46'933","reported_seq":981,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.515657+0000","last_change":"2024-09-15T12:22:00.390143+0000","last_active":"2024-09-15T12:23:10.515657+0000","last_peered":"2024-09-15T12:23:10.515657+0000","last_clean":"2024-09-15T12:23:10.515657+0000","last_became_active":"2024-09-15T12:22:00.370049+0000","last_became_peered":"2024-09-15T12:22:00.370049+0000","last_unstale":"2024-09-15T12:23:10.515657+0000","last_undegraded":"2024-09-15T12:23:10.515657+0000","last_fullsized":"2024-09-15T12:23:10.515657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":933,"log_dups_size":0,"ondisk_log_size":933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61145088,"num_objects":933,"num_object_clones":0,"num_object_copies":2799,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":933,"num_write_kb":59712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":111,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.312250+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:22:52.312250+0000","last_peered":"2024-09-15T12:22:52.312250+0000","last_clean":"2024-09-15T12:22:52.312250+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:22:52.312250+0000","last_undegraded":"2024-09-15T12:22:52.312250+0000","last_fullsized":"2024-09-15T12:22:52.312250+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"46'892","reported_seq":940,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.698741+0000","last_change":"2024-09-15T12:22:00.450159+0000","last_active":"2024-09-15T12:23:10.698741+0000","last_peered":"2024-09-15T12:23:10.698741+0000","last_clean":"2024-09-15T12:23:10.698741+0000","last_became_active":"2024-09-15T12:22:00.437056+0000","last_became_peered":"2024-09-15T12:22:00.437056+0000","last_unstale":"2024-09-15T12:23:10.698741+0000","last_undegraded":"2024-09-15T12:23:10.698741+0000","last_fullsized":"2024-09-15T12:23:10.698741+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58458112,"num_objects":892,"num_object_clones":0,"num_object_copies":2676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":892,"num_write_kb":57088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.299407+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:22:52.299407+0000","last_peered":"2024-09-15T12:22:52.299407+0000","last_clean":"2024-09-15T12:22:52.299407+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:22:52.299407+0000","last_undegraded":"2024-09-15T12:22:52.299407+0000","last_fullsized":"2024-09-15T12:22:52.299407+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"46'888","reported_seq":936,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.735246+0000","last_change":"2024-09-15T12:22:00.364579+0000","last_active":"2024-09-15T12:23:10.735246+0000","last_peered":"2024-09-15T12:23:10.735246+0000","last_clean":"2024-09-15T12:23:10.735246+0000","last_became_active":"2024-09-15T12:22:00.353614+0000","last_became_peered":"2024-09-15T12:22:00.353614+0000","last_unstale":"2024-09-15T12:23:10.735246+0000","last_undegraded":"2024-09-15T12:23:10.735246+0000","last_fullsized":"2024-09-15T12:23:10.735246+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58195968,"num_objects":888,"num_object_clones":0,"num_object_copies":2664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":56832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-15T12:22:41.291379+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:22:41.291379+0000","last_peered":"2024-09-15T12:22:41.291379+0000","last_clean":"2024-09-15T12:22:41.291379+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:22:41.291379+0000","last_undegraded":"2024-09-15T12:22:41.291379+0000","last_fullsized":"2024-09-15T12:22:41.291379+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"46'910","reported_seq":958,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.636546+0000","last_change":"2024-09-15T12:22:00.384094+0000","last_active":"2024-09-15T12:23:10.636546+0000","last_peered":"2024-09-15T12:23:10.636546+0000","last_clean":"2024-09-15T12:23:10.636546+0000","last_became_active":"2024-09-15T12:22:00.377789+0000","last_became_peered":"2024-09-15T12:22:00.377789+0000","last_unstale":"2024-09-15T12:23:10.636546+0000","last_undegraded":"2024-09-15T12:23:10.636546+0000","last_fullsized":"2024-09-15T12:23:10.636546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59637760,"num_objects":910,"num_object_clones":0,"num_object_copies":2730,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":910,"num_write_kb":58240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.307644+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:22:52.307644+0000","last_peered":"2024-09-15T12:22:52.307644+0000","last_clean":"2024-09-15T12:22:52.307644+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:22:52.307644+0000","last_undegraded":"2024-09-15T12:22:52.307644+0000","last_fullsized":"2024-09-15T12:22:52.307644+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"46'924","reported_seq":972,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.724930+0000","last_change":"2024-09-15T12:22:00.394121+0000","last_active":"2024-09-15T12:23:10.724930+0000","last_peered":"2024-09-15T12:23:10.724930+0000","last_clean":"2024-09-15T12:23:10.724930+0000","last_became_active":"2024-09-15T12:22:00.388183+0000","last_became_peered":"2024-09-15T12:22:00.388183+0000","last_unstale":"2024-09-15T12:23:10.724930+0000","last_undegraded":"2024-09-15T12:23:10.724930+0000","last_fullsized":"2024-09-15T12:23:10.724930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":924,"log_dups_size":0,"ondisk_log_size":924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60555264,"num_objects":924,"num_object_clones":0,"num_object_copies":2772,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":924,"num_write_kb":59136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.313103+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:22:52.313103+0000","last_peered":"2024-09-15T12:22:52.313103+0000","last_clean":"2024-09-15T12:22:52.313103+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:22:52.313103+0000","last_undegraded":"2024-09-15T12:22:52.313103+0000","last_fullsized":"2024-09-15T12:22:52.313103+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":921174016,"num_objects":14056,"num_object_clones":0,"num_object_copies":42168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14056,"num_write_kb":899584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":158064640,"data_stored":2529034240,"data_compressed":120088748,"data_compressed_allocated":158064640,"data_compressed_original":2529034240,"omap_allocated":0,"internal_metadata":0},"log_size":14056,"ondisk_log_size":14056,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673199,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":77636,"kb_used_data":28596,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94294204,"statfs":{"total":96636764160,"available":96557264896,"internally_reserved":0,"allocated":29282304,"data_stored":462612606,"data_compressed":21962492,"data_compressed_allocated":28909568,"data_compressed_original":462471168,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":84988,"kb_used_data":35948,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94286852,"statfs":{"total":96636764160,"available":96549736448,"internally_reserved":0,"allocated":36810752,"data_stored":582491061,"data_compressed":27654577,"data_compressed_allocated":36401152,"data_compressed_original":582336512,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":96048,"kb_used_data":47008,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94275792,"statfs":{"total":96636764160,"available":96538411008,"internally_reserved":0,"allocated":48136192,"data_stored":764090773,"data_compressed":36275683,"data_compressed_allocated":47747072,"data_compressed_original":763953152,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":96644,"kb_used_data":43444,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94275196,"statfs":{"total":96636764160,"available":96537800704,"internally_reserved":0,"allocated":44486656,"data_stored":705305525,"data_compressed":33486308,"data_compressed_allocated":44077056,"data_compressed_original":705150976,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":44294144,"data_stored":708706304,"data_compressed":33652332,"data_compressed_allocated":44294144,"data_compressed_original":708706304,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":48009216,"data_stored":768147456,"data_compressed":36474851,"data_compressed_allocated":48009216,"data_compressed_original":768147456,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36589568,"data_stored":585433088,"data_compressed":27798817,"data_compressed_allocated":36589568,"data_compressed_original":585433088,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29171712,"data_stored":466747392,"data_compressed":22162748,"data_compressed_allocated":29171712,"data_compressed_original":466747392,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:23:12.344 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 71 16 14710 14694 12.9334 11.625 0.109585 0.0772572 2024-09-15T12:23:13.344 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 72 16 14895 14879 12.9143 11.5625 0.0493421 0.0773834 2024-09-15T12:23:14.035 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:23:14.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:14.177+0000 7f0c32191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:14.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:14.187+0000 7f0c32191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:14.344 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 73 16 15093 15077 12.9069 12.375 0.0727504 0.07744 2024-09-15T12:23:15.344 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 74 16 15285 15269 12.8946 12 0.0592022 0.0774984 2024-09-15T12:23:16.344 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 75 16 15471 15455 12.8777 11.625 0.0716596 0.0776003 2024-09-15T12:23:16.721 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:23:16.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:16.889+0000 7f230f0fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:16.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:16.896+0000 7f230f0fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:17.311 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:23:17.311 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:23:17.311 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:23:17.344 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 76 16 15664 15648 12.867 12.0625 0.0598817 0.0776638 2024-09-15T12:23:17.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:17.462+0000 7ffa5e591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:17.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:17.473+0000 7ffa5e591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:17.804 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:23:17.805 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:23:17.822 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2024-09-15T12:23:17.757549+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":945816115,"num_objects":14427,"num_object_clones":0,"num_object_copies":43281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":14504,"num_write_kb":924180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14478,"ondisk_log_size":14478,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":392636,"kb_used_data":174268,"kb_used_omap":0,"kb_used_meta":218304,"kb_avail":377094724,"statfs":{"total":386547056640,"available":386144997376,"internally_reserved":0,"allocated":178450432,"data_stored":2829741217,"data_compressed":134347779,"data_compressed_allocated":176836608,"data_compressed_original":2829139968,"omap_allocated":0,"internal_metadata":223543296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":385155072,"num_objects":5877,"num_object_clones":0,"num_object_copies":17631,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5877,"num_write_kb":376128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002693"},"pg_stats":[{"pgid":"4.f","version":"46'919","reported_seq":967,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.728004+0000","last_change":"2024-09-15T12:22:00.377854+0000","last_active":"2024-09-15T12:23:10.728004+0000","last_peered":"2024-09-15T12:23:10.728004+0000","last_clean":"2024-09-15T12:23:10.728004+0000","last_became_active":"2024-09-15T12:22:00.359790+0000","last_became_peered":"2024-09-15T12:22:00.359790+0000","last_unstale":"2024-09-15T12:23:10.728004+0000","last_undegraded":"2024-09-15T12:23:10.728004+0000","last_fullsized":"2024-09-15T12:23:10.728004+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":919,"log_dups_size":0,"ondisk_log_size":919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60227584,"num_objects":919,"num_object_clones":0,"num_object_copies":2757,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":919,"num_write_kb":58816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"46'888","reported_seq":936,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.668940+0000","last_change":"2024-09-15T12:22:00.383291+0000","last_active":"2024-09-15T12:23:10.668940+0000","last_peered":"2024-09-15T12:23:10.668940+0000","last_clean":"2024-09-15T12:23:10.668940+0000","last_became_active":"2024-09-15T12:22:00.376330+0000","last_became_peered":"2024-09-15T12:22:00.376330+0000","last_unstale":"2024-09-15T12:23:10.668940+0000","last_undegraded":"2024-09-15T12:23:10.668940+0000","last_fullsized":"2024-09-15T12:23:10.668940+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58195968,"num_objects":888,"num_object_clones":0,"num_object_copies":2664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":56832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"46'930","reported_seq":978,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.560765+0000","last_change":"2024-09-15T12:22:00.413467+0000","last_active":"2024-09-15T12:23:10.560765+0000","last_peered":"2024-09-15T12:23:10.560765+0000","last_clean":"2024-09-15T12:23:10.560765+0000","last_became_active":"2024-09-15T12:22:00.399293+0000","last_became_peered":"2024-09-15T12:22:00.399293+0000","last_unstale":"2024-09-15T12:23:10.560765+0000","last_undegraded":"2024-09-15T12:23:10.560765+0000","last_fullsized":"2024-09-15T12:23:10.560765+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":930,"log_dups_size":0,"ondisk_log_size":930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60948480,"num_objects":930,"num_object_clones":0,"num_object_copies":2790,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":930,"num_write_kb":59520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"46'915","reported_seq":963,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:11.752262+0000","last_change":"2024-09-15T12:22:00.397700+0000","last_active":"2024-09-15T12:23:11.752262+0000","last_peered":"2024-09-15T12:23:11.752262+0000","last_clean":"2024-09-15T12:23:11.752262+0000","last_became_active":"2024-09-15T12:22:00.388314+0000","last_became_peered":"2024-09-15T12:22:00.388314+0000","last_unstale":"2024-09-15T12:23:11.752262+0000","last_undegraded":"2024-09-15T12:23:11.752262+0000","last_fullsized":"2024-09-15T12:23:11.752262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59965440,"num_objects":915,"num_object_clones":0,"num_object_copies":2745,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":915,"num_write_kb":58560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"46'835","reported_seq":883,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.283424+0000","last_change":"2024-09-15T12:22:00.418610+0000","last_active":"2024-09-15T12:23:10.283424+0000","last_peered":"2024-09-15T12:23:10.283424+0000","last_clean":"2024-09-15T12:23:10.283424+0000","last_became_active":"2024-09-15T12:22:00.404352+0000","last_became_peered":"2024-09-15T12:22:00.404352+0000","last_unstale":"2024-09-15T12:23:10.283424+0000","last_undegraded":"2024-09-15T12:23:10.283424+0000","last_fullsized":"2024-09-15T12:23:10.283424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54722560,"num_objects":835,"num_object_clones":0,"num_object_copies":2505,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":835,"num_write_kb":53440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"46'881","reported_seq":929,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.596733+0000","last_change":"2024-09-15T12:22:00.408893+0000","last_active":"2024-09-15T12:23:10.596733+0000","last_peered":"2024-09-15T12:23:10.596733+0000","last_clean":"2024-09-15T12:23:10.596733+0000","last_became_active":"2024-09-15T12:22:00.399557+0000","last_became_peered":"2024-09-15T12:22:00.399557+0000","last_unstale":"2024-09-15T12:23:10.596733+0000","last_undegraded":"2024-09-15T12:23:10.596733+0000","last_fullsized":"2024-09-15T12:23:10.596733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57737216,"num_objects":881,"num_object_clones":0,"num_object_copies":2643,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":881,"num_write_kb":56384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"46'931","reported_seq":979,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.597932+0000","last_change":"2024-09-15T12:22:00.458263+0000","last_active":"2024-09-15T12:23:10.597932+0000","last_peered":"2024-09-15T12:23:10.597932+0000","last_clean":"2024-09-15T12:23:10.597932+0000","last_became_active":"2024-09-15T12:22:00.446629+0000","last_became_peered":"2024-09-15T12:22:00.446629+0000","last_unstale":"2024-09-15T12:23:10.597932+0000","last_undegraded":"2024-09-15T12:23:10.597932+0000","last_fullsized":"2024-09-15T12:23:10.597932+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":931,"log_dups_size":0,"ondisk_log_size":931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61014016,"num_objects":931,"num_object_clones":0,"num_object_copies":2793,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":931,"num_write_kb":59584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"46'941","reported_seq":989,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.708141+0000","last_change":"2024-09-15T12:22:00.432607+0000","last_active":"2024-09-15T12:23:10.708141+0000","last_peered":"2024-09-15T12:23:10.708141+0000","last_clean":"2024-09-15T12:23:10.708141+0000","last_became_active":"2024-09-15T12:22:00.422177+0000","last_became_peered":"2024-09-15T12:22:00.422177+0000","last_unstale":"2024-09-15T12:23:10.708141+0000","last_undegraded":"2024-09-15T12:23:10.708141+0000","last_fullsized":"2024-09-15T12:23:10.708141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":941,"log_dups_size":0,"ondisk_log_size":941,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61669376,"num_objects":941,"num_object_clones":0,"num_object_copies":2823,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":941,"num_write_kb":60224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"46'867","reported_seq":915,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.671056+0000","last_change":"2024-09-15T12:22:00.420197+0000","last_active":"2024-09-15T12:23:10.671056+0000","last_peered":"2024-09-15T12:23:10.671056+0000","last_clean":"2024-09-15T12:23:10.671056+0000","last_became_active":"2024-09-15T12:22:00.406666+0000","last_became_peered":"2024-09-15T12:22:00.406666+0000","last_unstale":"2024-09-15T12:23:10.671056+0000","last_undegraded":"2024-09-15T12:23:10.671056+0000","last_fullsized":"2024-09-15T12:23:10.671056+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56819712,"num_objects":867,"num_object_clones":0,"num_object_copies":2601,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":867,"num_write_kb":55488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":181,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.296581+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:22:52.296581+0000","last_peered":"2024-09-15T12:22:52.296581+0000","last_clean":"2024-09-15T12:22:52.296581+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:22:52.296581+0000","last_undegraded":"2024-09-15T12:22:52.296581+0000","last_fullsized":"2024-09-15T12:22:52.296581+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":110,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.305678+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:22:52.305678+0000","last_peered":"2024-09-15T12:22:52.305678+0000","last_clean":"2024-09-15T12:22:52.305678+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:22:52.305678+0000","last_undegraded":"2024-09-15T12:22:52.305678+0000","last_fullsized":"2024-09-15T12:22:52.305678+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"46'896","reported_seq":944,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.618027+0000","last_change":"2024-09-15T12:22:00.381165+0000","last_active":"2024-09-15T12:23:10.618027+0000","last_peered":"2024-09-15T12:23:10.618027+0000","last_clean":"2024-09-15T12:23:10.618027+0000","last_became_active":"2024-09-15T12:22:00.374145+0000","last_became_peered":"2024-09-15T12:22:00.374145+0000","last_unstale":"2024-09-15T12:23:10.618027+0000","last_undegraded":"2024-09-15T12:23:10.618027+0000","last_fullsized":"2024-09-15T12:23:10.618027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":896,"log_dups_size":0,"ondisk_log_size":896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":896,"num_object_clones":0,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.321345+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:22:52.321345+0000","last_peered":"2024-09-15T12:22:52.321345+0000","last_clean":"2024-09-15T12:22:52.321345+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:22:52.321345+0000","last_undegraded":"2024-09-15T12:22:52.321345+0000","last_fullsized":"2024-09-15T12:22:52.321345+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"46'873","reported_seq":921,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.559123+0000","last_change":"2024-09-15T12:22:00.405131+0000","last_active":"2024-09-15T12:23:10.559123+0000","last_peered":"2024-09-15T12:23:10.559123+0000","last_clean":"2024-09-15T12:23:10.559123+0000","last_became_active":"2024-09-15T12:22:00.398288+0000","last_became_peered":"2024-09-15T12:22:00.398288+0000","last_unstale":"2024-09-15T12:23:10.559123+0000","last_undegraded":"2024-09-15T12:23:10.559123+0000","last_fullsized":"2024-09-15T12:23:10.559123+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":873,"log_dups_size":0,"ondisk_log_size":873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57212928,"num_objects":873,"num_object_clones":0,"num_object_copies":2619,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":873,"num_write_kb":55872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.299731+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:22:52.299731+0000","last_peered":"2024-09-15T12:22:52.299731+0000","last_clean":"2024-09-15T12:22:52.299731+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:22:52.299731+0000","last_undegraded":"2024-09-15T12:22:52.299731+0000","last_fullsized":"2024-09-15T12:22:52.299731+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"46'933","reported_seq":981,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.515657+0000","last_change":"2024-09-15T12:22:00.390143+0000","last_active":"2024-09-15T12:23:10.515657+0000","last_peered":"2024-09-15T12:23:10.515657+0000","last_clean":"2024-09-15T12:23:10.515657+0000","last_became_active":"2024-09-15T12:22:00.370049+0000","last_became_peered":"2024-09-15T12:22:00.370049+0000","last_unstale":"2024-09-15T12:23:10.515657+0000","last_undegraded":"2024-09-15T12:23:10.515657+0000","last_fullsized":"2024-09-15T12:23:10.515657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":933,"log_dups_size":0,"ondisk_log_size":933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61145088,"num_objects":933,"num_object_clones":0,"num_object_copies":2799,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":933,"num_write_kb":59712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":111,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.312250+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:22:52.312250+0000","last_peered":"2024-09-15T12:22:52.312250+0000","last_clean":"2024-09-15T12:22:52.312250+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:22:52.312250+0000","last_undegraded":"2024-09-15T12:22:52.312250+0000","last_fullsized":"2024-09-15T12:22:52.312250+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"46'892","reported_seq":940,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.698741+0000","last_change":"2024-09-15T12:22:00.450159+0000","last_active":"2024-09-15T12:23:10.698741+0000","last_peered":"2024-09-15T12:23:10.698741+0000","last_clean":"2024-09-15T12:23:10.698741+0000","last_became_active":"2024-09-15T12:22:00.437056+0000","last_became_peered":"2024-09-15T12:22:00.437056+0000","last_unstale":"2024-09-15T12:23:10.698741+0000","last_undegraded":"2024-09-15T12:23:10.698741+0000","last_fullsized":"2024-09-15T12:23:10.698741+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58458112,"num_objects":892,"num_object_clones":0,"num_object_copies":2676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":892,"num_write_kb":57088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.299407+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:22:52.299407+0000","last_peered":"2024-09-15T12:22:52.299407+0000","last_clean":"2024-09-15T12:22:52.299407+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:22:52.299407+0000","last_undegraded":"2024-09-15T12:22:52.299407+0000","last_fullsized":"2024-09-15T12:22:52.299407+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"46'888","reported_seq":936,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.735246+0000","last_change":"2024-09-15T12:22:00.364579+0000","last_active":"2024-09-15T12:23:10.735246+0000","last_peered":"2024-09-15T12:23:10.735246+0000","last_clean":"2024-09-15T12:23:10.735246+0000","last_became_active":"2024-09-15T12:22:00.353614+0000","last_became_peered":"2024-09-15T12:22:00.353614+0000","last_unstale":"2024-09-15T12:23:10.735246+0000","last_undegraded":"2024-09-15T12:23:10.735246+0000","last_fullsized":"2024-09-15T12:23:10.735246+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58195968,"num_objects":888,"num_object_clones":0,"num_object_copies":2664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":56832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.300413+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:22:52.300413+0000","last_peered":"2024-09-15T12:22:52.300413+0000","last_clean":"2024-09-15T12:22:52.300413+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:22:52.300413+0000","last_undegraded":"2024-09-15T12:22:52.300413+0000","last_fullsized":"2024-09-15T12:22:52.300413+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"46'910","reported_seq":958,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.636546+0000","last_change":"2024-09-15T12:22:00.384094+0000","last_active":"2024-09-15T12:23:10.636546+0000","last_peered":"2024-09-15T12:23:10.636546+0000","last_clean":"2024-09-15T12:23:10.636546+0000","last_became_active":"2024-09-15T12:22:00.377789+0000","last_became_peered":"2024-09-15T12:22:00.377789+0000","last_unstale":"2024-09-15T12:23:10.636546+0000","last_undegraded":"2024-09-15T12:23:10.636546+0000","last_fullsized":"2024-09-15T12:23:10.636546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59637760,"num_objects":910,"num_object_clones":0,"num_object_copies":2730,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":910,"num_write_kb":58240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.307644+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:22:52.307644+0000","last_peered":"2024-09-15T12:22:52.307644+0000","last_clean":"2024-09-15T12:22:52.307644+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:22:52.307644+0000","last_undegraded":"2024-09-15T12:22:52.307644+0000","last_fullsized":"2024-09-15T12:22:52.307644+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"46'924","reported_seq":972,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.724930+0000","last_change":"2024-09-15T12:22:00.394121+0000","last_active":"2024-09-15T12:23:10.724930+0000","last_peered":"2024-09-15T12:23:10.724930+0000","last_clean":"2024-09-15T12:23:10.724930+0000","last_became_active":"2024-09-15T12:22:00.388183+0000","last_became_peered":"2024-09-15T12:22:00.388183+0000","last_unstale":"2024-09-15T12:23:10.724930+0000","last_undegraded":"2024-09-15T12:23:10.724930+0000","last_fullsized":"2024-09-15T12:23:10.724930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":924,"log_dups_size":0,"ondisk_log_size":924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60555264,"num_objects":924,"num_object_clones":0,"num_object_copies":2772,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":924,"num_write_kb":59136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.313103+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:22:52.313103+0000","last_peered":"2024-09-15T12:22:52.313103+0000","last_clean":"2024-09-15T12:22:52.313103+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:22:52.313103+0000","last_undegraded":"2024-09-15T12:22:52.313103+0000","last_fullsized":"2024-09-15T12:22:52.313103+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":945225728,"num_objects":14423,"num_object_clones":0,"num_object_copies":43269,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14423,"num_write_kb":923072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":177700864,"data_stored":2843213824,"data_compressed":135007675,"data_compressed_allocated":177700864,"data_compressed_original":2843213824,"omap_allocated":0,"internal_metadata":0},"log_size":14423,"ondisk_log_size":14423,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673229,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":114956,"kb_used_data":47868,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94256884,"statfs":{"total":96636764160,"available":96519049216,"internally_reserved":0,"allocated":49016832,"data_stored":777853858,"data_compressed":36931211,"data_compressed_allocated":48611328,"data_compressed_original":777699328,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":84988,"kb_used_data":35948,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94286852,"statfs":{"total":96636764160,"available":96549736448,"internally_reserved":0,"allocated":36810752,"data_stored":582491061,"data_compressed":27654577,"data_compressed_allocated":36401152,"data_compressed_original":582336512,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":96048,"kb_used_data":47008,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94275792,"statfs":{"total":96636764160,"available":96538411008,"internally_reserved":0,"allocated":48136192,"data_stored":764090773,"data_compressed":36275683,"data_compressed_allocated":47747072,"data_compressed_original":763953152,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":96644,"kb_used_data":43444,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94275196,"statfs":{"total":96636764160,"available":96537800704,"internally_reserved":0,"allocated":44486656,"data_stored":705305525,"data_compressed":33486308,"data_compressed_allocated":44077056,"data_compressed_original":705150976,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":44294144,"data_stored":708706304,"data_compressed":33652332,"data_compressed_allocated":44294144,"data_compressed_original":708706304,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":48009216,"data_stored":768147456,"data_compressed":36474851,"data_compressed_allocated":48009216,"data_compressed_original":768147456,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36589568,"data_stored":585433088,"data_compressed":27798817,"data_compressed_allocated":36589568,"data_compressed_original":585433088,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":48807936,"data_stored":780926976,"data_compressed":37081675,"data_compressed_allocated":48807936,"data_compressed_original":780926976,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:23:18.345 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 77 16 15844 15828 12.8459 11.25 0.0922427 0.0777834 2024-09-15T12:23:19.344 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 78 16 16039 16023 12.8375 12.1875 0.0846077 0.0778424 2024-09-15T12:23:19.538 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:23:19.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:19.677+0000 7f647c6bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:19.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:19.687+0000 7f647c6bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:20.344 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 79 16 16232 16216 12.8277 12.0625 0.0581956 0.0779047 2024-09-15T12:23:21.345 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:2024-09-15T12:23:21.344526+0000 min lat: 0.0169163 max lat: 0.203393 avg lat: 0.0779692 2024-09-15T12:23:21.345 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-15T12:23:21.345 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 80 16 16426 16410 12.8189 12.125 0.068477 0.0779692 2024-09-15T12:23:22.345 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 81 16 16608 16592 12.801 11.375 0.0964597 0.0780515 2024-09-15T12:23:22.466 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:23:22.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:22.627+0000 7fbe6f351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:22.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:22.635+0000 7fbe6f351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:22.824 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:23:22.824 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:23:22.824 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:23:22.824 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:23:22.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:22.967+0000 7fec79791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:22.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:22.989+0000 7fec79791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:23.128 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:23:23.128 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:23:23.129 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:23:23.129 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:23:23.129 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:23:23.129 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:23:23.129 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:23:23.129 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:23:23.130 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:23:23.130 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:23:23.130 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:23:23.130 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:23:23.134 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:23:23.134 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:23:23.134 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:23:23.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:23.301+0000 7f86f385a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:23.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:23.314+0000 7f86f385a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:23.345 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 82 16 16793 16777 12.7859 11.5625 0.0968192 0.0781597 2024-09-15T12:23:23.517 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:23:23.518 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:23:23.518 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:23:23.518 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:23:23.518 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:23:23.518 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:23:23.518 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:23:23.518 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:23:23.518 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:23:23.518 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:23:23.518 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:23:23.518 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:23:23.521 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:23:23.521 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:23:23.521 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:23:23.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:23.735+0000 7f2fbb791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:23.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:23.753+0000 7f2fbb791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:23.909 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:23:23.909 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:23:23.909 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:23:23.910 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:23:23.910 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:23:23.910 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:23:23.910 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:23:23.910 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:23:23.910 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:23:23.910 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:23:23.910 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:23:23.910 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:23:23.913 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:23:23.913 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:23:23.914 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:23:24.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:24.043+0000 7f421f791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:24.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:24.057+0000 7f421f791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:24.117 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:23:24.117 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:23:24.117 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:23:24.117 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:23:24.118 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:23:24.118 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:23:24.118 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:23:24.118 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:23:24.118 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:23:24.118 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:23:24.118 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:23:24.118 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:23:24.121 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:23:24.121 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:23:24.345 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 83 16 16983 16967 12.7749 11.875 0.0956282 0.0782354 2024-09-15T12:23:25.348 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 84 16 17174 17158 12.7649 11.9375 0.105436 0.0782832 2024-09-15T12:23:25.481 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:23:25.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:25.632+0000 7f52dd0ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:25.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:25.642+0000 7f52dd0ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:26.345 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 85 16 17352 17336 12.7456 11.125 0.0993213 0.0784088 2024-09-15T12:23:27.345 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 86 16 17537 17521 12.7319 11.5625 0.116577 0.0784906 2024-09-15T12:23:28.190 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:23:28.345 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 87 16 17708 17692 12.7084 10.6875 0.0692795 0.0786312 2024-09-15T12:23:28.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:28.354+0000 7f1987cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:28.366 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:28.365+0000 7f1987cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:29.122 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:23:29.122 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:23:29.123 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:23:29.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:29.286+0000 7fa097c74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:29.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:29.299+0000 7fa097c74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:29.345 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 88 16 17886 17870 12.6904 11.125 0.0636046 0.0787514 2024-09-15T12:23:29.599 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:23:29.599 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:23:29.625 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2024-09-15T12:23:27.759692+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":945816115,"num_objects":14427,"num_object_clones":0,"num_object_copies":43281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":14504,"num_write_kb":924180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14478,"ondisk_log_size":14478,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":392636,"kb_used_data":174268,"kb_used_omap":0,"kb_used_meta":218304,"kb_avail":377094724,"statfs":{"total":386547056640,"available":386144997376,"internally_reserved":0,"allocated":178450432,"data_stored":2829741217,"data_compressed":134347779,"data_compressed_allocated":176836608,"data_compressed_original":2829139968,"omap_allocated":0,"internal_metadata":223543296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002538"},"pg_stats":[{"pgid":"4.f","version":"46'919","reported_seq":967,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.728004+0000","last_change":"2024-09-15T12:22:00.377854+0000","last_active":"2024-09-15T12:23:10.728004+0000","last_peered":"2024-09-15T12:23:10.728004+0000","last_clean":"2024-09-15T12:23:10.728004+0000","last_became_active":"2024-09-15T12:22:00.359790+0000","last_became_peered":"2024-09-15T12:22:00.359790+0000","last_unstale":"2024-09-15T12:23:10.728004+0000","last_undegraded":"2024-09-15T12:23:10.728004+0000","last_fullsized":"2024-09-15T12:23:10.728004+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":919,"log_dups_size":0,"ondisk_log_size":919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60227584,"num_objects":919,"num_object_clones":0,"num_object_copies":2757,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":919,"num_write_kb":58816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"46'888","reported_seq":936,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.668940+0000","last_change":"2024-09-15T12:22:00.383291+0000","last_active":"2024-09-15T12:23:10.668940+0000","last_peered":"2024-09-15T12:23:10.668940+0000","last_clean":"2024-09-15T12:23:10.668940+0000","last_became_active":"2024-09-15T12:22:00.376330+0000","last_became_peered":"2024-09-15T12:22:00.376330+0000","last_unstale":"2024-09-15T12:23:10.668940+0000","last_undegraded":"2024-09-15T12:23:10.668940+0000","last_fullsized":"2024-09-15T12:23:10.668940+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58195968,"num_objects":888,"num_object_clones":0,"num_object_copies":2664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":56832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"46'930","reported_seq":978,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.560765+0000","last_change":"2024-09-15T12:22:00.413467+0000","last_active":"2024-09-15T12:23:10.560765+0000","last_peered":"2024-09-15T12:23:10.560765+0000","last_clean":"2024-09-15T12:23:10.560765+0000","last_became_active":"2024-09-15T12:22:00.399293+0000","last_became_peered":"2024-09-15T12:22:00.399293+0000","last_unstale":"2024-09-15T12:23:10.560765+0000","last_undegraded":"2024-09-15T12:23:10.560765+0000","last_fullsized":"2024-09-15T12:23:10.560765+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":930,"log_dups_size":0,"ondisk_log_size":930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60948480,"num_objects":930,"num_object_clones":0,"num_object_copies":2790,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":930,"num_write_kb":59520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"46'915","reported_seq":963,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:11.752262+0000","last_change":"2024-09-15T12:22:00.397700+0000","last_active":"2024-09-15T12:23:11.752262+0000","last_peered":"2024-09-15T12:23:11.752262+0000","last_clean":"2024-09-15T12:23:11.752262+0000","last_became_active":"2024-09-15T12:22:00.388314+0000","last_became_peered":"2024-09-15T12:22:00.388314+0000","last_unstale":"2024-09-15T12:23:11.752262+0000","last_undegraded":"2024-09-15T12:23:11.752262+0000","last_fullsized":"2024-09-15T12:23:11.752262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59965440,"num_objects":915,"num_object_clones":0,"num_object_copies":2745,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":915,"num_write_kb":58560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"46'835","reported_seq":883,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.283424+0000","last_change":"2024-09-15T12:22:00.418610+0000","last_active":"2024-09-15T12:23:10.283424+0000","last_peered":"2024-09-15T12:23:10.283424+0000","last_clean":"2024-09-15T12:23:10.283424+0000","last_became_active":"2024-09-15T12:22:00.404352+0000","last_became_peered":"2024-09-15T12:22:00.404352+0000","last_unstale":"2024-09-15T12:23:10.283424+0000","last_undegraded":"2024-09-15T12:23:10.283424+0000","last_fullsized":"2024-09-15T12:23:10.283424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54722560,"num_objects":835,"num_object_clones":0,"num_object_copies":2505,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":835,"num_write_kb":53440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"46'881","reported_seq":929,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.596733+0000","last_change":"2024-09-15T12:22:00.408893+0000","last_active":"2024-09-15T12:23:10.596733+0000","last_peered":"2024-09-15T12:23:10.596733+0000","last_clean":"2024-09-15T12:23:10.596733+0000","last_became_active":"2024-09-15T12:22:00.399557+0000","last_became_peered":"2024-09-15T12:22:00.399557+0000","last_unstale":"2024-09-15T12:23:10.596733+0000","last_undegraded":"2024-09-15T12:23:10.596733+0000","last_fullsized":"2024-09-15T12:23:10.596733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57737216,"num_objects":881,"num_object_clones":0,"num_object_copies":2643,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":881,"num_write_kb":56384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"46'931","reported_seq":979,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.597932+0000","last_change":"2024-09-15T12:22:00.458263+0000","last_active":"2024-09-15T12:23:10.597932+0000","last_peered":"2024-09-15T12:23:10.597932+0000","last_clean":"2024-09-15T12:23:10.597932+0000","last_became_active":"2024-09-15T12:22:00.446629+0000","last_became_peered":"2024-09-15T12:22:00.446629+0000","last_unstale":"2024-09-15T12:23:10.597932+0000","last_undegraded":"2024-09-15T12:23:10.597932+0000","last_fullsized":"2024-09-15T12:23:10.597932+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":931,"log_dups_size":0,"ondisk_log_size":931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61014016,"num_objects":931,"num_object_clones":0,"num_object_copies":2793,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":931,"num_write_kb":59584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"46'941","reported_seq":989,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.708141+0000","last_change":"2024-09-15T12:22:00.432607+0000","last_active":"2024-09-15T12:23:10.708141+0000","last_peered":"2024-09-15T12:23:10.708141+0000","last_clean":"2024-09-15T12:23:10.708141+0000","last_became_active":"2024-09-15T12:22:00.422177+0000","last_became_peered":"2024-09-15T12:22:00.422177+0000","last_unstale":"2024-09-15T12:23:10.708141+0000","last_undegraded":"2024-09-15T12:23:10.708141+0000","last_fullsized":"2024-09-15T12:23:10.708141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":941,"log_dups_size":0,"ondisk_log_size":941,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61669376,"num_objects":941,"num_object_clones":0,"num_object_copies":2823,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":941,"num_write_kb":60224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"46'867","reported_seq":915,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.671056+0000","last_change":"2024-09-15T12:22:00.420197+0000","last_active":"2024-09-15T12:23:10.671056+0000","last_peered":"2024-09-15T12:23:10.671056+0000","last_clean":"2024-09-15T12:23:10.671056+0000","last_became_active":"2024-09-15T12:22:00.406666+0000","last_became_peered":"2024-09-15T12:22:00.406666+0000","last_unstale":"2024-09-15T12:23:10.671056+0000","last_undegraded":"2024-09-15T12:23:10.671056+0000","last_fullsized":"2024-09-15T12:23:10.671056+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56819712,"num_objects":867,"num_object_clones":0,"num_object_copies":2601,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":867,"num_write_kb":55488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":181,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.296581+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:22:52.296581+0000","last_peered":"2024-09-15T12:22:52.296581+0000","last_clean":"2024-09-15T12:22:52.296581+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:22:52.296581+0000","last_undegraded":"2024-09-15T12:22:52.296581+0000","last_fullsized":"2024-09-15T12:22:52.296581+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":110,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.305678+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:22:52.305678+0000","last_peered":"2024-09-15T12:22:52.305678+0000","last_clean":"2024-09-15T12:22:52.305678+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:22:52.305678+0000","last_undegraded":"2024-09-15T12:22:52.305678+0000","last_fullsized":"2024-09-15T12:22:52.305678+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"46'896","reported_seq":944,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.618027+0000","last_change":"2024-09-15T12:22:00.381165+0000","last_active":"2024-09-15T12:23:10.618027+0000","last_peered":"2024-09-15T12:23:10.618027+0000","last_clean":"2024-09-15T12:23:10.618027+0000","last_became_active":"2024-09-15T12:22:00.374145+0000","last_became_peered":"2024-09-15T12:22:00.374145+0000","last_unstale":"2024-09-15T12:23:10.618027+0000","last_undegraded":"2024-09-15T12:23:10.618027+0000","last_fullsized":"2024-09-15T12:23:10.618027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":896,"log_dups_size":0,"ondisk_log_size":896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":896,"num_object_clones":0,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.321345+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:22:52.321345+0000","last_peered":"2024-09-15T12:22:52.321345+0000","last_clean":"2024-09-15T12:22:52.321345+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:22:52.321345+0000","last_undegraded":"2024-09-15T12:22:52.321345+0000","last_fullsized":"2024-09-15T12:22:52.321345+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"46'873","reported_seq":921,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.559123+0000","last_change":"2024-09-15T12:22:00.405131+0000","last_active":"2024-09-15T12:23:10.559123+0000","last_peered":"2024-09-15T12:23:10.559123+0000","last_clean":"2024-09-15T12:23:10.559123+0000","last_became_active":"2024-09-15T12:22:00.398288+0000","last_became_peered":"2024-09-15T12:22:00.398288+0000","last_unstale":"2024-09-15T12:23:10.559123+0000","last_undegraded":"2024-09-15T12:23:10.559123+0000","last_fullsized":"2024-09-15T12:23:10.559123+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":873,"log_dups_size":0,"ondisk_log_size":873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57212928,"num_objects":873,"num_object_clones":0,"num_object_copies":2619,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":873,"num_write_kb":55872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.299731+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:22:52.299731+0000","last_peered":"2024-09-15T12:22:52.299731+0000","last_clean":"2024-09-15T12:22:52.299731+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:22:52.299731+0000","last_undegraded":"2024-09-15T12:22:52.299731+0000","last_fullsized":"2024-09-15T12:22:52.299731+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"46'933","reported_seq":981,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.515657+0000","last_change":"2024-09-15T12:22:00.390143+0000","last_active":"2024-09-15T12:23:10.515657+0000","last_peered":"2024-09-15T12:23:10.515657+0000","last_clean":"2024-09-15T12:23:10.515657+0000","last_became_active":"2024-09-15T12:22:00.370049+0000","last_became_peered":"2024-09-15T12:22:00.370049+0000","last_unstale":"2024-09-15T12:23:10.515657+0000","last_undegraded":"2024-09-15T12:23:10.515657+0000","last_fullsized":"2024-09-15T12:23:10.515657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":933,"log_dups_size":0,"ondisk_log_size":933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61145088,"num_objects":933,"num_object_clones":0,"num_object_copies":2799,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":933,"num_write_kb":59712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":111,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.312250+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:22:52.312250+0000","last_peered":"2024-09-15T12:22:52.312250+0000","last_clean":"2024-09-15T12:22:52.312250+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:22:52.312250+0000","last_undegraded":"2024-09-15T12:22:52.312250+0000","last_fullsized":"2024-09-15T12:22:52.312250+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"46'892","reported_seq":940,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.698741+0000","last_change":"2024-09-15T12:22:00.450159+0000","last_active":"2024-09-15T12:23:10.698741+0000","last_peered":"2024-09-15T12:23:10.698741+0000","last_clean":"2024-09-15T12:23:10.698741+0000","last_became_active":"2024-09-15T12:22:00.437056+0000","last_became_peered":"2024-09-15T12:22:00.437056+0000","last_unstale":"2024-09-15T12:23:10.698741+0000","last_undegraded":"2024-09-15T12:23:10.698741+0000","last_fullsized":"2024-09-15T12:23:10.698741+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58458112,"num_objects":892,"num_object_clones":0,"num_object_copies":2676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":892,"num_write_kb":57088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.299407+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:22:52.299407+0000","last_peered":"2024-09-15T12:22:52.299407+0000","last_clean":"2024-09-15T12:22:52.299407+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:22:52.299407+0000","last_undegraded":"2024-09-15T12:22:52.299407+0000","last_fullsized":"2024-09-15T12:22:52.299407+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"46'888","reported_seq":936,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.735246+0000","last_change":"2024-09-15T12:22:00.364579+0000","last_active":"2024-09-15T12:23:10.735246+0000","last_peered":"2024-09-15T12:23:10.735246+0000","last_clean":"2024-09-15T12:23:10.735246+0000","last_became_active":"2024-09-15T12:22:00.353614+0000","last_became_peered":"2024-09-15T12:22:00.353614+0000","last_unstale":"2024-09-15T12:23:10.735246+0000","last_undegraded":"2024-09-15T12:23:10.735246+0000","last_fullsized":"2024-09-15T12:23:10.735246+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58195968,"num_objects":888,"num_object_clones":0,"num_object_copies":2664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":56832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.300413+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:22:52.300413+0000","last_peered":"2024-09-15T12:22:52.300413+0000","last_clean":"2024-09-15T12:22:52.300413+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:22:52.300413+0000","last_undegraded":"2024-09-15T12:22:52.300413+0000","last_fullsized":"2024-09-15T12:22:52.300413+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"46'910","reported_seq":958,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.636546+0000","last_change":"2024-09-15T12:22:00.384094+0000","last_active":"2024-09-15T12:23:10.636546+0000","last_peered":"2024-09-15T12:23:10.636546+0000","last_clean":"2024-09-15T12:23:10.636546+0000","last_became_active":"2024-09-15T12:22:00.377789+0000","last_became_peered":"2024-09-15T12:22:00.377789+0000","last_unstale":"2024-09-15T12:23:10.636546+0000","last_undegraded":"2024-09-15T12:23:10.636546+0000","last_fullsized":"2024-09-15T12:23:10.636546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59637760,"num_objects":910,"num_object_clones":0,"num_object_copies":2730,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":910,"num_write_kb":58240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.307644+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:22:52.307644+0000","last_peered":"2024-09-15T12:22:52.307644+0000","last_clean":"2024-09-15T12:22:52.307644+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:22:52.307644+0000","last_undegraded":"2024-09-15T12:22:52.307644+0000","last_fullsized":"2024-09-15T12:22:52.307644+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"46'924","reported_seq":972,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.724930+0000","last_change":"2024-09-15T12:22:00.394121+0000","last_active":"2024-09-15T12:23:10.724930+0000","last_peered":"2024-09-15T12:23:10.724930+0000","last_clean":"2024-09-15T12:23:10.724930+0000","last_became_active":"2024-09-15T12:22:00.388183+0000","last_became_peered":"2024-09-15T12:22:00.388183+0000","last_unstale":"2024-09-15T12:23:10.724930+0000","last_undegraded":"2024-09-15T12:23:10.724930+0000","last_fullsized":"2024-09-15T12:23:10.724930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":924,"log_dups_size":0,"ondisk_log_size":924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60555264,"num_objects":924,"num_object_clones":0,"num_object_copies":2772,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":924,"num_write_kb":59136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.313103+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:22:52.313103+0000","last_peered":"2024-09-15T12:22:52.313103+0000","last_clean":"2024-09-15T12:22:52.313103+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:22:52.313103+0000","last_undegraded":"2024-09-15T12:22:52.313103+0000","last_fullsized":"2024-09-15T12:22:52.313103+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":945225728,"num_objects":14423,"num_object_clones":0,"num_object_copies":43269,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14423,"num_write_kb":923072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":177700864,"data_stored":2843213824,"data_compressed":135007675,"data_compressed_allocated":177700864,"data_compressed_original":2843213824,"omap_allocated":0,"internal_metadata":0},"log_size":14423,"ondisk_log_size":14423,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673229,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":114956,"kb_used_data":47868,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94256884,"statfs":{"total":96636764160,"available":96519049216,"internally_reserved":0,"allocated":49016832,"data_stored":777853858,"data_compressed":36931211,"data_compressed_allocated":48611328,"data_compressed_original":777699328,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":84988,"kb_used_data":35948,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94286852,"statfs":{"total":96636764160,"available":96549736448,"internally_reserved":0,"allocated":36810752,"data_stored":582491061,"data_compressed":27654577,"data_compressed_allocated":36401152,"data_compressed_original":582336512,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":96048,"kb_used_data":47008,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94275792,"statfs":{"total":96636764160,"available":96538411008,"internally_reserved":0,"allocated":48136192,"data_stored":764090773,"data_compressed":36275683,"data_compressed_allocated":47747072,"data_compressed_original":763953152,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":96644,"kb_used_data":43444,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94275196,"statfs":{"total":96636764160,"available":96537800704,"internally_reserved":0,"allocated":44486656,"data_stored":705305525,"data_compressed":33486308,"data_compressed_allocated":44077056,"data_compressed_original":705150976,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":44294144,"data_stored":708706304,"data_compressed":33652332,"data_compressed_allocated":44294144,"data_compressed_original":708706304,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":48009216,"data_stored":768147456,"data_compressed":36474851,"data_compressed_allocated":48009216,"data_compressed_original":768147456,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36589568,"data_stored":585433088,"data_compressed":27798817,"data_compressed_allocated":36589568,"data_compressed_original":585433088,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":48807936,"data_stored":780926976,"data_compressed":37081675,"data_compressed_allocated":48807936,"data_compressed_original":780926976,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:23:30.346 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 89 16 18074 18058 12.6798 11.75 0.134115 0.0788123 2024-09-15T12:23:30.730 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:23:30.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:30.885+0000 7f8970151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:30.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:30.895+0000 7f8970151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:31.346 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 90 13 18243 18230 12.6583 10.75 0.10749 0.0789668 2024-09-15T12:23:32.346 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Total time run: 90.0518 2024-09-15T12:23:32.346 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Total writes made: 18243 2024-09-15T12:23:32.346 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Write size: 65536 2024-09-15T12:23:32.346 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Object size: 65536 2024-09-15T12:23:32.346 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Bandwidth (MB/sec): 12.6615 2024-09-15T12:23:32.346 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Stddev Bandwidth: 1.01758 2024-09-15T12:23:32.346 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Max bandwidth (MB/sec): 15.3125 2024-09-15T12:23:32.346 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Min bandwidth (MB/sec): 10.6875 2024-09-15T12:23:32.347 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Average IOPS: 202 2024-09-15T12:23:32.347 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Stddev IOPS: 16.2813 2024-09-15T12:23:32.347 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Max IOPS: 245 2024-09-15T12:23:32.347 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Min IOPS: 171 2024-09-15T12:23:32.347 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Average Latency(s): 0.0789517 2024-09-15T12:23:32.347 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Stddev Latency(s): 0.0277323 2024-09-15T12:23:32.347 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Max latency(s): 0.218571 2024-09-15T12:23:32.347 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Min latency(s): 0.0169163 2024-09-15T12:23:32.374 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Cleaning up (deleting benchmark objects) 2024-09-15T12:23:33.421 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:23:33.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:33.559+0000 7f9895d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:33.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:33.567+0000 7f9895d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:34.627 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:23:34.628 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-15T12:23:34.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:34.768+0000 7fc1664c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:34.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:34.781+0000 7fc1664c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:35.828 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.0 to 1 (10000) 2024-09-15T12:23:35.848 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-15T12:23:35.986 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:23:36.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:35.996+0000 7fe54ef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:36.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:36.016+0000 7fe54ef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:36.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:36.144+0000 7f692e29c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:36.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:36.155+0000 7f692e29c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:36.829 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.1 to 1 (10000) 2024-09-15T12:23:36.854 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-15T12:23:37.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:37.002+0000 7f550cf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:37.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:37.016+0000 7f550cf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:37.839 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.2 to 1 (10000) 2024-09-15T12:23:37.867 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-15T12:23:38.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:38.036+0000 7f7bb2888640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:38.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:38.054+0000 7f7bb2888640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:38.698 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:23:38.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:38.839+0000 7fd4fb351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:38.845 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.3 to 1 (10000) 2024-09-15T12:23:38.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:38.854+0000 7fd4fb351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:38.872 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-15T12:23:38.873 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:23:39.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:39.033+0000 7fb3d40d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:39.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:39.054+0000 7fb3d40d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:39.321 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:23:39.323 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:23:39.347 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2024-09-15T12:23:38.845420+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":945816115,"num_objects":14427,"num_object_clones":0,"num_object_copies":43281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":14504,"num_write_kb":924180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14478,"ondisk_log_size":14478,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":392636,"kb_used_data":174268,"kb_used_omap":0,"kb_used_meta":218304,"kb_avail":377094724,"statfs":{"total":386547056640,"available":386144997376,"internally_reserved":0,"allocated":178450432,"data_stored":2829741217,"data_compressed":134347779,"data_compressed_allocated":176836608,"data_compressed_original":2829139968,"omap_allocated":0,"internal_metadata":223543296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.084653"},"pg_stats":[{"pgid":"4.f","version":"46'919","reported_seq":967,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.728004+0000","last_change":"2024-09-15T12:22:00.377854+0000","last_active":"2024-09-15T12:23:10.728004+0000","last_peered":"2024-09-15T12:23:10.728004+0000","last_clean":"2024-09-15T12:23:10.728004+0000","last_became_active":"2024-09-15T12:22:00.359790+0000","last_became_peered":"2024-09-15T12:22:00.359790+0000","last_unstale":"2024-09-15T12:23:10.728004+0000","last_undegraded":"2024-09-15T12:23:10.728004+0000","last_fullsized":"2024-09-15T12:23:10.728004+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":919,"log_dups_size":0,"ondisk_log_size":919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60227584,"num_objects":919,"num_object_clones":0,"num_object_copies":2757,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":919,"num_write_kb":58816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"46'888","reported_seq":936,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.668940+0000","last_change":"2024-09-15T12:22:00.383291+0000","last_active":"2024-09-15T12:23:10.668940+0000","last_peered":"2024-09-15T12:23:10.668940+0000","last_clean":"2024-09-15T12:23:10.668940+0000","last_became_active":"2024-09-15T12:22:00.376330+0000","last_became_peered":"2024-09-15T12:22:00.376330+0000","last_unstale":"2024-09-15T12:23:10.668940+0000","last_undegraded":"2024-09-15T12:23:10.668940+0000","last_fullsized":"2024-09-15T12:23:10.668940+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58195968,"num_objects":888,"num_object_clones":0,"num_object_copies":2664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":56832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"46'930","reported_seq":978,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.560765+0000","last_change":"2024-09-15T12:22:00.413467+0000","last_active":"2024-09-15T12:23:10.560765+0000","last_peered":"2024-09-15T12:23:10.560765+0000","last_clean":"2024-09-15T12:23:10.560765+0000","last_became_active":"2024-09-15T12:22:00.399293+0000","last_became_peered":"2024-09-15T12:22:00.399293+0000","last_unstale":"2024-09-15T12:23:10.560765+0000","last_undegraded":"2024-09-15T12:23:10.560765+0000","last_fullsized":"2024-09-15T12:23:10.560765+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":930,"log_dups_size":0,"ondisk_log_size":930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60948480,"num_objects":930,"num_object_clones":0,"num_object_copies":2790,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":930,"num_write_kb":59520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"46'915","reported_seq":963,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:11.752262+0000","last_change":"2024-09-15T12:22:00.397700+0000","last_active":"2024-09-15T12:23:11.752262+0000","last_peered":"2024-09-15T12:23:11.752262+0000","last_clean":"2024-09-15T12:23:11.752262+0000","last_became_active":"2024-09-15T12:22:00.388314+0000","last_became_peered":"2024-09-15T12:22:00.388314+0000","last_unstale":"2024-09-15T12:23:11.752262+0000","last_undegraded":"2024-09-15T12:23:11.752262+0000","last_fullsized":"2024-09-15T12:23:11.752262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59965440,"num_objects":915,"num_object_clones":0,"num_object_copies":2745,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":915,"num_write_kb":58560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"46'835","reported_seq":883,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.283424+0000","last_change":"2024-09-15T12:22:00.418610+0000","last_active":"2024-09-15T12:23:10.283424+0000","last_peered":"2024-09-15T12:23:10.283424+0000","last_clean":"2024-09-15T12:23:10.283424+0000","last_became_active":"2024-09-15T12:22:00.404352+0000","last_became_peered":"2024-09-15T12:22:00.404352+0000","last_unstale":"2024-09-15T12:23:10.283424+0000","last_undegraded":"2024-09-15T12:23:10.283424+0000","last_fullsized":"2024-09-15T12:23:10.283424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54722560,"num_objects":835,"num_object_clones":0,"num_object_copies":2505,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":835,"num_write_kb":53440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"46'881","reported_seq":929,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.596733+0000","last_change":"2024-09-15T12:22:00.408893+0000","last_active":"2024-09-15T12:23:10.596733+0000","last_peered":"2024-09-15T12:23:10.596733+0000","last_clean":"2024-09-15T12:23:10.596733+0000","last_became_active":"2024-09-15T12:22:00.399557+0000","last_became_peered":"2024-09-15T12:22:00.399557+0000","last_unstale":"2024-09-15T12:23:10.596733+0000","last_undegraded":"2024-09-15T12:23:10.596733+0000","last_fullsized":"2024-09-15T12:23:10.596733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57737216,"num_objects":881,"num_object_clones":0,"num_object_copies":2643,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":881,"num_write_kb":56384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"46'931","reported_seq":979,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.597932+0000","last_change":"2024-09-15T12:22:00.458263+0000","last_active":"2024-09-15T12:23:10.597932+0000","last_peered":"2024-09-15T12:23:10.597932+0000","last_clean":"2024-09-15T12:23:10.597932+0000","last_became_active":"2024-09-15T12:22:00.446629+0000","last_became_peered":"2024-09-15T12:22:00.446629+0000","last_unstale":"2024-09-15T12:23:10.597932+0000","last_undegraded":"2024-09-15T12:23:10.597932+0000","last_fullsized":"2024-09-15T12:23:10.597932+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":931,"log_dups_size":0,"ondisk_log_size":931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61014016,"num_objects":931,"num_object_clones":0,"num_object_copies":2793,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":931,"num_write_kb":59584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"46'941","reported_seq":989,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.708141+0000","last_change":"2024-09-15T12:22:00.432607+0000","last_active":"2024-09-15T12:23:10.708141+0000","last_peered":"2024-09-15T12:23:10.708141+0000","last_clean":"2024-09-15T12:23:10.708141+0000","last_became_active":"2024-09-15T12:22:00.422177+0000","last_became_peered":"2024-09-15T12:22:00.422177+0000","last_unstale":"2024-09-15T12:23:10.708141+0000","last_undegraded":"2024-09-15T12:23:10.708141+0000","last_fullsized":"2024-09-15T12:23:10.708141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":941,"log_dups_size":0,"ondisk_log_size":941,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61669376,"num_objects":941,"num_object_clones":0,"num_object_copies":2823,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":941,"num_write_kb":60224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"46'867","reported_seq":915,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.671056+0000","last_change":"2024-09-15T12:22:00.420197+0000","last_active":"2024-09-15T12:23:10.671056+0000","last_peered":"2024-09-15T12:23:10.671056+0000","last_clean":"2024-09-15T12:23:10.671056+0000","last_became_active":"2024-09-15T12:22:00.406666+0000","last_became_peered":"2024-09-15T12:22:00.406666+0000","last_unstale":"2024-09-15T12:23:10.671056+0000","last_undegraded":"2024-09-15T12:23:10.671056+0000","last_fullsized":"2024-09-15T12:23:10.671056+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56819712,"num_objects":867,"num_object_clones":0,"num_object_copies":2601,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":867,"num_write_kb":55488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":181,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.296581+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:22:52.296581+0000","last_peered":"2024-09-15T12:22:52.296581+0000","last_clean":"2024-09-15T12:22:52.296581+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:22:52.296581+0000","last_undegraded":"2024-09-15T12:22:52.296581+0000","last_fullsized":"2024-09-15T12:22:52.296581+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":110,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.305678+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:22:52.305678+0000","last_peered":"2024-09-15T12:22:52.305678+0000","last_clean":"2024-09-15T12:22:52.305678+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:22:52.305678+0000","last_undegraded":"2024-09-15T12:22:52.305678+0000","last_fullsized":"2024-09-15T12:22:52.305678+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"46'896","reported_seq":944,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.618027+0000","last_change":"2024-09-15T12:22:00.381165+0000","last_active":"2024-09-15T12:23:10.618027+0000","last_peered":"2024-09-15T12:23:10.618027+0000","last_clean":"2024-09-15T12:23:10.618027+0000","last_became_active":"2024-09-15T12:22:00.374145+0000","last_became_peered":"2024-09-15T12:22:00.374145+0000","last_unstale":"2024-09-15T12:23:10.618027+0000","last_undegraded":"2024-09-15T12:23:10.618027+0000","last_fullsized":"2024-09-15T12:23:10.618027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":896,"log_dups_size":0,"ondisk_log_size":896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":896,"num_object_clones":0,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.321345+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:22:52.321345+0000","last_peered":"2024-09-15T12:22:52.321345+0000","last_clean":"2024-09-15T12:22:52.321345+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:22:52.321345+0000","last_undegraded":"2024-09-15T12:22:52.321345+0000","last_fullsized":"2024-09-15T12:22:52.321345+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"46'873","reported_seq":921,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.559123+0000","last_change":"2024-09-15T12:22:00.405131+0000","last_active":"2024-09-15T12:23:10.559123+0000","last_peered":"2024-09-15T12:23:10.559123+0000","last_clean":"2024-09-15T12:23:10.559123+0000","last_became_active":"2024-09-15T12:22:00.398288+0000","last_became_peered":"2024-09-15T12:22:00.398288+0000","last_unstale":"2024-09-15T12:23:10.559123+0000","last_undegraded":"2024-09-15T12:23:10.559123+0000","last_fullsized":"2024-09-15T12:23:10.559123+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":873,"log_dups_size":0,"ondisk_log_size":873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57212928,"num_objects":873,"num_object_clones":0,"num_object_copies":2619,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":873,"num_write_kb":55872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.299731+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:22:52.299731+0000","last_peered":"2024-09-15T12:22:52.299731+0000","last_clean":"2024-09-15T12:22:52.299731+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:22:52.299731+0000","last_undegraded":"2024-09-15T12:22:52.299731+0000","last_fullsized":"2024-09-15T12:22:52.299731+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"46'933","reported_seq":981,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.515657+0000","last_change":"2024-09-15T12:22:00.390143+0000","last_active":"2024-09-15T12:23:10.515657+0000","last_peered":"2024-09-15T12:23:10.515657+0000","last_clean":"2024-09-15T12:23:10.515657+0000","last_became_active":"2024-09-15T12:22:00.370049+0000","last_became_peered":"2024-09-15T12:22:00.370049+0000","last_unstale":"2024-09-15T12:23:10.515657+0000","last_undegraded":"2024-09-15T12:23:10.515657+0000","last_fullsized":"2024-09-15T12:23:10.515657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":933,"log_dups_size":0,"ondisk_log_size":933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61145088,"num_objects":933,"num_object_clones":0,"num_object_copies":2799,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":933,"num_write_kb":59712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":111,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.312250+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:22:52.312250+0000","last_peered":"2024-09-15T12:22:52.312250+0000","last_clean":"2024-09-15T12:22:52.312250+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:22:52.312250+0000","last_undegraded":"2024-09-15T12:22:52.312250+0000","last_fullsized":"2024-09-15T12:22:52.312250+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"46'892","reported_seq":940,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.698741+0000","last_change":"2024-09-15T12:22:00.450159+0000","last_active":"2024-09-15T12:23:10.698741+0000","last_peered":"2024-09-15T12:23:10.698741+0000","last_clean":"2024-09-15T12:23:10.698741+0000","last_became_active":"2024-09-15T12:22:00.437056+0000","last_became_peered":"2024-09-15T12:22:00.437056+0000","last_unstale":"2024-09-15T12:23:10.698741+0000","last_undegraded":"2024-09-15T12:23:10.698741+0000","last_fullsized":"2024-09-15T12:23:10.698741+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58458112,"num_objects":892,"num_object_clones":0,"num_object_copies":2676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":892,"num_write_kb":57088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.299407+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:22:52.299407+0000","last_peered":"2024-09-15T12:22:52.299407+0000","last_clean":"2024-09-15T12:22:52.299407+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:22:52.299407+0000","last_undegraded":"2024-09-15T12:22:52.299407+0000","last_fullsized":"2024-09-15T12:22:52.299407+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"46'888","reported_seq":936,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.735246+0000","last_change":"2024-09-15T12:22:00.364579+0000","last_active":"2024-09-15T12:23:10.735246+0000","last_peered":"2024-09-15T12:23:10.735246+0000","last_clean":"2024-09-15T12:23:10.735246+0000","last_became_active":"2024-09-15T12:22:00.353614+0000","last_became_peered":"2024-09-15T12:22:00.353614+0000","last_unstale":"2024-09-15T12:23:10.735246+0000","last_undegraded":"2024-09-15T12:23:10.735246+0000","last_fullsized":"2024-09-15T12:23:10.735246+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58195968,"num_objects":888,"num_object_clones":0,"num_object_copies":2664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":56832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.300413+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:22:52.300413+0000","last_peered":"2024-09-15T12:22:52.300413+0000","last_clean":"2024-09-15T12:22:52.300413+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:22:52.300413+0000","last_undegraded":"2024-09-15T12:22:52.300413+0000","last_fullsized":"2024-09-15T12:22:52.300413+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"46'910","reported_seq":958,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.636546+0000","last_change":"2024-09-15T12:22:00.384094+0000","last_active":"2024-09-15T12:23:10.636546+0000","last_peered":"2024-09-15T12:23:10.636546+0000","last_clean":"2024-09-15T12:23:10.636546+0000","last_became_active":"2024-09-15T12:22:00.377789+0000","last_became_peered":"2024-09-15T12:22:00.377789+0000","last_unstale":"2024-09-15T12:23:10.636546+0000","last_undegraded":"2024-09-15T12:23:10.636546+0000","last_fullsized":"2024-09-15T12:23:10.636546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59637760,"num_objects":910,"num_object_clones":0,"num_object_copies":2730,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":910,"num_write_kb":58240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.307644+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:22:52.307644+0000","last_peered":"2024-09-15T12:22:52.307644+0000","last_clean":"2024-09-15T12:22:52.307644+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:22:52.307644+0000","last_undegraded":"2024-09-15T12:22:52.307644+0000","last_fullsized":"2024-09-15T12:22:52.307644+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"46'924","reported_seq":972,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.724930+0000","last_change":"2024-09-15T12:22:00.394121+0000","last_active":"2024-09-15T12:23:10.724930+0000","last_peered":"2024-09-15T12:23:10.724930+0000","last_clean":"2024-09-15T12:23:10.724930+0000","last_became_active":"2024-09-15T12:22:00.388183+0000","last_became_peered":"2024-09-15T12:22:00.388183+0000","last_unstale":"2024-09-15T12:23:10.724930+0000","last_undegraded":"2024-09-15T12:23:10.724930+0000","last_fullsized":"2024-09-15T12:23:10.724930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":924,"log_dups_size":0,"ondisk_log_size":924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60555264,"num_objects":924,"num_object_clones":0,"num_object_copies":2772,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":924,"num_write_kb":59136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.313103+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:22:52.313103+0000","last_peered":"2024-09-15T12:22:52.313103+0000","last_clean":"2024-09-15T12:22:52.313103+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:22:52.313103+0000","last_undegraded":"2024-09-15T12:22:52.313103+0000","last_fullsized":"2024-09-15T12:22:52.313103+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":945225728,"num_objects":14423,"num_object_clones":0,"num_object_copies":43269,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14423,"num_write_kb":923072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":177700864,"data_stored":2843213824,"data_compressed":135007675,"data_compressed_allocated":177700864,"data_compressed_original":2843213824,"omap_allocated":0,"internal_metadata":0},"log_size":14423,"ondisk_log_size":14423,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673229,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":114956,"kb_used_data":47868,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94256884,"statfs":{"total":96636764160,"available":96519049216,"internally_reserved":0,"allocated":49016832,"data_stored":777853858,"data_compressed":36931211,"data_compressed_allocated":48611328,"data_compressed_original":777699328,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":84988,"kb_used_data":35948,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94286852,"statfs":{"total":96636764160,"available":96549736448,"internally_reserved":0,"allocated":36810752,"data_stored":582491061,"data_compressed":27654577,"data_compressed_allocated":36401152,"data_compressed_original":582336512,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":96048,"kb_used_data":47008,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94275792,"statfs":{"total":96636764160,"available":96538411008,"internally_reserved":0,"allocated":48136192,"data_stored":764090773,"data_compressed":36275683,"data_compressed_allocated":47747072,"data_compressed_original":763953152,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":96644,"kb_used_data":43444,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94275196,"statfs":{"total":96636764160,"available":96537800704,"internally_reserved":0,"allocated":44486656,"data_stored":705305525,"data_compressed":33486308,"data_compressed_allocated":44077056,"data_compressed_original":705150976,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":44294144,"data_stored":708706304,"data_compressed":33652332,"data_compressed_allocated":44294144,"data_compressed_original":708706304,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":48009216,"data_stored":768147456,"data_compressed":36474851,"data_compressed_allocated":48009216,"data_compressed_original":768147456,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36589568,"data_stored":585433088,"data_compressed":27798817,"data_compressed_allocated":36589568,"data_compressed_original":585433088,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":48807936,"data_stored":780926976,"data_compressed":37081675,"data_compressed_allocated":48807936,"data_compressed_original":780926976,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:23:39.348 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:23:39.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:39.552+0000 7fbe90d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:39.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:39.566+0000 7fbe90d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:39.941 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:23:39.942 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:23:39.965 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2024-09-15T12:23:39.761920+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":945816115,"num_objects":14427,"num_object_clones":0,"num_object_copies":43281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":14504,"num_write_kb":924180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14478,"ondisk_log_size":14478,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":392636,"kb_used_data":174268,"kb_used_omap":0,"kb_used_meta":218304,"kb_avail":377094724,"statfs":{"total":386547056640,"available":386144997376,"internally_reserved":0,"allocated":178450432,"data_stored":2829741217,"data_compressed":134347779,"data_compressed_allocated":176836608,"data_compressed_original":2829139968,"omap_allocated":0,"internal_metadata":223543296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000776"},"pg_stats":[{"pgid":"4.f","version":"46'919","reported_seq":967,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.728004+0000","last_change":"2024-09-15T12:22:00.377854+0000","last_active":"2024-09-15T12:23:10.728004+0000","last_peered":"2024-09-15T12:23:10.728004+0000","last_clean":"2024-09-15T12:23:10.728004+0000","last_became_active":"2024-09-15T12:22:00.359790+0000","last_became_peered":"2024-09-15T12:22:00.359790+0000","last_unstale":"2024-09-15T12:23:10.728004+0000","last_undegraded":"2024-09-15T12:23:10.728004+0000","last_fullsized":"2024-09-15T12:23:10.728004+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":919,"log_dups_size":0,"ondisk_log_size":919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60227584,"num_objects":919,"num_object_clones":0,"num_object_copies":2757,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":919,"num_write_kb":58816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"46'888","reported_seq":936,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.668940+0000","last_change":"2024-09-15T12:22:00.383291+0000","last_active":"2024-09-15T12:23:10.668940+0000","last_peered":"2024-09-15T12:23:10.668940+0000","last_clean":"2024-09-15T12:23:10.668940+0000","last_became_active":"2024-09-15T12:22:00.376330+0000","last_became_peered":"2024-09-15T12:22:00.376330+0000","last_unstale":"2024-09-15T12:23:10.668940+0000","last_undegraded":"2024-09-15T12:23:10.668940+0000","last_fullsized":"2024-09-15T12:23:10.668940+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58195968,"num_objects":888,"num_object_clones":0,"num_object_copies":2664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":56832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"46'930","reported_seq":978,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.560765+0000","last_change":"2024-09-15T12:22:00.413467+0000","last_active":"2024-09-15T12:23:10.560765+0000","last_peered":"2024-09-15T12:23:10.560765+0000","last_clean":"2024-09-15T12:23:10.560765+0000","last_became_active":"2024-09-15T12:22:00.399293+0000","last_became_peered":"2024-09-15T12:22:00.399293+0000","last_unstale":"2024-09-15T12:23:10.560765+0000","last_undegraded":"2024-09-15T12:23:10.560765+0000","last_fullsized":"2024-09-15T12:23:10.560765+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":930,"log_dups_size":0,"ondisk_log_size":930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60948480,"num_objects":930,"num_object_clones":0,"num_object_copies":2790,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":930,"num_write_kb":59520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"46'915","reported_seq":963,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:11.752262+0000","last_change":"2024-09-15T12:22:00.397700+0000","last_active":"2024-09-15T12:23:11.752262+0000","last_peered":"2024-09-15T12:23:11.752262+0000","last_clean":"2024-09-15T12:23:11.752262+0000","last_became_active":"2024-09-15T12:22:00.388314+0000","last_became_peered":"2024-09-15T12:22:00.388314+0000","last_unstale":"2024-09-15T12:23:11.752262+0000","last_undegraded":"2024-09-15T12:23:11.752262+0000","last_fullsized":"2024-09-15T12:23:11.752262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59965440,"num_objects":915,"num_object_clones":0,"num_object_copies":2745,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":915,"num_write_kb":58560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"46'835","reported_seq":883,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.283424+0000","last_change":"2024-09-15T12:22:00.418610+0000","last_active":"2024-09-15T12:23:10.283424+0000","last_peered":"2024-09-15T12:23:10.283424+0000","last_clean":"2024-09-15T12:23:10.283424+0000","last_became_active":"2024-09-15T12:22:00.404352+0000","last_became_peered":"2024-09-15T12:22:00.404352+0000","last_unstale":"2024-09-15T12:23:10.283424+0000","last_undegraded":"2024-09-15T12:23:10.283424+0000","last_fullsized":"2024-09-15T12:23:10.283424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54722560,"num_objects":835,"num_object_clones":0,"num_object_copies":2505,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":835,"num_write_kb":53440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"46'881","reported_seq":929,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.596733+0000","last_change":"2024-09-15T12:22:00.408893+0000","last_active":"2024-09-15T12:23:10.596733+0000","last_peered":"2024-09-15T12:23:10.596733+0000","last_clean":"2024-09-15T12:23:10.596733+0000","last_became_active":"2024-09-15T12:22:00.399557+0000","last_became_peered":"2024-09-15T12:22:00.399557+0000","last_unstale":"2024-09-15T12:23:10.596733+0000","last_undegraded":"2024-09-15T12:23:10.596733+0000","last_fullsized":"2024-09-15T12:23:10.596733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57737216,"num_objects":881,"num_object_clones":0,"num_object_copies":2643,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":881,"num_write_kb":56384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"46'931","reported_seq":979,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.597932+0000","last_change":"2024-09-15T12:22:00.458263+0000","last_active":"2024-09-15T12:23:10.597932+0000","last_peered":"2024-09-15T12:23:10.597932+0000","last_clean":"2024-09-15T12:23:10.597932+0000","last_became_active":"2024-09-15T12:22:00.446629+0000","last_became_peered":"2024-09-15T12:22:00.446629+0000","last_unstale":"2024-09-15T12:23:10.597932+0000","last_undegraded":"2024-09-15T12:23:10.597932+0000","last_fullsized":"2024-09-15T12:23:10.597932+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":931,"log_dups_size":0,"ondisk_log_size":931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61014016,"num_objects":931,"num_object_clones":0,"num_object_copies":2793,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":931,"num_write_kb":59584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"46'941","reported_seq":989,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.708141+0000","last_change":"2024-09-15T12:22:00.432607+0000","last_active":"2024-09-15T12:23:10.708141+0000","last_peered":"2024-09-15T12:23:10.708141+0000","last_clean":"2024-09-15T12:23:10.708141+0000","last_became_active":"2024-09-15T12:22:00.422177+0000","last_became_peered":"2024-09-15T12:22:00.422177+0000","last_unstale":"2024-09-15T12:23:10.708141+0000","last_undegraded":"2024-09-15T12:23:10.708141+0000","last_fullsized":"2024-09-15T12:23:10.708141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":941,"log_dups_size":0,"ondisk_log_size":941,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61669376,"num_objects":941,"num_object_clones":0,"num_object_copies":2823,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":941,"num_write_kb":60224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"46'867","reported_seq":915,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.671056+0000","last_change":"2024-09-15T12:22:00.420197+0000","last_active":"2024-09-15T12:23:10.671056+0000","last_peered":"2024-09-15T12:23:10.671056+0000","last_clean":"2024-09-15T12:23:10.671056+0000","last_became_active":"2024-09-15T12:22:00.406666+0000","last_became_peered":"2024-09-15T12:22:00.406666+0000","last_unstale":"2024-09-15T12:23:10.671056+0000","last_undegraded":"2024-09-15T12:23:10.671056+0000","last_fullsized":"2024-09-15T12:23:10.671056+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56819712,"num_objects":867,"num_object_clones":0,"num_object_copies":2601,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":867,"num_write_kb":55488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":181,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.296581+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:22:52.296581+0000","last_peered":"2024-09-15T12:22:52.296581+0000","last_clean":"2024-09-15T12:22:52.296581+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:22:52.296581+0000","last_undegraded":"2024-09-15T12:22:52.296581+0000","last_fullsized":"2024-09-15T12:22:52.296581+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":110,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.305678+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:22:52.305678+0000","last_peered":"2024-09-15T12:22:52.305678+0000","last_clean":"2024-09-15T12:22:52.305678+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:22:52.305678+0000","last_undegraded":"2024-09-15T12:22:52.305678+0000","last_fullsized":"2024-09-15T12:22:52.305678+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"46'896","reported_seq":944,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.618027+0000","last_change":"2024-09-15T12:22:00.381165+0000","last_active":"2024-09-15T12:23:10.618027+0000","last_peered":"2024-09-15T12:23:10.618027+0000","last_clean":"2024-09-15T12:23:10.618027+0000","last_became_active":"2024-09-15T12:22:00.374145+0000","last_became_peered":"2024-09-15T12:22:00.374145+0000","last_unstale":"2024-09-15T12:23:10.618027+0000","last_undegraded":"2024-09-15T12:23:10.618027+0000","last_fullsized":"2024-09-15T12:23:10.618027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":896,"log_dups_size":0,"ondisk_log_size":896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":896,"num_object_clones":0,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.321345+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:22:52.321345+0000","last_peered":"2024-09-15T12:22:52.321345+0000","last_clean":"2024-09-15T12:22:52.321345+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:22:52.321345+0000","last_undegraded":"2024-09-15T12:22:52.321345+0000","last_fullsized":"2024-09-15T12:22:52.321345+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"46'873","reported_seq":921,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.559123+0000","last_change":"2024-09-15T12:22:00.405131+0000","last_active":"2024-09-15T12:23:10.559123+0000","last_peered":"2024-09-15T12:23:10.559123+0000","last_clean":"2024-09-15T12:23:10.559123+0000","last_became_active":"2024-09-15T12:22:00.398288+0000","last_became_peered":"2024-09-15T12:22:00.398288+0000","last_unstale":"2024-09-15T12:23:10.559123+0000","last_undegraded":"2024-09-15T12:23:10.559123+0000","last_fullsized":"2024-09-15T12:23:10.559123+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":873,"log_dups_size":0,"ondisk_log_size":873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57212928,"num_objects":873,"num_object_clones":0,"num_object_copies":2619,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":873,"num_write_kb":55872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.299731+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:22:52.299731+0000","last_peered":"2024-09-15T12:22:52.299731+0000","last_clean":"2024-09-15T12:22:52.299731+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:22:52.299731+0000","last_undegraded":"2024-09-15T12:22:52.299731+0000","last_fullsized":"2024-09-15T12:22:52.299731+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"46'933","reported_seq":981,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.515657+0000","last_change":"2024-09-15T12:22:00.390143+0000","last_active":"2024-09-15T12:23:10.515657+0000","last_peered":"2024-09-15T12:23:10.515657+0000","last_clean":"2024-09-15T12:23:10.515657+0000","last_became_active":"2024-09-15T12:22:00.370049+0000","last_became_peered":"2024-09-15T12:22:00.370049+0000","last_unstale":"2024-09-15T12:23:10.515657+0000","last_undegraded":"2024-09-15T12:23:10.515657+0000","last_fullsized":"2024-09-15T12:23:10.515657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":933,"log_dups_size":0,"ondisk_log_size":933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61145088,"num_objects":933,"num_object_clones":0,"num_object_copies":2799,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":933,"num_write_kb":59712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":111,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.312250+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:22:52.312250+0000","last_peered":"2024-09-15T12:22:52.312250+0000","last_clean":"2024-09-15T12:22:52.312250+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:22:52.312250+0000","last_undegraded":"2024-09-15T12:22:52.312250+0000","last_fullsized":"2024-09-15T12:22:52.312250+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"46'892","reported_seq":940,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.698741+0000","last_change":"2024-09-15T12:22:00.450159+0000","last_active":"2024-09-15T12:23:10.698741+0000","last_peered":"2024-09-15T12:23:10.698741+0000","last_clean":"2024-09-15T12:23:10.698741+0000","last_became_active":"2024-09-15T12:22:00.437056+0000","last_became_peered":"2024-09-15T12:22:00.437056+0000","last_unstale":"2024-09-15T12:23:10.698741+0000","last_undegraded":"2024-09-15T12:23:10.698741+0000","last_fullsized":"2024-09-15T12:23:10.698741+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58458112,"num_objects":892,"num_object_clones":0,"num_object_copies":2676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":892,"num_write_kb":57088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.299407+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:22:52.299407+0000","last_peered":"2024-09-15T12:22:52.299407+0000","last_clean":"2024-09-15T12:22:52.299407+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:22:52.299407+0000","last_undegraded":"2024-09-15T12:22:52.299407+0000","last_fullsized":"2024-09-15T12:22:52.299407+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"46'888","reported_seq":936,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.735246+0000","last_change":"2024-09-15T12:22:00.364579+0000","last_active":"2024-09-15T12:23:10.735246+0000","last_peered":"2024-09-15T12:23:10.735246+0000","last_clean":"2024-09-15T12:23:10.735246+0000","last_became_active":"2024-09-15T12:22:00.353614+0000","last_became_peered":"2024-09-15T12:22:00.353614+0000","last_unstale":"2024-09-15T12:23:10.735246+0000","last_undegraded":"2024-09-15T12:23:10.735246+0000","last_fullsized":"2024-09-15T12:23:10.735246+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58195968,"num_objects":888,"num_object_clones":0,"num_object_copies":2664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":56832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.300413+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:22:52.300413+0000","last_peered":"2024-09-15T12:22:52.300413+0000","last_clean":"2024-09-15T12:22:52.300413+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:22:52.300413+0000","last_undegraded":"2024-09-15T12:22:52.300413+0000","last_fullsized":"2024-09-15T12:22:52.300413+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"46'910","reported_seq":958,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.636546+0000","last_change":"2024-09-15T12:22:00.384094+0000","last_active":"2024-09-15T12:23:10.636546+0000","last_peered":"2024-09-15T12:23:10.636546+0000","last_clean":"2024-09-15T12:23:10.636546+0000","last_became_active":"2024-09-15T12:22:00.377789+0000","last_became_peered":"2024-09-15T12:22:00.377789+0000","last_unstale":"2024-09-15T12:23:10.636546+0000","last_undegraded":"2024-09-15T12:23:10.636546+0000","last_fullsized":"2024-09-15T12:23:10.636546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59637760,"num_objects":910,"num_object_clones":0,"num_object_copies":2730,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":910,"num_write_kb":58240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.307644+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:22:52.307644+0000","last_peered":"2024-09-15T12:22:52.307644+0000","last_clean":"2024-09-15T12:22:52.307644+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:22:52.307644+0000","last_undegraded":"2024-09-15T12:22:52.307644+0000","last_fullsized":"2024-09-15T12:22:52.307644+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"46'924","reported_seq":972,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.724930+0000","last_change":"2024-09-15T12:22:00.394121+0000","last_active":"2024-09-15T12:23:10.724930+0000","last_peered":"2024-09-15T12:23:10.724930+0000","last_clean":"2024-09-15T12:23:10.724930+0000","last_became_active":"2024-09-15T12:22:00.388183+0000","last_became_peered":"2024-09-15T12:22:00.388183+0000","last_unstale":"2024-09-15T12:23:10.724930+0000","last_undegraded":"2024-09-15T12:23:10.724930+0000","last_fullsized":"2024-09-15T12:23:10.724930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":924,"log_dups_size":0,"ondisk_log_size":924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60555264,"num_objects":924,"num_object_clones":0,"num_object_copies":2772,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":924,"num_write_kb":59136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.313103+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:22:52.313103+0000","last_peered":"2024-09-15T12:22:52.313103+0000","last_clean":"2024-09-15T12:22:52.313103+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:22:52.313103+0000","last_undegraded":"2024-09-15T12:22:52.313103+0000","last_fullsized":"2024-09-15T12:22:52.313103+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":945225728,"num_objects":14423,"num_object_clones":0,"num_object_copies":43269,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14423,"num_write_kb":923072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":177700864,"data_stored":2843213824,"data_compressed":135007675,"data_compressed_allocated":177700864,"data_compressed_original":2843213824,"omap_allocated":0,"internal_metadata":0},"log_size":14423,"ondisk_log_size":14423,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673229,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":114956,"kb_used_data":47868,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94256884,"statfs":{"total":96636764160,"available":96519049216,"internally_reserved":0,"allocated":49016832,"data_stored":777853858,"data_compressed":36931211,"data_compressed_allocated":48611328,"data_compressed_original":777699328,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":84988,"kb_used_data":35948,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94286852,"statfs":{"total":96636764160,"available":96549736448,"internally_reserved":0,"allocated":36810752,"data_stored":582491061,"data_compressed":27654577,"data_compressed_allocated":36401152,"data_compressed_original":582336512,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":96048,"kb_used_data":47008,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94275792,"statfs":{"total":96636764160,"available":96538411008,"internally_reserved":0,"allocated":48136192,"data_stored":764090773,"data_compressed":36275683,"data_compressed_allocated":47747072,"data_compressed_original":763953152,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":96644,"kb_used_data":43444,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94275196,"statfs":{"total":96636764160,"available":96537800704,"internally_reserved":0,"allocated":44486656,"data_stored":705305525,"data_compressed":33486308,"data_compressed_allocated":44077056,"data_compressed_original":705150976,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":44294144,"data_stored":708706304,"data_compressed":33652332,"data_compressed_allocated":44294144,"data_compressed_original":708706304,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":48009216,"data_stored":768147456,"data_compressed":36474851,"data_compressed_allocated":48009216,"data_compressed_original":768147456,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36589568,"data_stored":585433088,"data_compressed":27798817,"data_compressed_allocated":36589568,"data_compressed_original":585433088,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":48807936,"data_stored":780926976,"data_compressed":37081675,"data_compressed_allocated":48807936,"data_compressed_original":780926976,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:23:39.967 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-15T12:23:39.967 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:23:39.967 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:23:40.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:40.107+0000 7faf26591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:40.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:40.119+0000 7faf26591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:40.381 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:23:40.381 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:23:40.398 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2024-09-15T12:23:39.761920+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":945816115,"num_objects":14427,"num_object_clones":0,"num_object_copies":43281,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":14504,"num_write_kb":924180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14478,"ondisk_log_size":14478,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":392636,"kb_used_data":174268,"kb_used_omap":0,"kb_used_meta":218304,"kb_avail":377094724,"statfs":{"total":386547056640,"available":386144997376,"internally_reserved":0,"allocated":178450432,"data_stored":2829741217,"data_compressed":134347779,"data_compressed_allocated":176836608,"data_compressed_original":2829139968,"omap_allocated":0,"internal_metadata":223543296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000776"},"pg_stats":[{"pgid":"4.f","version":"46'919","reported_seq":967,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.728004+0000","last_change":"2024-09-15T12:22:00.377854+0000","last_active":"2024-09-15T12:23:10.728004+0000","last_peered":"2024-09-15T12:23:10.728004+0000","last_clean":"2024-09-15T12:23:10.728004+0000","last_became_active":"2024-09-15T12:22:00.359790+0000","last_became_peered":"2024-09-15T12:22:00.359790+0000","last_unstale":"2024-09-15T12:23:10.728004+0000","last_undegraded":"2024-09-15T12:23:10.728004+0000","last_fullsized":"2024-09-15T12:23:10.728004+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":919,"log_dups_size":0,"ondisk_log_size":919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60227584,"num_objects":919,"num_object_clones":0,"num_object_copies":2757,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":919,"num_write_kb":58816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"46'888","reported_seq":936,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.668940+0000","last_change":"2024-09-15T12:22:00.383291+0000","last_active":"2024-09-15T12:23:10.668940+0000","last_peered":"2024-09-15T12:23:10.668940+0000","last_clean":"2024-09-15T12:23:10.668940+0000","last_became_active":"2024-09-15T12:22:00.376330+0000","last_became_peered":"2024-09-15T12:22:00.376330+0000","last_unstale":"2024-09-15T12:23:10.668940+0000","last_undegraded":"2024-09-15T12:23:10.668940+0000","last_fullsized":"2024-09-15T12:23:10.668940+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58195968,"num_objects":888,"num_object_clones":0,"num_object_copies":2664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":56832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"46'930","reported_seq":978,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.560765+0000","last_change":"2024-09-15T12:22:00.413467+0000","last_active":"2024-09-15T12:23:10.560765+0000","last_peered":"2024-09-15T12:23:10.560765+0000","last_clean":"2024-09-15T12:23:10.560765+0000","last_became_active":"2024-09-15T12:22:00.399293+0000","last_became_peered":"2024-09-15T12:22:00.399293+0000","last_unstale":"2024-09-15T12:23:10.560765+0000","last_undegraded":"2024-09-15T12:23:10.560765+0000","last_fullsized":"2024-09-15T12:23:10.560765+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":930,"log_dups_size":0,"ondisk_log_size":930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60948480,"num_objects":930,"num_object_clones":0,"num_object_copies":2790,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":930,"num_write_kb":59520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"46'915","reported_seq":963,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:11.752262+0000","last_change":"2024-09-15T12:22:00.397700+0000","last_active":"2024-09-15T12:23:11.752262+0000","last_peered":"2024-09-15T12:23:11.752262+0000","last_clean":"2024-09-15T12:23:11.752262+0000","last_became_active":"2024-09-15T12:22:00.388314+0000","last_became_peered":"2024-09-15T12:22:00.388314+0000","last_unstale":"2024-09-15T12:23:11.752262+0000","last_undegraded":"2024-09-15T12:23:11.752262+0000","last_fullsized":"2024-09-15T12:23:11.752262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":915,"log_dups_size":0,"ondisk_log_size":915,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59965440,"num_objects":915,"num_object_clones":0,"num_object_copies":2745,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":915,"num_write_kb":58560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"46'835","reported_seq":883,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.283424+0000","last_change":"2024-09-15T12:22:00.418610+0000","last_active":"2024-09-15T12:23:10.283424+0000","last_peered":"2024-09-15T12:23:10.283424+0000","last_clean":"2024-09-15T12:23:10.283424+0000","last_became_active":"2024-09-15T12:22:00.404352+0000","last_became_peered":"2024-09-15T12:22:00.404352+0000","last_unstale":"2024-09-15T12:23:10.283424+0000","last_undegraded":"2024-09-15T12:23:10.283424+0000","last_fullsized":"2024-09-15T12:23:10.283424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54722560,"num_objects":835,"num_object_clones":0,"num_object_copies":2505,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":835,"num_write_kb":53440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"46'881","reported_seq":929,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.596733+0000","last_change":"2024-09-15T12:22:00.408893+0000","last_active":"2024-09-15T12:23:10.596733+0000","last_peered":"2024-09-15T12:23:10.596733+0000","last_clean":"2024-09-15T12:23:10.596733+0000","last_became_active":"2024-09-15T12:22:00.399557+0000","last_became_peered":"2024-09-15T12:22:00.399557+0000","last_unstale":"2024-09-15T12:23:10.596733+0000","last_undegraded":"2024-09-15T12:23:10.596733+0000","last_fullsized":"2024-09-15T12:23:10.596733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57737216,"num_objects":881,"num_object_clones":0,"num_object_copies":2643,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":881,"num_write_kb":56384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"46'931","reported_seq":979,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.597932+0000","last_change":"2024-09-15T12:22:00.458263+0000","last_active":"2024-09-15T12:23:10.597932+0000","last_peered":"2024-09-15T12:23:10.597932+0000","last_clean":"2024-09-15T12:23:10.597932+0000","last_became_active":"2024-09-15T12:22:00.446629+0000","last_became_peered":"2024-09-15T12:22:00.446629+0000","last_unstale":"2024-09-15T12:23:10.597932+0000","last_undegraded":"2024-09-15T12:23:10.597932+0000","last_fullsized":"2024-09-15T12:23:10.597932+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":931,"log_dups_size":0,"ondisk_log_size":931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61014016,"num_objects":931,"num_object_clones":0,"num_object_copies":2793,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":931,"num_write_kb":59584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"46'941","reported_seq":989,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.708141+0000","last_change":"2024-09-15T12:22:00.432607+0000","last_active":"2024-09-15T12:23:10.708141+0000","last_peered":"2024-09-15T12:23:10.708141+0000","last_clean":"2024-09-15T12:23:10.708141+0000","last_became_active":"2024-09-15T12:22:00.422177+0000","last_became_peered":"2024-09-15T12:22:00.422177+0000","last_unstale":"2024-09-15T12:23:10.708141+0000","last_undegraded":"2024-09-15T12:23:10.708141+0000","last_fullsized":"2024-09-15T12:23:10.708141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":941,"log_dups_size":0,"ondisk_log_size":941,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61669376,"num_objects":941,"num_object_clones":0,"num_object_copies":2823,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":941,"num_write_kb":60224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"46'867","reported_seq":915,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.671056+0000","last_change":"2024-09-15T12:22:00.420197+0000","last_active":"2024-09-15T12:23:10.671056+0000","last_peered":"2024-09-15T12:23:10.671056+0000","last_clean":"2024-09-15T12:23:10.671056+0000","last_became_active":"2024-09-15T12:22:00.406666+0000","last_became_peered":"2024-09-15T12:22:00.406666+0000","last_unstale":"2024-09-15T12:23:10.671056+0000","last_undegraded":"2024-09-15T12:23:10.671056+0000","last_fullsized":"2024-09-15T12:23:10.671056+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":867,"log_dups_size":0,"ondisk_log_size":867,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56819712,"num_objects":867,"num_object_clones":0,"num_object_copies":2601,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":867,"num_write_kb":55488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":181,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.296581+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:22:52.296581+0000","last_peered":"2024-09-15T12:22:52.296581+0000","last_clean":"2024-09-15T12:22:52.296581+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:22:52.296581+0000","last_undegraded":"2024-09-15T12:22:52.296581+0000","last_fullsized":"2024-09-15T12:22:52.296581+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":110,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.305678+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:22:52.305678+0000","last_peered":"2024-09-15T12:22:52.305678+0000","last_clean":"2024-09-15T12:22:52.305678+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:22:52.305678+0000","last_undegraded":"2024-09-15T12:22:52.305678+0000","last_fullsized":"2024-09-15T12:22:52.305678+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"46'896","reported_seq":944,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.618027+0000","last_change":"2024-09-15T12:22:00.381165+0000","last_active":"2024-09-15T12:23:10.618027+0000","last_peered":"2024-09-15T12:23:10.618027+0000","last_clean":"2024-09-15T12:23:10.618027+0000","last_became_active":"2024-09-15T12:22:00.374145+0000","last_became_peered":"2024-09-15T12:22:00.374145+0000","last_unstale":"2024-09-15T12:23:10.618027+0000","last_undegraded":"2024-09-15T12:23:10.618027+0000","last_fullsized":"2024-09-15T12:23:10.618027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":896,"log_dups_size":0,"ondisk_log_size":896,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":896,"num_object_clones":0,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":896,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.321345+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:22:52.321345+0000","last_peered":"2024-09-15T12:22:52.321345+0000","last_clean":"2024-09-15T12:22:52.321345+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:22:52.321345+0000","last_undegraded":"2024-09-15T12:22:52.321345+0000","last_fullsized":"2024-09-15T12:22:52.321345+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"46'873","reported_seq":921,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.559123+0000","last_change":"2024-09-15T12:22:00.405131+0000","last_active":"2024-09-15T12:23:10.559123+0000","last_peered":"2024-09-15T12:23:10.559123+0000","last_clean":"2024-09-15T12:23:10.559123+0000","last_became_active":"2024-09-15T12:22:00.398288+0000","last_became_peered":"2024-09-15T12:22:00.398288+0000","last_unstale":"2024-09-15T12:23:10.559123+0000","last_undegraded":"2024-09-15T12:23:10.559123+0000","last_fullsized":"2024-09-15T12:23:10.559123+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":873,"log_dups_size":0,"ondisk_log_size":873,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57212928,"num_objects":873,"num_object_clones":0,"num_object_copies":2619,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":873,"num_write_kb":55872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.299731+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:22:52.299731+0000","last_peered":"2024-09-15T12:22:52.299731+0000","last_clean":"2024-09-15T12:22:52.299731+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:22:52.299731+0000","last_undegraded":"2024-09-15T12:22:52.299731+0000","last_fullsized":"2024-09-15T12:22:52.299731+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"46'933","reported_seq":981,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.515657+0000","last_change":"2024-09-15T12:22:00.390143+0000","last_active":"2024-09-15T12:23:10.515657+0000","last_peered":"2024-09-15T12:23:10.515657+0000","last_clean":"2024-09-15T12:23:10.515657+0000","last_became_active":"2024-09-15T12:22:00.370049+0000","last_became_peered":"2024-09-15T12:22:00.370049+0000","last_unstale":"2024-09-15T12:23:10.515657+0000","last_undegraded":"2024-09-15T12:23:10.515657+0000","last_fullsized":"2024-09-15T12:23:10.515657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":933,"log_dups_size":0,"ondisk_log_size":933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61145088,"num_objects":933,"num_object_clones":0,"num_object_copies":2799,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":933,"num_write_kb":59712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":111,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.312250+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:22:52.312250+0000","last_peered":"2024-09-15T12:22:52.312250+0000","last_clean":"2024-09-15T12:22:52.312250+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:22:52.312250+0000","last_undegraded":"2024-09-15T12:22:52.312250+0000","last_fullsized":"2024-09-15T12:22:52.312250+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"46'892","reported_seq":940,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.698741+0000","last_change":"2024-09-15T12:22:00.450159+0000","last_active":"2024-09-15T12:23:10.698741+0000","last_peered":"2024-09-15T12:23:10.698741+0000","last_clean":"2024-09-15T12:23:10.698741+0000","last_became_active":"2024-09-15T12:22:00.437056+0000","last_became_peered":"2024-09-15T12:22:00.437056+0000","last_unstale":"2024-09-15T12:23:10.698741+0000","last_undegraded":"2024-09-15T12:23:10.698741+0000","last_fullsized":"2024-09-15T12:23:10.698741+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58458112,"num_objects":892,"num_object_clones":0,"num_object_copies":2676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":892,"num_write_kb":57088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.299407+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:22:52.299407+0000","last_peered":"2024-09-15T12:22:52.299407+0000","last_clean":"2024-09-15T12:22:52.299407+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:22:52.299407+0000","last_undegraded":"2024-09-15T12:22:52.299407+0000","last_fullsized":"2024-09-15T12:22:52.299407+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"46'888","reported_seq":936,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.735246+0000","last_change":"2024-09-15T12:22:00.364579+0000","last_active":"2024-09-15T12:23:10.735246+0000","last_peered":"2024-09-15T12:23:10.735246+0000","last_clean":"2024-09-15T12:23:10.735246+0000","last_became_active":"2024-09-15T12:22:00.353614+0000","last_became_peered":"2024-09-15T12:22:00.353614+0000","last_unstale":"2024-09-15T12:23:10.735246+0000","last_undegraded":"2024-09-15T12:23:10.735246+0000","last_fullsized":"2024-09-15T12:23:10.735246+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":888,"log_dups_size":0,"ondisk_log_size":888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58195968,"num_objects":888,"num_object_clones":0,"num_object_copies":2664,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":888,"num_write_kb":56832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.300413+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:22:52.300413+0000","last_peered":"2024-09-15T12:22:52.300413+0000","last_clean":"2024-09-15T12:22:52.300413+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:22:52.300413+0000","last_undegraded":"2024-09-15T12:22:52.300413+0000","last_fullsized":"2024-09-15T12:22:52.300413+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"46'910","reported_seq":958,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.636546+0000","last_change":"2024-09-15T12:22:00.384094+0000","last_active":"2024-09-15T12:23:10.636546+0000","last_peered":"2024-09-15T12:23:10.636546+0000","last_clean":"2024-09-15T12:23:10.636546+0000","last_became_active":"2024-09-15T12:22:00.377789+0000","last_became_peered":"2024-09-15T12:22:00.377789+0000","last_unstale":"2024-09-15T12:23:10.636546+0000","last_undegraded":"2024-09-15T12:23:10.636546+0000","last_fullsized":"2024-09-15T12:23:10.636546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":910,"log_dups_size":0,"ondisk_log_size":910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59637760,"num_objects":910,"num_object_clones":0,"num_object_copies":2730,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":910,"num_write_kb":58240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.307644+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:22:52.307644+0000","last_peered":"2024-09-15T12:22:52.307644+0000","last_clean":"2024-09-15T12:22:52.307644+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:22:52.307644+0000","last_undegraded":"2024-09-15T12:22:52.307644+0000","last_fullsized":"2024-09-15T12:22:52.307644+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"46'924","reported_seq":972,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:23:10.724930+0000","last_change":"2024-09-15T12:22:00.394121+0000","last_active":"2024-09-15T12:23:10.724930+0000","last_peered":"2024-09-15T12:23:10.724930+0000","last_clean":"2024-09-15T12:23:10.724930+0000","last_became_active":"2024-09-15T12:22:00.388183+0000","last_became_peered":"2024-09-15T12:22:00.388183+0000","last_unstale":"2024-09-15T12:23:10.724930+0000","last_undegraded":"2024-09-15T12:23:10.724930+0000","last_fullsized":"2024-09-15T12:23:10.724930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":924,"log_dups_size":0,"ondisk_log_size":924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60555264,"num_objects":924,"num_object_clones":0,"num_object_copies":2772,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":924,"num_write_kb":59136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-15T12:22:52.313103+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:22:52.313103+0000","last_peered":"2024-09-15T12:22:52.313103+0000","last_clean":"2024-09-15T12:22:52.313103+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:22:52.313103+0000","last_undegraded":"2024-09-15T12:22:52.313103+0000","last_fullsized":"2024-09-15T12:22:52.313103+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":945225728,"num_objects":14423,"num_object_clones":0,"num_object_copies":43269,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14423,"num_write_kb":923072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":177700864,"data_stored":2843213824,"data_compressed":135007675,"data_compressed_allocated":177700864,"data_compressed_original":2843213824,"omap_allocated":0,"internal_metadata":0},"log_size":14423,"ondisk_log_size":14423,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673229,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":114956,"kb_used_data":47868,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94256884,"statfs":{"total":96636764160,"available":96519049216,"internally_reserved":0,"allocated":49016832,"data_stored":777853858,"data_compressed":36931211,"data_compressed_allocated":48611328,"data_compressed_original":777699328,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":84988,"kb_used_data":35948,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94286852,"statfs":{"total":96636764160,"available":96549736448,"internally_reserved":0,"allocated":36810752,"data_stored":582491061,"data_compressed":27654577,"data_compressed_allocated":36401152,"data_compressed_original":582336512,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":96048,"kb_used_data":47008,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94275792,"statfs":{"total":96636764160,"available":96538411008,"internally_reserved":0,"allocated":48136192,"data_stored":764090773,"data_compressed":36275683,"data_compressed_allocated":47747072,"data_compressed_original":763953152,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":96644,"kb_used_data":43444,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94275196,"statfs":{"total":96636764160,"available":96537800704,"internally_reserved":0,"allocated":44486656,"data_stored":705305525,"data_compressed":33486308,"data_compressed_allocated":44077056,"data_compressed_original":705150976,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":44294144,"data_stored":708706304,"data_compressed":33652332,"data_compressed_allocated":44294144,"data_compressed_original":708706304,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":48009216,"data_stored":768147456,"data_compressed":36474851,"data_compressed_allocated":48009216,"data_compressed_original":768147456,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36589568,"data_stored":585433088,"data_compressed":27798817,"data_compressed_allocated":36589568,"data_compressed_original":585433088,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":48807936,"data_stored":780926976,"data_compressed":37081675,"data_compressed_allocated":48807936,"data_compressed_original":780926976,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:23:41.337 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:23:41.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:41.503+0000 7f5a708fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:41.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:41.516+0000 7f5a708fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:44.017 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:23:44.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:44.177+0000 7f0408cc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:44.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:44.189+0000 7f0408cc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:45.401 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:23:45.401 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:23:45.401 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:23:45.401 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:23:45.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:45.544+0000 7f662bf51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:45.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:45.559+0000 7f662bf51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:45.681 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:23:45.681 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:23:45.681 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:23:45.681 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:23:45.681 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:23:45.681 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:23:45.682 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:23:45.682 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:23:45.682 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:23:45.682 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:23:45.682 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:23:45.682 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:23:45.688 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:23:45.689 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:23:45.689 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:23:45.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:45.863+0000 7f9300791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:45.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:45.875+0000 7f9300791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:45.951 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:23:45.952 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:23:45.952 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:23:45.952 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:23:45.952 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:23:45.952 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:23:45.952 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:23:45.952 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:23:45.952 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:23:45.952 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:23:45.952 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:23:45.952 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:23:45.955 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:23:45.956 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:23:45.956 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:23:46.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:46.097+0000 7faa00b08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:46.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:46.110+0000 7faa00b08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:46.134 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:23:46.134 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:23:46.134 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:23:46.134 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:23:46.134 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:23:46.134 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:23:46.135 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:23:46.135 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:23:46.135 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:23:46.135 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:23:46.135 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:23:46.135 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:23:46.137 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:23:46.138 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:23:46.138 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:23:46.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:46.303+0000 7f391d591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:46.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:46.318+0000 7f391d591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:46.439 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:23:46.439 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:23:46.440 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:23:46.440 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:23:46.440 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:23:46.440 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:23:46.440 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:23:46.440 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:23:46.440 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:23:46.440 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:23:46.440 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:23:46.440 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:23:46.443 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:23:46.443 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:23:46.651 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:23:46.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:46.790+0000 7f04b36f4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:46.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:46.801+0000 7f04b36f4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:49.390 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:23:49.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:49.533+0000 7fe646711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:49.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:49.541+0000 7fe646711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:51.444 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:23:51.444 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:23:51.445 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:23:51.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:51.603+0000 7f5825351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:51.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:51.613+0000 7f5825351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:51.911 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:23:51.911 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:23:51.932 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":198,"stamp":"2024-09-15T12:23:51.764335+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1090323019,"num_objects":16633,"num_object_clones":0,"num_object_copies":49899,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":19940,"num_write_kb":1168661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19914,"ondisk_log_size":19914,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":460368,"kb_used_data":201744,"kb_used_omap":0,"kb_used_meta":258560,"kb_avail":377026992,"statfs":{"total":386547056640,"available":386075639808,"internally_reserved":0,"allocated":206585856,"data_stored":3277666681,"data_compressed":155618517,"data_compressed_allocated":204828672,"data_compressed_original":3277012992,"omap_allocated":0,"internal_metadata":264765440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":144506904,"num_objects":2206,"num_object_clones":0,"num_object_copies":6618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5436,"num_write_kb":244481,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002415"},"pg_stats":[{"pgid":"4.f","version":"50'1273","reported_seq":1333,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.730421+0000","last_change":"2024-09-15T12:22:00.377854+0000","last_active":"2024-09-15T12:23:40.730421+0000","last_peered":"2024-09-15T12:23:40.730421+0000","last_clean":"2024-09-15T12:23:40.730421+0000","last_became_active":"2024-09-15T12:22:00.359790+0000","last_became_peered":"2024-09-15T12:22:00.359790+0000","last_unstale":"2024-09-15T12:23:40.730421+0000","last_undegraded":"2024-09-15T12:23:40.730421+0000","last_fullsized":"2024-09-15T12:23:40.730421+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1273,"log_dups_size":0,"ondisk_log_size":1273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69271552,"num_objects":1057,"num_object_clones":0,"num_object_copies":3171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1273,"num_write_kb":74560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"50'1250","reported_seq":1310,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.420454+0000","last_change":"2024-09-15T12:22:00.383291+0000","last_active":"2024-09-15T12:23:40.420454+0000","last_peered":"2024-09-15T12:23:40.420454+0000","last_clean":"2024-09-15T12:23:40.420454+0000","last_became_active":"2024-09-15T12:22:00.376330+0000","last_became_peered":"2024-09-15T12:22:00.376330+0000","last_unstale":"2024-09-15T12:23:40.420454+0000","last_undegraded":"2024-09-15T12:23:40.420454+0000","last_fullsized":"2024-09-15T12:23:40.420454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1250,"log_dups_size":0,"ondisk_log_size":1250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68419584,"num_objects":1044,"num_object_clones":0,"num_object_copies":3132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1250,"num_write_kb":73408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"50'1296","reported_seq":1357,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.692514+0000","last_change":"2024-09-15T12:22:00.413467+0000","last_active":"2024-09-15T12:23:40.692514+0000","last_peered":"2024-09-15T12:23:40.692514+0000","last_clean":"2024-09-15T12:23:40.692514+0000","last_became_active":"2024-09-15T12:22:00.399293+0000","last_became_peered":"2024-09-15T12:22:00.399293+0000","last_unstale":"2024-09-15T12:23:40.692514+0000","last_undegraded":"2024-09-15T12:23:40.692514+0000","last_fullsized":"2024-09-15T12:23:40.692514+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1296,"log_dups_size":0,"ondisk_log_size":1296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70582296,"num_objects":1078,"num_object_clones":0,"num_object_copies":3234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1296,"num_write_kb":75905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"50'1219","reported_seq":1279,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:41.598819+0000","last_change":"2024-09-15T12:22:00.397700+0000","last_active":"2024-09-15T12:23:41.598819+0000","last_peered":"2024-09-15T12:23:41.598819+0000","last_clean":"2024-09-15T12:23:41.598819+0000","last_became_active":"2024-09-15T12:22:00.388314+0000","last_became_peered":"2024-09-15T12:22:00.388314+0000","last_unstale":"2024-09-15T12:23:41.598819+0000","last_undegraded":"2024-09-15T12:23:41.598819+0000","last_fullsized":"2024-09-15T12:23:41.598819+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1219,"log_dups_size":0,"ondisk_log_size":1219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65339392,"num_objects":997,"num_object_clones":0,"num_object_copies":2991,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1219,"num_write_kb":70912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"50'1157","reported_seq":1217,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.556158+0000","last_change":"2024-09-15T12:22:00.418610+0000","last_active":"2024-09-15T12:23:40.556158+0000","last_peered":"2024-09-15T12:23:40.556158+0000","last_clean":"2024-09-15T12:23:40.556158+0000","last_became_active":"2024-09-15T12:22:00.404352+0000","last_became_peered":"2024-09-15T12:22:00.404352+0000","last_unstale":"2024-09-15T12:23:40.556158+0000","last_undegraded":"2024-09-15T12:23:40.556158+0000","last_fullsized":"2024-09-15T12:23:40.556158+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1157,"log_dups_size":0,"ondisk_log_size":1157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64552960,"num_objects":985,"num_object_clones":0,"num_object_copies":2955,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":68544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"50'1238","reported_seq":1298,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.664223+0000","last_change":"2024-09-15T12:22:00.408893+0000","last_active":"2024-09-15T12:23:40.664223+0000","last_peered":"2024-09-15T12:23:40.664223+0000","last_clean":"2024-09-15T12:23:40.664223+0000","last_became_active":"2024-09-15T12:22:00.399557+0000","last_became_peered":"2024-09-15T12:22:00.399557+0000","last_unstale":"2024-09-15T12:23:40.664223+0000","last_undegraded":"2024-09-15T12:23:40.664223+0000","last_fullsized":"2024-09-15T12:23:40.664223+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68157440,"num_objects":1040,"num_object_clones":0,"num_object_copies":3120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1238,"num_write_kb":72896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"50'1286","reported_seq":1346,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.585940+0000","last_change":"2024-09-15T12:22:00.458263+0000","last_active":"2024-09-15T12:23:40.585940+0000","last_peered":"2024-09-15T12:23:40.585940+0000","last_clean":"2024-09-15T12:23:40.585940+0000","last_became_active":"2024-09-15T12:22:00.446629+0000","last_became_peered":"2024-09-15T12:22:00.446629+0000","last_unstale":"2024-09-15T12:23:40.585940+0000","last_undegraded":"2024-09-15T12:23:40.585940+0000","last_fullsized":"2024-09-15T12:23:40.585940+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1286,"log_dups_size":0,"ondisk_log_size":1286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68288512,"num_objects":1042,"num_object_clones":0,"num_object_copies":3126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1286,"num_write_kb":74496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"50'1264","reported_seq":1324,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.689692+0000","last_change":"2024-09-15T12:22:00.432607+0000","last_active":"2024-09-15T12:23:40.689692+0000","last_peered":"2024-09-15T12:23:40.689692+0000","last_clean":"2024-09-15T12:23:40.689692+0000","last_became_active":"2024-09-15T12:22:00.422177+0000","last_became_peered":"2024-09-15T12:22:00.422177+0000","last_unstale":"2024-09-15T12:23:40.689692+0000","last_undegraded":"2024-09-15T12:23:40.689692+0000","last_fullsized":"2024-09-15T12:23:40.689692+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1264,"log_dups_size":0,"ondisk_log_size":1264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69074944,"num_objects":1054,"num_object_clones":0,"num_object_copies":3162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1264,"num_write_kb":74176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"50'1199","reported_seq":1259,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.527434+0000","last_change":"2024-09-15T12:22:00.420197+0000","last_active":"2024-09-15T12:23:40.527434+0000","last_peered":"2024-09-15T12:23:40.527434+0000","last_clean":"2024-09-15T12:23:40.527434+0000","last_became_active":"2024-09-15T12:22:00.406666+0000","last_became_peered":"2024-09-15T12:22:00.406666+0000","last_unstale":"2024-09-15T12:23:40.527434+0000","last_undegraded":"2024-09-15T12:23:40.527434+0000","last_fullsized":"2024-09-15T12:23:40.527434+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1199,"log_dups_size":0,"ondisk_log_size":1199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63373312,"num_objects":967,"num_object_clones":0,"num_object_copies":2901,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1199,"num_write_kb":69312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":193,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.876676+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:23:38.876676+0000","last_peered":"2024-09-15T12:23:38.876676+0000","last_clean":"2024-09-15T12:23:38.876676+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:23:38.876676+0000","last_undegraded":"2024-09-15T12:23:38.876676+0000","last_fullsized":"2024-09-15T12:23:38.876676+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":122,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.905388+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:23:38.905388+0000","last_peered":"2024-09-15T12:23:38.905388+0000","last_clean":"2024-09-15T12:23:38.905388+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:23:38.905388+0000","last_undegraded":"2024-09-15T12:23:38.905388+0000","last_fullsized":"2024-09-15T12:23:38.905388+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"50'1230","reported_seq":1290,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.556380+0000","last_change":"2024-09-15T12:22:00.381165+0000","last_active":"2024-09-15T12:23:40.556380+0000","last_peered":"2024-09-15T12:23:40.556380+0000","last_clean":"2024-09-15T12:23:40.556380+0000","last_became_active":"2024-09-15T12:22:00.374145+0000","last_became_peered":"2024-09-15T12:22:00.374145+0000","last_unstale":"2024-09-15T12:23:40.556380+0000","last_undegraded":"2024-09-15T12:23:40.556380+0000","last_fullsized":"2024-09-15T12:23:40.556380+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1230,"log_dups_size":0,"ondisk_log_size":1230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68157440,"num_objects":1040,"num_object_clones":0,"num_object_copies":3120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1230,"num_write_kb":72640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.906246+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:23:38.906246+0000","last_peered":"2024-09-15T12:23:38.906246+0000","last_clean":"2024-09-15T12:23:38.906246+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:23:38.906246+0000","last_undegraded":"2024-09-15T12:23:38.906246+0000","last_fullsized":"2024-09-15T12:23:38.906246+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"50'1219","reported_seq":1279,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.661818+0000","last_change":"2024-09-15T12:22:00.405131+0000","last_active":"2024-09-15T12:23:40.661818+0000","last_peered":"2024-09-15T12:23:40.661818+0000","last_clean":"2024-09-15T12:23:40.661818+0000","last_became_active":"2024-09-15T12:22:00.398288+0000","last_became_peered":"2024-09-15T12:22:00.398288+0000","last_unstale":"2024-09-15T12:23:40.661818+0000","last_undegraded":"2024-09-15T12:23:40.661818+0000","last_fullsized":"2024-09-15T12:23:40.661818+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1219,"log_dups_size":0,"ondisk_log_size":1219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67043328,"num_objects":1023,"num_object_clones":0,"num_object_copies":3069,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1219,"num_write_kb":71744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.899555+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:23:38.899555+0000","last_peered":"2024-09-15T12:23:38.899555+0000","last_clean":"2024-09-15T12:23:38.899555+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:23:38.899555+0000","last_undegraded":"2024-09-15T12:23:38.899555+0000","last_fullsized":"2024-09-15T12:23:38.899555+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"50'1265","reported_seq":1325,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.595458+0000","last_change":"2024-09-15T12:22:00.390143+0000","last_active":"2024-09-15T12:23:40.595458+0000","last_peered":"2024-09-15T12:23:40.595458+0000","last_clean":"2024-09-15T12:23:40.595458+0000","last_became_active":"2024-09-15T12:22:00.370049+0000","last_became_peered":"2024-09-15T12:22:00.370049+0000","last_unstale":"2024-09-15T12:23:40.595458+0000","last_undegraded":"2024-09-15T12:23:40.595458+0000","last_fullsized":"2024-09-15T12:23:40.595458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1265,"log_dups_size":0,"ondisk_log_size":1265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71106560,"num_objects":1085,"num_object_clones":0,"num_object_copies":3255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1265,"num_write_kb":75200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":123,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.899570+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:23:38.899570+0000","last_peered":"2024-09-15T12:23:38.899570+0000","last_clean":"2024-09-15T12:23:38.899570+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:23:38.899570+0000","last_undegraded":"2024-09-15T12:23:38.899570+0000","last_fullsized":"2024-09-15T12:23:38.899570+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"50'1216","reported_seq":1276,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.629971+0000","last_change":"2024-09-15T12:22:00.450159+0000","last_active":"2024-09-15T12:23:40.629971+0000","last_peered":"2024-09-15T12:23:40.629971+0000","last_clean":"2024-09-15T12:23:40.629971+0000","last_became_active":"2024-09-15T12:22:00.437056+0000","last_became_peered":"2024-09-15T12:22:00.437056+0000","last_unstale":"2024-09-15T12:23:40.629971+0000","last_undegraded":"2024-09-15T12:23:40.629971+0000","last_fullsized":"2024-09-15T12:23:40.629971+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67764224,"num_objects":1034,"num_object_clones":0,"num_object_copies":3102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":72000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.879479+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:23:38.879479+0000","last_peered":"2024-09-15T12:23:38.879479+0000","last_clean":"2024-09-15T12:23:38.879479+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:23:38.879479+0000","last_undegraded":"2024-09-15T12:23:38.879479+0000","last_fullsized":"2024-09-15T12:23:38.879479+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"50'1230","reported_seq":1290,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.757565+0000","last_change":"2024-09-15T12:22:00.364579+0000","last_active":"2024-09-15T12:23:40.757565+0000","last_peered":"2024-09-15T12:23:40.757565+0000","last_clean":"2024-09-15T12:23:40.757565+0000","last_became_active":"2024-09-15T12:22:00.353614+0000","last_became_peered":"2024-09-15T12:22:00.353614+0000","last_unstale":"2024-09-15T12:23:40.757565+0000","last_undegraded":"2024-09-15T12:23:40.757565+0000","last_fullsized":"2024-09-15T12:23:40.757565+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1230,"log_dups_size":0,"ondisk_log_size":1230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68026368,"num_objects":1038,"num_object_clones":0,"num_object_copies":3114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1230,"num_write_kb":72576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.884650+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:23:38.884650+0000","last_peered":"2024-09-15T12:23:38.884650+0000","last_clean":"2024-09-15T12:23:38.884650+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:23:38.884650+0000","last_undegraded":"2024-09-15T12:23:38.884650+0000","last_fullsized":"2024-09-15T12:23:38.884650+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"50'1249","reported_seq":1309,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.712037+0000","last_change":"2024-09-15T12:22:00.384094+0000","last_active":"2024-09-15T12:23:40.712037+0000","last_peered":"2024-09-15T12:23:40.712037+0000","last_clean":"2024-09-15T12:23:40.712037+0000","last_became_active":"2024-09-15T12:22:00.377789+0000","last_became_peered":"2024-09-15T12:22:00.377789+0000","last_unstale":"2024-09-15T12:23:40.712037+0000","last_undegraded":"2024-09-15T12:23:40.712037+0000","last_fullsized":"2024-09-15T12:23:40.712037+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1249,"log_dups_size":0,"ondisk_log_size":1249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71106560,"num_objects":1085,"num_object_clones":0,"num_object_copies":3255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1249,"num_write_kb":74688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.879601+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:23:38.879601+0000","last_peered":"2024-09-15T12:23:38.879601+0000","last_clean":"2024-09-15T12:23:38.879601+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:23:38.879601+0000","last_undegraded":"2024-09-15T12:23:38.879601+0000","last_fullsized":"2024-09-15T12:23:38.879601+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"50'1268","reported_seq":1328,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.734229+0000","last_change":"2024-09-15T12:22:00.394121+0000","last_active":"2024-09-15T12:23:40.734229+0000","last_peered":"2024-09-15T12:23:40.734229+0000","last_clean":"2024-09-15T12:23:40.734229+0000","last_became_active":"2024-09-15T12:22:00.388183+0000","last_became_peered":"2024-09-15T12:22:00.388183+0000","last_unstale":"2024-09-15T12:23:40.734229+0000","last_undegraded":"2024-09-15T12:23:40.734229+0000","last_fullsized":"2024-09-15T12:23:40.734229+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1268,"log_dups_size":0,"ondisk_log_size":1268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69468160,"num_objects":1060,"num_object_clones":0,"num_object_copies":3180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1268,"num_write_kb":74496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.906326+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:23:38.906326+0000","last_peered":"2024-09-15T12:23:38.906326+0000","last_clean":"2024-09-15T12:23:38.906326+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:23:38.906326+0000","last_undegraded":"2024-09-15T12:23:38.906326+0000","last_fullsized":"2024-09-15T12:23:38.906326+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":1089732632,"num_objects":16629,"num_object_clones":0,"num_object_copies":49887,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":19859,"num_write_kb":1167553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":203849728,"data_stored":3261399112,"data_compressed":154868677,"data_compressed_allocated":203837440,"data_compressed_original":3261399040,"omap_allocated":0,"internal_metadata":0},"log_size":19859,"ondisk_log_size":19859,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":125400,"kb_used_data":54152,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94246440,"statfs":{"total":96636764160,"available":96508354560,"internally_reserved":0,"allocated":55451648,"data_stored":880299718,"data_compressed":41796183,"data_compressed_allocated":55013376,"data_compressed_original":880132096,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":91460,"kb_used_data":42420,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94280380,"statfs":{"total":96636764160,"available":96543109120,"internally_reserved":0,"allocated":43438080,"data_stored":687951601,"data_compressed":32662463,"data_compressed_allocated":42991616,"data_compressed_original":687783936,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":121804,"kb_used_data":54716,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94250036,"statfs":{"total":96636764160,"available":96512036864,"internally_reserved":0,"allocated":56029184,"data_stored":889801937,"data_compressed":42245400,"data_compressed_allocated":55603200,"data_compressed_original":889651200,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":121704,"kb_used_data":50456,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94250136,"statfs":{"total":96636764160,"available":96512139264,"internally_reserved":0,"allocated":51666944,"data_stored":819613425,"data_compressed":38914471,"data_compressed_allocated":51220480,"data_compressed_original":819445760,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":50962432,"data_stored":815333400,"data_compressed":38716391,"data_compressed_allocated":50958336,"data_compressed_original":815333376,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":55386112,"data_stored":886112280,"data_compressed":42077352,"data_compressed_allocated":55382016,"data_compressed_original":886112256,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":42704896,"data_stored":683212824,"data_compressed":32442599,"data_compressed_allocated":42700800,"data_compressed_original":683212800,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":54796288,"data_stored":876740608,"data_compressed":41632335,"data_compressed_allocated":54796288,"data_compressed_original":876740608,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:23:52.001 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:23:52.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:52.171+0000 7f1e1d151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:52.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:52.179+0000 7f1e1d151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:54.835 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:23:55.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:55.000+0000 7f4343cac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:55.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:55.008+0000 7f4343cac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:56.935 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:23:56.935 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:23:56.935 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:23:57.114 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:57.106+0000 7f09ecb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:57.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:57.119+0000 7f09ecb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:57.424 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:23:57.426 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:23:57.440 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:23:57.448 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2024-09-15T12:23:55.765188+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1090323019,"num_objects":16633,"num_object_clones":0,"num_object_copies":49899,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":19940,"num_write_kb":1168661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19914,"ondisk_log_size":19914,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":460368,"kb_used_data":201744,"kb_used_omap":0,"kb_used_meta":258560,"kb_avail":377026992,"statfs":{"total":386547056640,"available":386075639808,"internally_reserved":0,"allocated":206585856,"data_stored":3277666681,"data_compressed":155618517,"data_compressed_allocated":204828672,"data_compressed_original":3277012992,"omap_allocated":0,"internal_metadata":264765440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002456"},"pg_stats":[{"pgid":"4.f","version":"50'1273","reported_seq":1333,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.730421+0000","last_change":"2024-09-15T12:22:00.377854+0000","last_active":"2024-09-15T12:23:40.730421+0000","last_peered":"2024-09-15T12:23:40.730421+0000","last_clean":"2024-09-15T12:23:40.730421+0000","last_became_active":"2024-09-15T12:22:00.359790+0000","last_became_peered":"2024-09-15T12:22:00.359790+0000","last_unstale":"2024-09-15T12:23:40.730421+0000","last_undegraded":"2024-09-15T12:23:40.730421+0000","last_fullsized":"2024-09-15T12:23:40.730421+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1273,"log_dups_size":0,"ondisk_log_size":1273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69271552,"num_objects":1057,"num_object_clones":0,"num_object_copies":3171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1273,"num_write_kb":74560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"50'1250","reported_seq":1310,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.420454+0000","last_change":"2024-09-15T12:22:00.383291+0000","last_active":"2024-09-15T12:23:40.420454+0000","last_peered":"2024-09-15T12:23:40.420454+0000","last_clean":"2024-09-15T12:23:40.420454+0000","last_became_active":"2024-09-15T12:22:00.376330+0000","last_became_peered":"2024-09-15T12:22:00.376330+0000","last_unstale":"2024-09-15T12:23:40.420454+0000","last_undegraded":"2024-09-15T12:23:40.420454+0000","last_fullsized":"2024-09-15T12:23:40.420454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1250,"log_dups_size":0,"ondisk_log_size":1250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68419584,"num_objects":1044,"num_object_clones":0,"num_object_copies":3132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1250,"num_write_kb":73408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"50'1296","reported_seq":1357,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.692514+0000","last_change":"2024-09-15T12:22:00.413467+0000","last_active":"2024-09-15T12:23:40.692514+0000","last_peered":"2024-09-15T12:23:40.692514+0000","last_clean":"2024-09-15T12:23:40.692514+0000","last_became_active":"2024-09-15T12:22:00.399293+0000","last_became_peered":"2024-09-15T12:22:00.399293+0000","last_unstale":"2024-09-15T12:23:40.692514+0000","last_undegraded":"2024-09-15T12:23:40.692514+0000","last_fullsized":"2024-09-15T12:23:40.692514+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1296,"log_dups_size":0,"ondisk_log_size":1296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70582296,"num_objects":1078,"num_object_clones":0,"num_object_copies":3234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1296,"num_write_kb":75905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"50'1219","reported_seq":1279,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:41.598819+0000","last_change":"2024-09-15T12:22:00.397700+0000","last_active":"2024-09-15T12:23:41.598819+0000","last_peered":"2024-09-15T12:23:41.598819+0000","last_clean":"2024-09-15T12:23:41.598819+0000","last_became_active":"2024-09-15T12:22:00.388314+0000","last_became_peered":"2024-09-15T12:22:00.388314+0000","last_unstale":"2024-09-15T12:23:41.598819+0000","last_undegraded":"2024-09-15T12:23:41.598819+0000","last_fullsized":"2024-09-15T12:23:41.598819+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1219,"log_dups_size":0,"ondisk_log_size":1219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65339392,"num_objects":997,"num_object_clones":0,"num_object_copies":2991,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1219,"num_write_kb":70912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"50'1157","reported_seq":1217,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.556158+0000","last_change":"2024-09-15T12:22:00.418610+0000","last_active":"2024-09-15T12:23:40.556158+0000","last_peered":"2024-09-15T12:23:40.556158+0000","last_clean":"2024-09-15T12:23:40.556158+0000","last_became_active":"2024-09-15T12:22:00.404352+0000","last_became_peered":"2024-09-15T12:22:00.404352+0000","last_unstale":"2024-09-15T12:23:40.556158+0000","last_undegraded":"2024-09-15T12:23:40.556158+0000","last_fullsized":"2024-09-15T12:23:40.556158+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1157,"log_dups_size":0,"ondisk_log_size":1157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64552960,"num_objects":985,"num_object_clones":0,"num_object_copies":2955,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":68544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"50'1238","reported_seq":1298,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.664223+0000","last_change":"2024-09-15T12:22:00.408893+0000","last_active":"2024-09-15T12:23:40.664223+0000","last_peered":"2024-09-15T12:23:40.664223+0000","last_clean":"2024-09-15T12:23:40.664223+0000","last_became_active":"2024-09-15T12:22:00.399557+0000","last_became_peered":"2024-09-15T12:22:00.399557+0000","last_unstale":"2024-09-15T12:23:40.664223+0000","last_undegraded":"2024-09-15T12:23:40.664223+0000","last_fullsized":"2024-09-15T12:23:40.664223+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68157440,"num_objects":1040,"num_object_clones":0,"num_object_copies":3120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1238,"num_write_kb":72896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"50'1286","reported_seq":1346,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.585940+0000","last_change":"2024-09-15T12:22:00.458263+0000","last_active":"2024-09-15T12:23:40.585940+0000","last_peered":"2024-09-15T12:23:40.585940+0000","last_clean":"2024-09-15T12:23:40.585940+0000","last_became_active":"2024-09-15T12:22:00.446629+0000","last_became_peered":"2024-09-15T12:22:00.446629+0000","last_unstale":"2024-09-15T12:23:40.585940+0000","last_undegraded":"2024-09-15T12:23:40.585940+0000","last_fullsized":"2024-09-15T12:23:40.585940+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1286,"log_dups_size":0,"ondisk_log_size":1286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68288512,"num_objects":1042,"num_object_clones":0,"num_object_copies":3126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1286,"num_write_kb":74496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"50'1264","reported_seq":1324,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.689692+0000","last_change":"2024-09-15T12:22:00.432607+0000","last_active":"2024-09-15T12:23:40.689692+0000","last_peered":"2024-09-15T12:23:40.689692+0000","last_clean":"2024-09-15T12:23:40.689692+0000","last_became_active":"2024-09-15T12:22:00.422177+0000","last_became_peered":"2024-09-15T12:22:00.422177+0000","last_unstale":"2024-09-15T12:23:40.689692+0000","last_undegraded":"2024-09-15T12:23:40.689692+0000","last_fullsized":"2024-09-15T12:23:40.689692+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1264,"log_dups_size":0,"ondisk_log_size":1264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69074944,"num_objects":1054,"num_object_clones":0,"num_object_copies":3162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1264,"num_write_kb":74176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"50'1199","reported_seq":1259,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.527434+0000","last_change":"2024-09-15T12:22:00.420197+0000","last_active":"2024-09-15T12:23:40.527434+0000","last_peered":"2024-09-15T12:23:40.527434+0000","last_clean":"2024-09-15T12:23:40.527434+0000","last_became_active":"2024-09-15T12:22:00.406666+0000","last_became_peered":"2024-09-15T12:22:00.406666+0000","last_unstale":"2024-09-15T12:23:40.527434+0000","last_undegraded":"2024-09-15T12:23:40.527434+0000","last_fullsized":"2024-09-15T12:23:40.527434+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1199,"log_dups_size":0,"ondisk_log_size":1199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63373312,"num_objects":967,"num_object_clones":0,"num_object_copies":2901,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1199,"num_write_kb":69312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":193,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.876676+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:23:38.876676+0000","last_peered":"2024-09-15T12:23:38.876676+0000","last_clean":"2024-09-15T12:23:38.876676+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:23:38.876676+0000","last_undegraded":"2024-09-15T12:23:38.876676+0000","last_fullsized":"2024-09-15T12:23:38.876676+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":122,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.905388+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:23:38.905388+0000","last_peered":"2024-09-15T12:23:38.905388+0000","last_clean":"2024-09-15T12:23:38.905388+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:23:38.905388+0000","last_undegraded":"2024-09-15T12:23:38.905388+0000","last_fullsized":"2024-09-15T12:23:38.905388+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"50'1230","reported_seq":1290,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.556380+0000","last_change":"2024-09-15T12:22:00.381165+0000","last_active":"2024-09-15T12:23:40.556380+0000","last_peered":"2024-09-15T12:23:40.556380+0000","last_clean":"2024-09-15T12:23:40.556380+0000","last_became_active":"2024-09-15T12:22:00.374145+0000","last_became_peered":"2024-09-15T12:22:00.374145+0000","last_unstale":"2024-09-15T12:23:40.556380+0000","last_undegraded":"2024-09-15T12:23:40.556380+0000","last_fullsized":"2024-09-15T12:23:40.556380+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1230,"log_dups_size":0,"ondisk_log_size":1230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68157440,"num_objects":1040,"num_object_clones":0,"num_object_copies":3120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1230,"num_write_kb":72640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.906246+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:23:38.906246+0000","last_peered":"2024-09-15T12:23:38.906246+0000","last_clean":"2024-09-15T12:23:38.906246+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:23:38.906246+0000","last_undegraded":"2024-09-15T12:23:38.906246+0000","last_fullsized":"2024-09-15T12:23:38.906246+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"50'1219","reported_seq":1279,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.661818+0000","last_change":"2024-09-15T12:22:00.405131+0000","last_active":"2024-09-15T12:23:40.661818+0000","last_peered":"2024-09-15T12:23:40.661818+0000","last_clean":"2024-09-15T12:23:40.661818+0000","last_became_active":"2024-09-15T12:22:00.398288+0000","last_became_peered":"2024-09-15T12:22:00.398288+0000","last_unstale":"2024-09-15T12:23:40.661818+0000","last_undegraded":"2024-09-15T12:23:40.661818+0000","last_fullsized":"2024-09-15T12:23:40.661818+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1219,"log_dups_size":0,"ondisk_log_size":1219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67043328,"num_objects":1023,"num_object_clones":0,"num_object_copies":3069,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1219,"num_write_kb":71744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.899555+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:23:38.899555+0000","last_peered":"2024-09-15T12:23:38.899555+0000","last_clean":"2024-09-15T12:23:38.899555+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:23:38.899555+0000","last_undegraded":"2024-09-15T12:23:38.899555+0000","last_fullsized":"2024-09-15T12:23:38.899555+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"50'1265","reported_seq":1325,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.595458+0000","last_change":"2024-09-15T12:22:00.390143+0000","last_active":"2024-09-15T12:23:40.595458+0000","last_peered":"2024-09-15T12:23:40.595458+0000","last_clean":"2024-09-15T12:23:40.595458+0000","last_became_active":"2024-09-15T12:22:00.370049+0000","last_became_peered":"2024-09-15T12:22:00.370049+0000","last_unstale":"2024-09-15T12:23:40.595458+0000","last_undegraded":"2024-09-15T12:23:40.595458+0000","last_fullsized":"2024-09-15T12:23:40.595458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1265,"log_dups_size":0,"ondisk_log_size":1265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71106560,"num_objects":1085,"num_object_clones":0,"num_object_copies":3255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1265,"num_write_kb":75200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":123,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.899570+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:23:38.899570+0000","last_peered":"2024-09-15T12:23:38.899570+0000","last_clean":"2024-09-15T12:23:38.899570+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:23:38.899570+0000","last_undegraded":"2024-09-15T12:23:38.899570+0000","last_fullsized":"2024-09-15T12:23:38.899570+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"50'1216","reported_seq":1276,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.629971+0000","last_change":"2024-09-15T12:22:00.450159+0000","last_active":"2024-09-15T12:23:40.629971+0000","last_peered":"2024-09-15T12:23:40.629971+0000","last_clean":"2024-09-15T12:23:40.629971+0000","last_became_active":"2024-09-15T12:22:00.437056+0000","last_became_peered":"2024-09-15T12:22:00.437056+0000","last_unstale":"2024-09-15T12:23:40.629971+0000","last_undegraded":"2024-09-15T12:23:40.629971+0000","last_fullsized":"2024-09-15T12:23:40.629971+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67764224,"num_objects":1034,"num_object_clones":0,"num_object_copies":3102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":72000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.879479+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:23:38.879479+0000","last_peered":"2024-09-15T12:23:38.879479+0000","last_clean":"2024-09-15T12:23:38.879479+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:23:38.879479+0000","last_undegraded":"2024-09-15T12:23:38.879479+0000","last_fullsized":"2024-09-15T12:23:38.879479+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"50'1230","reported_seq":1290,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.757565+0000","last_change":"2024-09-15T12:22:00.364579+0000","last_active":"2024-09-15T12:23:40.757565+0000","last_peered":"2024-09-15T12:23:40.757565+0000","last_clean":"2024-09-15T12:23:40.757565+0000","last_became_active":"2024-09-15T12:22:00.353614+0000","last_became_peered":"2024-09-15T12:22:00.353614+0000","last_unstale":"2024-09-15T12:23:40.757565+0000","last_undegraded":"2024-09-15T12:23:40.757565+0000","last_fullsized":"2024-09-15T12:23:40.757565+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1230,"log_dups_size":0,"ondisk_log_size":1230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68026368,"num_objects":1038,"num_object_clones":0,"num_object_copies":3114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1230,"num_write_kb":72576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.884650+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:23:38.884650+0000","last_peered":"2024-09-15T12:23:38.884650+0000","last_clean":"2024-09-15T12:23:38.884650+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:23:38.884650+0000","last_undegraded":"2024-09-15T12:23:38.884650+0000","last_fullsized":"2024-09-15T12:23:38.884650+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"50'1249","reported_seq":1309,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.712037+0000","last_change":"2024-09-15T12:22:00.384094+0000","last_active":"2024-09-15T12:23:40.712037+0000","last_peered":"2024-09-15T12:23:40.712037+0000","last_clean":"2024-09-15T12:23:40.712037+0000","last_became_active":"2024-09-15T12:22:00.377789+0000","last_became_peered":"2024-09-15T12:22:00.377789+0000","last_unstale":"2024-09-15T12:23:40.712037+0000","last_undegraded":"2024-09-15T12:23:40.712037+0000","last_fullsized":"2024-09-15T12:23:40.712037+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1249,"log_dups_size":0,"ondisk_log_size":1249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71106560,"num_objects":1085,"num_object_clones":0,"num_object_copies":3255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1249,"num_write_kb":74688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.879601+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:23:38.879601+0000","last_peered":"2024-09-15T12:23:38.879601+0000","last_clean":"2024-09-15T12:23:38.879601+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:23:38.879601+0000","last_undegraded":"2024-09-15T12:23:38.879601+0000","last_fullsized":"2024-09-15T12:23:38.879601+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"50'1268","reported_seq":1328,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.734229+0000","last_change":"2024-09-15T12:22:00.394121+0000","last_active":"2024-09-15T12:23:40.734229+0000","last_peered":"2024-09-15T12:23:40.734229+0000","last_clean":"2024-09-15T12:23:40.734229+0000","last_became_active":"2024-09-15T12:22:00.388183+0000","last_became_peered":"2024-09-15T12:22:00.388183+0000","last_unstale":"2024-09-15T12:23:40.734229+0000","last_undegraded":"2024-09-15T12:23:40.734229+0000","last_fullsized":"2024-09-15T12:23:40.734229+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1268,"log_dups_size":0,"ondisk_log_size":1268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69468160,"num_objects":1060,"num_object_clones":0,"num_object_copies":3180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1268,"num_write_kb":74496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.906326+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:23:38.906326+0000","last_peered":"2024-09-15T12:23:38.906326+0000","last_clean":"2024-09-15T12:23:38.906326+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:23:38.906326+0000","last_undegraded":"2024-09-15T12:23:38.906326+0000","last_fullsized":"2024-09-15T12:23:38.906326+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":1089732632,"num_objects":16629,"num_object_clones":0,"num_object_copies":49887,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":19859,"num_write_kb":1167553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":203849728,"data_stored":3261399112,"data_compressed":154868677,"data_compressed_allocated":203837440,"data_compressed_original":3261399040,"omap_allocated":0,"internal_metadata":0},"log_size":19859,"ondisk_log_size":19859,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":125400,"kb_used_data":54152,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94246440,"statfs":{"total":96636764160,"available":96508354560,"internally_reserved":0,"allocated":55451648,"data_stored":880299718,"data_compressed":41796183,"data_compressed_allocated":55013376,"data_compressed_original":880132096,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":91460,"kb_used_data":42420,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94280380,"statfs":{"total":96636764160,"available":96543109120,"internally_reserved":0,"allocated":43438080,"data_stored":687951601,"data_compressed":32662463,"data_compressed_allocated":42991616,"data_compressed_original":687783936,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":121804,"kb_used_data":54716,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94250036,"statfs":{"total":96636764160,"available":96512036864,"internally_reserved":0,"allocated":56029184,"data_stored":889801937,"data_compressed":42245400,"data_compressed_allocated":55603200,"data_compressed_original":889651200,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":121704,"kb_used_data":50456,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94250136,"statfs":{"total":96636764160,"available":96512139264,"internally_reserved":0,"allocated":51666944,"data_stored":819613425,"data_compressed":38914471,"data_compressed_allocated":51220480,"data_compressed_original":819445760,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":50962432,"data_stored":815333400,"data_compressed":38716391,"data_compressed_allocated":50958336,"data_compressed_original":815333376,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":55386112,"data_stored":886112280,"data_compressed":42077352,"data_compressed_allocated":55382016,"data_compressed_original":886112256,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":42704896,"data_stored":683212824,"data_compressed":32442599,"data_compressed_allocated":42700800,"data_compressed_original":683212800,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":54796288,"data_stored":876740608,"data_compressed":41632335,"data_compressed_allocated":54796288,"data_compressed_original":876740608,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:23:57.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:57.585+0000 7f66dfb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:57.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:23:57.592+0000 7f66dfb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:23:59.947 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:24:00.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:00.100+0000 7fa3d7151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:00.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:00.114+0000 7fa3d7151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:02.450 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:24:02.451 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:24:02.451 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:24:02.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:02.613+0000 7f3fd9591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:02.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:02.622+0000 7f3fd9591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:02.722 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:24:02.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:02.891+0000 7f2eb2d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:02.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:02.900+0000 7f2eb1aef640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:02.995 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:24:02.995 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:24:03.017 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2024-09-15T12:24:01.766230+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1090323019,"num_objects":16633,"num_object_clones":0,"num_object_copies":49899,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":19940,"num_write_kb":1168661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19914,"ondisk_log_size":19914,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":460368,"kb_used_data":201744,"kb_used_omap":0,"kb_used_meta":258560,"kb_avail":377026992,"statfs":{"total":386547056640,"available":386075639808,"internally_reserved":0,"allocated":206585856,"data_stored":3277666681,"data_compressed":155618517,"data_compressed_allocated":204828672,"data_compressed_original":3277012992,"omap_allocated":0,"internal_metadata":264765440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002351"},"pg_stats":[{"pgid":"4.f","version":"50'1273","reported_seq":1333,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.730421+0000","last_change":"2024-09-15T12:22:00.377854+0000","last_active":"2024-09-15T12:23:40.730421+0000","last_peered":"2024-09-15T12:23:40.730421+0000","last_clean":"2024-09-15T12:23:40.730421+0000","last_became_active":"2024-09-15T12:22:00.359790+0000","last_became_peered":"2024-09-15T12:22:00.359790+0000","last_unstale":"2024-09-15T12:23:40.730421+0000","last_undegraded":"2024-09-15T12:23:40.730421+0000","last_fullsized":"2024-09-15T12:23:40.730421+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1273,"log_dups_size":0,"ondisk_log_size":1273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69271552,"num_objects":1057,"num_object_clones":0,"num_object_copies":3171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1273,"num_write_kb":74560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"50'1250","reported_seq":1310,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.420454+0000","last_change":"2024-09-15T12:22:00.383291+0000","last_active":"2024-09-15T12:23:40.420454+0000","last_peered":"2024-09-15T12:23:40.420454+0000","last_clean":"2024-09-15T12:23:40.420454+0000","last_became_active":"2024-09-15T12:22:00.376330+0000","last_became_peered":"2024-09-15T12:22:00.376330+0000","last_unstale":"2024-09-15T12:23:40.420454+0000","last_undegraded":"2024-09-15T12:23:40.420454+0000","last_fullsized":"2024-09-15T12:23:40.420454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1250,"log_dups_size":0,"ondisk_log_size":1250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68419584,"num_objects":1044,"num_object_clones":0,"num_object_copies":3132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1250,"num_write_kb":73408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"50'1296","reported_seq":1357,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.692514+0000","last_change":"2024-09-15T12:22:00.413467+0000","last_active":"2024-09-15T12:23:40.692514+0000","last_peered":"2024-09-15T12:23:40.692514+0000","last_clean":"2024-09-15T12:23:40.692514+0000","last_became_active":"2024-09-15T12:22:00.399293+0000","last_became_peered":"2024-09-15T12:22:00.399293+0000","last_unstale":"2024-09-15T12:23:40.692514+0000","last_undegraded":"2024-09-15T12:23:40.692514+0000","last_fullsized":"2024-09-15T12:23:40.692514+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1296,"log_dups_size":0,"ondisk_log_size":1296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70582296,"num_objects":1078,"num_object_clones":0,"num_object_copies":3234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1296,"num_write_kb":75905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"50'1219","reported_seq":1279,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:41.598819+0000","last_change":"2024-09-15T12:22:00.397700+0000","last_active":"2024-09-15T12:23:41.598819+0000","last_peered":"2024-09-15T12:23:41.598819+0000","last_clean":"2024-09-15T12:23:41.598819+0000","last_became_active":"2024-09-15T12:22:00.388314+0000","last_became_peered":"2024-09-15T12:22:00.388314+0000","last_unstale":"2024-09-15T12:23:41.598819+0000","last_undegraded":"2024-09-15T12:23:41.598819+0000","last_fullsized":"2024-09-15T12:23:41.598819+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1219,"log_dups_size":0,"ondisk_log_size":1219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65339392,"num_objects":997,"num_object_clones":0,"num_object_copies":2991,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1219,"num_write_kb":70912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"50'1157","reported_seq":1217,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.556158+0000","last_change":"2024-09-15T12:22:00.418610+0000","last_active":"2024-09-15T12:23:40.556158+0000","last_peered":"2024-09-15T12:23:40.556158+0000","last_clean":"2024-09-15T12:23:40.556158+0000","last_became_active":"2024-09-15T12:22:00.404352+0000","last_became_peered":"2024-09-15T12:22:00.404352+0000","last_unstale":"2024-09-15T12:23:40.556158+0000","last_undegraded":"2024-09-15T12:23:40.556158+0000","last_fullsized":"2024-09-15T12:23:40.556158+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1157,"log_dups_size":0,"ondisk_log_size":1157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64552960,"num_objects":985,"num_object_clones":0,"num_object_copies":2955,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1157,"num_write_kb":68544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"50'1238","reported_seq":1298,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.664223+0000","last_change":"2024-09-15T12:22:00.408893+0000","last_active":"2024-09-15T12:23:40.664223+0000","last_peered":"2024-09-15T12:23:40.664223+0000","last_clean":"2024-09-15T12:23:40.664223+0000","last_became_active":"2024-09-15T12:22:00.399557+0000","last_became_peered":"2024-09-15T12:22:00.399557+0000","last_unstale":"2024-09-15T12:23:40.664223+0000","last_undegraded":"2024-09-15T12:23:40.664223+0000","last_fullsized":"2024-09-15T12:23:40.664223+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1238,"log_dups_size":0,"ondisk_log_size":1238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68157440,"num_objects":1040,"num_object_clones":0,"num_object_copies":3120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1238,"num_write_kb":72896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"50'1286","reported_seq":1346,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.585940+0000","last_change":"2024-09-15T12:22:00.458263+0000","last_active":"2024-09-15T12:23:40.585940+0000","last_peered":"2024-09-15T12:23:40.585940+0000","last_clean":"2024-09-15T12:23:40.585940+0000","last_became_active":"2024-09-15T12:22:00.446629+0000","last_became_peered":"2024-09-15T12:22:00.446629+0000","last_unstale":"2024-09-15T12:23:40.585940+0000","last_undegraded":"2024-09-15T12:23:40.585940+0000","last_fullsized":"2024-09-15T12:23:40.585940+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1286,"log_dups_size":0,"ondisk_log_size":1286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68288512,"num_objects":1042,"num_object_clones":0,"num_object_copies":3126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1286,"num_write_kb":74496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"50'1264","reported_seq":1324,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.689692+0000","last_change":"2024-09-15T12:22:00.432607+0000","last_active":"2024-09-15T12:23:40.689692+0000","last_peered":"2024-09-15T12:23:40.689692+0000","last_clean":"2024-09-15T12:23:40.689692+0000","last_became_active":"2024-09-15T12:22:00.422177+0000","last_became_peered":"2024-09-15T12:22:00.422177+0000","last_unstale":"2024-09-15T12:23:40.689692+0000","last_undegraded":"2024-09-15T12:23:40.689692+0000","last_fullsized":"2024-09-15T12:23:40.689692+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1264,"log_dups_size":0,"ondisk_log_size":1264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69074944,"num_objects":1054,"num_object_clones":0,"num_object_copies":3162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1264,"num_write_kb":74176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"50'1199","reported_seq":1259,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.527434+0000","last_change":"2024-09-15T12:22:00.420197+0000","last_active":"2024-09-15T12:23:40.527434+0000","last_peered":"2024-09-15T12:23:40.527434+0000","last_clean":"2024-09-15T12:23:40.527434+0000","last_became_active":"2024-09-15T12:22:00.406666+0000","last_became_peered":"2024-09-15T12:22:00.406666+0000","last_unstale":"2024-09-15T12:23:40.527434+0000","last_undegraded":"2024-09-15T12:23:40.527434+0000","last_fullsized":"2024-09-15T12:23:40.527434+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1199,"log_dups_size":0,"ondisk_log_size":1199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63373312,"num_objects":967,"num_object_clones":0,"num_object_copies":2901,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1199,"num_write_kb":69312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":193,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.876676+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:23:38.876676+0000","last_peered":"2024-09-15T12:23:38.876676+0000","last_clean":"2024-09-15T12:23:38.876676+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:23:38.876676+0000","last_undegraded":"2024-09-15T12:23:38.876676+0000","last_fullsized":"2024-09-15T12:23:38.876676+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":122,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.905388+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:23:38.905388+0000","last_peered":"2024-09-15T12:23:38.905388+0000","last_clean":"2024-09-15T12:23:38.905388+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:23:38.905388+0000","last_undegraded":"2024-09-15T12:23:38.905388+0000","last_fullsized":"2024-09-15T12:23:38.905388+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"50'1230","reported_seq":1290,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.556380+0000","last_change":"2024-09-15T12:22:00.381165+0000","last_active":"2024-09-15T12:23:40.556380+0000","last_peered":"2024-09-15T12:23:40.556380+0000","last_clean":"2024-09-15T12:23:40.556380+0000","last_became_active":"2024-09-15T12:22:00.374145+0000","last_became_peered":"2024-09-15T12:22:00.374145+0000","last_unstale":"2024-09-15T12:23:40.556380+0000","last_undegraded":"2024-09-15T12:23:40.556380+0000","last_fullsized":"2024-09-15T12:23:40.556380+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1230,"log_dups_size":0,"ondisk_log_size":1230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68157440,"num_objects":1040,"num_object_clones":0,"num_object_copies":3120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1230,"num_write_kb":72640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.906246+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:23:38.906246+0000","last_peered":"2024-09-15T12:23:38.906246+0000","last_clean":"2024-09-15T12:23:38.906246+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:23:38.906246+0000","last_undegraded":"2024-09-15T12:23:38.906246+0000","last_fullsized":"2024-09-15T12:23:38.906246+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"50'1219","reported_seq":1279,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.661818+0000","last_change":"2024-09-15T12:22:00.405131+0000","last_active":"2024-09-15T12:23:40.661818+0000","last_peered":"2024-09-15T12:23:40.661818+0000","last_clean":"2024-09-15T12:23:40.661818+0000","last_became_active":"2024-09-15T12:22:00.398288+0000","last_became_peered":"2024-09-15T12:22:00.398288+0000","last_unstale":"2024-09-15T12:23:40.661818+0000","last_undegraded":"2024-09-15T12:23:40.661818+0000","last_fullsized":"2024-09-15T12:23:40.661818+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1219,"log_dups_size":0,"ondisk_log_size":1219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67043328,"num_objects":1023,"num_object_clones":0,"num_object_copies":3069,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1219,"num_write_kb":71744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.899555+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:23:38.899555+0000","last_peered":"2024-09-15T12:23:38.899555+0000","last_clean":"2024-09-15T12:23:38.899555+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:23:38.899555+0000","last_undegraded":"2024-09-15T12:23:38.899555+0000","last_fullsized":"2024-09-15T12:23:38.899555+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"50'1265","reported_seq":1325,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.595458+0000","last_change":"2024-09-15T12:22:00.390143+0000","last_active":"2024-09-15T12:23:40.595458+0000","last_peered":"2024-09-15T12:23:40.595458+0000","last_clean":"2024-09-15T12:23:40.595458+0000","last_became_active":"2024-09-15T12:22:00.370049+0000","last_became_peered":"2024-09-15T12:22:00.370049+0000","last_unstale":"2024-09-15T12:23:40.595458+0000","last_undegraded":"2024-09-15T12:23:40.595458+0000","last_fullsized":"2024-09-15T12:23:40.595458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1265,"log_dups_size":0,"ondisk_log_size":1265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71106560,"num_objects":1085,"num_object_clones":0,"num_object_copies":3255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1265,"num_write_kb":75200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":123,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.899570+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:23:38.899570+0000","last_peered":"2024-09-15T12:23:38.899570+0000","last_clean":"2024-09-15T12:23:38.899570+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:23:38.899570+0000","last_undegraded":"2024-09-15T12:23:38.899570+0000","last_fullsized":"2024-09-15T12:23:38.899570+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"50'1216","reported_seq":1276,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.629971+0000","last_change":"2024-09-15T12:22:00.450159+0000","last_active":"2024-09-15T12:23:40.629971+0000","last_peered":"2024-09-15T12:23:40.629971+0000","last_clean":"2024-09-15T12:23:40.629971+0000","last_became_active":"2024-09-15T12:22:00.437056+0000","last_became_peered":"2024-09-15T12:22:00.437056+0000","last_unstale":"2024-09-15T12:23:40.629971+0000","last_undegraded":"2024-09-15T12:23:40.629971+0000","last_fullsized":"2024-09-15T12:23:40.629971+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1216,"log_dups_size":0,"ondisk_log_size":1216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67764224,"num_objects":1034,"num_object_clones":0,"num_object_copies":3102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1216,"num_write_kb":72000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.879479+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:23:38.879479+0000","last_peered":"2024-09-15T12:23:38.879479+0000","last_clean":"2024-09-15T12:23:38.879479+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:23:38.879479+0000","last_undegraded":"2024-09-15T12:23:38.879479+0000","last_fullsized":"2024-09-15T12:23:38.879479+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"50'1230","reported_seq":1290,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.757565+0000","last_change":"2024-09-15T12:22:00.364579+0000","last_active":"2024-09-15T12:23:40.757565+0000","last_peered":"2024-09-15T12:23:40.757565+0000","last_clean":"2024-09-15T12:23:40.757565+0000","last_became_active":"2024-09-15T12:22:00.353614+0000","last_became_peered":"2024-09-15T12:22:00.353614+0000","last_unstale":"2024-09-15T12:23:40.757565+0000","last_undegraded":"2024-09-15T12:23:40.757565+0000","last_fullsized":"2024-09-15T12:23:40.757565+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1230,"log_dups_size":0,"ondisk_log_size":1230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68026368,"num_objects":1038,"num_object_clones":0,"num_object_copies":3114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1230,"num_write_kb":72576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.884650+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:23:38.884650+0000","last_peered":"2024-09-15T12:23:38.884650+0000","last_clean":"2024-09-15T12:23:38.884650+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:23:38.884650+0000","last_undegraded":"2024-09-15T12:23:38.884650+0000","last_fullsized":"2024-09-15T12:23:38.884650+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"50'1249","reported_seq":1309,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.712037+0000","last_change":"2024-09-15T12:22:00.384094+0000","last_active":"2024-09-15T12:23:40.712037+0000","last_peered":"2024-09-15T12:23:40.712037+0000","last_clean":"2024-09-15T12:23:40.712037+0000","last_became_active":"2024-09-15T12:22:00.377789+0000","last_became_peered":"2024-09-15T12:22:00.377789+0000","last_unstale":"2024-09-15T12:23:40.712037+0000","last_undegraded":"2024-09-15T12:23:40.712037+0000","last_fullsized":"2024-09-15T12:23:40.712037+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1249,"log_dups_size":0,"ondisk_log_size":1249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71106560,"num_objects":1085,"num_object_clones":0,"num_object_copies":3255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1249,"num_write_kb":74688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.879601+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:23:38.879601+0000","last_peered":"2024-09-15T12:23:38.879601+0000","last_clean":"2024-09-15T12:23:38.879601+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:23:38.879601+0000","last_undegraded":"2024-09-15T12:23:38.879601+0000","last_fullsized":"2024-09-15T12:23:38.879601+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"50'1268","reported_seq":1328,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:40.734229+0000","last_change":"2024-09-15T12:22:00.394121+0000","last_active":"2024-09-15T12:23:40.734229+0000","last_peered":"2024-09-15T12:23:40.734229+0000","last_clean":"2024-09-15T12:23:40.734229+0000","last_became_active":"2024-09-15T12:22:00.388183+0000","last_became_peered":"2024-09-15T12:22:00.388183+0000","last_unstale":"2024-09-15T12:23:40.734229+0000","last_undegraded":"2024-09-15T12:23:40.734229+0000","last_fullsized":"2024-09-15T12:23:40.734229+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1268,"log_dups_size":0,"ondisk_log_size":1268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69468160,"num_objects":1060,"num_object_clones":0,"num_object_copies":3180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1268,"num_write_kb":74496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.906326+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:23:38.906326+0000","last_peered":"2024-09-15T12:23:38.906326+0000","last_clean":"2024-09-15T12:23:38.906326+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:23:38.906326+0000","last_undegraded":"2024-09-15T12:23:38.906326+0000","last_fullsized":"2024-09-15T12:23:38.906326+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":1089732632,"num_objects":16629,"num_object_clones":0,"num_object_copies":49887,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":19859,"num_write_kb":1167553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":203849728,"data_stored":3261399112,"data_compressed":154868677,"data_compressed_allocated":203837440,"data_compressed_original":3261399040,"omap_allocated":0,"internal_metadata":0},"log_size":19859,"ondisk_log_size":19859,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":125400,"kb_used_data":54152,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94246440,"statfs":{"total":96636764160,"available":96508354560,"internally_reserved":0,"allocated":55451648,"data_stored":880299718,"data_compressed":41796183,"data_compressed_allocated":55013376,"data_compressed_original":880132096,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":91460,"kb_used_data":42420,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94280380,"statfs":{"total":96636764160,"available":96543109120,"internally_reserved":0,"allocated":43438080,"data_stored":687951601,"data_compressed":32662463,"data_compressed_allocated":42991616,"data_compressed_original":687783936,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":121804,"kb_used_data":54716,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94250036,"statfs":{"total":96636764160,"available":96512036864,"internally_reserved":0,"allocated":56029184,"data_stored":889801937,"data_compressed":42245400,"data_compressed_allocated":55603200,"data_compressed_original":889651200,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":121704,"kb_used_data":50456,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94250136,"statfs":{"total":96636764160,"available":96512139264,"internally_reserved":0,"allocated":51666944,"data_stored":819613425,"data_compressed":38914471,"data_compressed_allocated":51220480,"data_compressed_original":819445760,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":50962432,"data_stored":815333400,"data_compressed":38716391,"data_compressed_allocated":50958336,"data_compressed_original":815333376,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":55386112,"data_stored":886112280,"data_compressed":42077352,"data_compressed_allocated":55382016,"data_compressed_original":886112256,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":42704896,"data_stored":683212824,"data_compressed":32442599,"data_compressed_allocated":42700800,"data_compressed_original":683212800,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":54796288,"data_stored":876740608,"data_compressed":41632335,"data_compressed_allocated":54796288,"data_compressed_original":876740608,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:24:05.734 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:24:05.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:05.891+0000 7fc989911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:05.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:05.899+0000 7fc989911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:08.019 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:24:08.019 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:24:08.019 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:24:08.019 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:24:08.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:08.173+0000 7f6101ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:08.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:08.194+0000 7f6101ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:08.264 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:24:08.432 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:24:08.433 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:24:08.433 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:24:08.433 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:24:08.433 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:24:08.433 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:24:08.433 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:24:08.433 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:24:08.433 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:24:08.433 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:24:08.433 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:24:08.433 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:24:08.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:08.429+0000 7f7e4e791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:08.439 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:24:08.440 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:24:08.440 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:24:08.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:08.440+0000 7f7e4e791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:08.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:08.619+0000 7f9a5e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:08.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:08.633+0000 7f9a5e191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:08.718 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:24:08.718 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:24:08.718 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:24:08.718 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:24:08.719 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:24:08.719 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:24:08.719 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:24:08.719 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:24:08.719 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:24:08.719 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:24:08.720 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:24:08.720 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:24:08.721 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:24:08.721 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:24:08.722 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:24:08.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:08.919+0000 7efcf1d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:08.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:08.934+0000 7efcf1d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:08.974 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:24:08.974 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:24:08.974 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:24:08.974 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:24:08.974 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:24:08.974 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:24:08.974 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:24:08.974 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:24:08.974 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:24:08.975 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:24:08.975 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:24:08.975 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:24:08.979 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:24:08.980 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:24:08.980 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:24:09.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:09.116+0000 7f82c1c9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:09.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:09.134+0000 7f82c1c9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:09.181 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:24:09.182 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:24:09.182 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:24:09.182 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:24:09.182 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:24:09.182 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:24:09.182 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:24:09.182 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:24:09.182 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:24:09.182 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:24:09.182 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:24:09.182 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:24:09.186 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:24:09.187 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:24:11.131 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:24:11.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:11.277+0000 7f08e1791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:11.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:11.287+0000 7f08e1791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:13.809 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:24:13.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:13.939+0000 7f31a4b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:13.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:13.949+0000 7f31a4b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:14.188 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:24:14.188 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:24:14.188 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:24:14.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:14.341+0000 7fe8e42d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:14.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:14.357+0000 7fe8e42d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:14.714 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:24:14.715 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:24:14.737 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":209,"stamp":"2024-09-15T12:24:13.768631+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":715719243,"num_objects":10917,"num_object_clones":0,"num_object_copies":32751,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":25656,"num_write_kb":1168661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25630,"ondisk_log_size":25630,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":405424,"kb_used_data":132904,"kb_used_omap":0,"kb_used_meta":272448,"kb_avail":377081936,"statfs":{"total":386547056640,"available":386131902464,"internally_reserved":0,"allocated":136093696,"data_stored":2149792121,"data_compressed":102060997,"data_compressed_allocated":134336512,"data_compressed_original":2149138432,"omap_allocated":0,"internal_metadata":278986752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-374603776,"num_objects":-5716,"num_object_clones":0,"num_object_copies":-17148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5716,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002400"},"pg_stats":[{"pgid":"4.f","version":"50'1628","reported_seq":1688,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.634790+0000","last_change":"2024-09-15T12:22:00.377854+0000","last_active":"2024-09-15T12:24:10.634790+0000","last_peered":"2024-09-15T12:24:10.634790+0000","last_clean":"2024-09-15T12:24:10.634790+0000","last_became_active":"2024-09-15T12:22:00.359790+0000","last_became_peered":"2024-09-15T12:22:00.359790+0000","last_unstale":"2024-09-15T12:24:10.634790+0000","last_undegraded":"2024-09-15T12:24:10.634790+0000","last_fullsized":"2024-09-15T12:24:10.634790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1628,"log_dups_size":0,"ondisk_log_size":1628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46006272,"num_objects":702,"num_object_clones":0,"num_object_copies":2106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1628,"num_write_kb":74560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"50'1613","reported_seq":1673,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.715301+0000","last_change":"2024-09-15T12:22:00.383291+0000","last_active":"2024-09-15T12:24:10.715301+0000","last_peered":"2024-09-15T12:24:10.715301+0000","last_clean":"2024-09-15T12:24:10.715301+0000","last_became_active":"2024-09-15T12:22:00.376330+0000","last_became_peered":"2024-09-15T12:22:00.376330+0000","last_unstale":"2024-09-15T12:24:10.715301+0000","last_undegraded":"2024-09-15T12:24:10.715301+0000","last_fullsized":"2024-09-15T12:24:10.715301+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1613,"log_dups_size":0,"ondisk_log_size":1613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44630016,"num_objects":681,"num_object_clones":0,"num_object_copies":2043,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1613,"num_write_kb":73408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"50'1662","reported_seq":1723,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.585317+0000","last_change":"2024-09-15T12:22:00.413467+0000","last_active":"2024-09-15T12:24:10.585317+0000","last_peered":"2024-09-15T12:24:10.585317+0000","last_clean":"2024-09-15T12:24:10.585317+0000","last_became_active":"2024-09-15T12:22:00.399293+0000","last_became_peered":"2024-09-15T12:22:00.399293+0000","last_unstale":"2024-09-15T12:24:10.585317+0000","last_undegraded":"2024-09-15T12:24:10.585317+0000","last_fullsized":"2024-09-15T12:24:10.585317+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1662,"log_dups_size":0,"ondisk_log_size":1662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46596120,"num_objects":712,"num_object_clones":0,"num_object_copies":2136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1662,"num_write_kb":75905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"50'1587","reported_seq":1647,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:11.488429+0000","last_change":"2024-09-15T12:22:00.397700+0000","last_active":"2024-09-15T12:24:11.488429+0000","last_peered":"2024-09-15T12:24:11.488429+0000","last_clean":"2024-09-15T12:24:11.488429+0000","last_became_active":"2024-09-15T12:22:00.388314+0000","last_became_peered":"2024-09-15T12:22:00.388314+0000","last_unstale":"2024-09-15T12:24:11.488429+0000","last_undegraded":"2024-09-15T12:24:11.488429+0000","last_fullsized":"2024-09-15T12:24:11.488429+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1587,"log_dups_size":0,"ondisk_log_size":1587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41222144,"num_objects":629,"num_object_clones":0,"num_object_copies":1887,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1587,"num_write_kb":70912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"50'1496","reported_seq":1556,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.688491+0000","last_change":"2024-09-15T12:22:00.418610+0000","last_active":"2024-09-15T12:24:10.688491+0000","last_peered":"2024-09-15T12:24:10.688491+0000","last_clean":"2024-09-15T12:24:10.688491+0000","last_became_active":"2024-09-15T12:22:00.404352+0000","last_became_peered":"2024-09-15T12:22:00.404352+0000","last_unstale":"2024-09-15T12:24:10.688491+0000","last_undegraded":"2024-09-15T12:24:10.688491+0000","last_fullsized":"2024-09-15T12:24:10.688491+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1496,"log_dups_size":0,"ondisk_log_size":1496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42336256,"num_objects":646,"num_object_clones":0,"num_object_copies":1938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1496,"num_write_kb":68544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"50'1589","reported_seq":1649,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.658164+0000","last_change":"2024-09-15T12:22:00.408893+0000","last_active":"2024-09-15T12:24:10.658164+0000","last_peered":"2024-09-15T12:24:10.658164+0000","last_clean":"2024-09-15T12:24:10.658164+0000","last_became_active":"2024-09-15T12:22:00.399557+0000","last_became_peered":"2024-09-15T12:22:00.399557+0000","last_unstale":"2024-09-15T12:24:10.658164+0000","last_undegraded":"2024-09-15T12:24:10.658164+0000","last_fullsized":"2024-09-15T12:24:10.658164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1589,"log_dups_size":0,"ondisk_log_size":1589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45154304,"num_objects":689,"num_object_clones":0,"num_object_copies":2067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1589,"num_write_kb":72896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"50'1650","reported_seq":1710,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.696263+0000","last_change":"2024-09-15T12:22:00.458263+0000","last_active":"2024-09-15T12:24:10.696263+0000","last_peered":"2024-09-15T12:24:10.696263+0000","last_clean":"2024-09-15T12:24:10.696263+0000","last_became_active":"2024-09-15T12:22:00.446629+0000","last_became_peered":"2024-09-15T12:22:00.446629+0000","last_unstale":"2024-09-15T12:24:10.696263+0000","last_undegraded":"2024-09-15T12:24:10.696263+0000","last_fullsized":"2024-09-15T12:24:10.696263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1650,"log_dups_size":0,"ondisk_log_size":1650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44433408,"num_objects":678,"num_object_clones":0,"num_object_copies":2034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1650,"num_write_kb":74496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"50'1616","reported_seq":1676,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.486172+0000","last_change":"2024-09-15T12:22:00.432607+0000","last_active":"2024-09-15T12:24:10.486172+0000","last_peered":"2024-09-15T12:24:10.486172+0000","last_clean":"2024-09-15T12:24:10.486172+0000","last_became_active":"2024-09-15T12:22:00.422177+0000","last_became_peered":"2024-09-15T12:22:00.422177+0000","last_unstale":"2024-09-15T12:24:10.486172+0000","last_undegraded":"2024-09-15T12:24:10.486172+0000","last_fullsized":"2024-09-15T12:24:10.486172+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1616,"log_dups_size":0,"ondisk_log_size":1616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46006272,"num_objects":702,"num_object_clones":0,"num_object_copies":2106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1616,"num_write_kb":74176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"50'1543","reported_seq":1603,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.688794+0000","last_change":"2024-09-15T12:22:00.420197+0000","last_active":"2024-09-15T12:24:10.688794+0000","last_peered":"2024-09-15T12:24:10.688794+0000","last_clean":"2024-09-15T12:24:10.688794+0000","last_became_active":"2024-09-15T12:22:00.406666+0000","last_became_peered":"2024-09-15T12:22:00.406666+0000","last_unstale":"2024-09-15T12:24:10.688794+0000","last_undegraded":"2024-09-15T12:24:10.688794+0000","last_fullsized":"2024-09-15T12:24:10.688794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1543,"log_dups_size":0,"ondisk_log_size":1543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40828928,"num_objects":623,"num_object_clones":0,"num_object_copies":1869,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1543,"num_write_kb":69312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":193,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.876676+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:23:38.876676+0000","last_peered":"2024-09-15T12:23:38.876676+0000","last_clean":"2024-09-15T12:23:38.876676+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:23:38.876676+0000","last_undegraded":"2024-09-15T12:23:38.876676+0000","last_fullsized":"2024-09-15T12:23:38.876676+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":122,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.905388+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:23:38.905388+0000","last_peered":"2024-09-15T12:23:38.905388+0000","last_clean":"2024-09-15T12:23:38.905388+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:23:38.905388+0000","last_undegraded":"2024-09-15T12:23:38.905388+0000","last_fullsized":"2024-09-15T12:23:38.905388+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"50'1609","reported_seq":1669,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.643304+0000","last_change":"2024-09-15T12:22:00.381165+0000","last_active":"2024-09-15T12:24:10.643304+0000","last_peered":"2024-09-15T12:24:10.643304+0000","last_clean":"2024-09-15T12:24:10.643304+0000","last_became_active":"2024-09-15T12:22:00.374145+0000","last_became_peered":"2024-09-15T12:22:00.374145+0000","last_unstale":"2024-09-15T12:24:10.643304+0000","last_undegraded":"2024-09-15T12:24:10.643304+0000","last_fullsized":"2024-09-15T12:24:10.643304+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1609,"log_dups_size":0,"ondisk_log_size":1609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43319296,"num_objects":661,"num_object_clones":0,"num_object_copies":1983,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1609,"num_write_kb":72640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.906246+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:23:38.906246+0000","last_peered":"2024-09-15T12:23:38.906246+0000","last_clean":"2024-09-15T12:23:38.906246+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:23:38.906246+0000","last_undegraded":"2024-09-15T12:23:38.906246+0000","last_fullsized":"2024-09-15T12:23:38.906246+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"50'1546","reported_seq":1606,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.500743+0000","last_change":"2024-09-15T12:22:00.405131+0000","last_active":"2024-09-15T12:24:10.500743+0000","last_peered":"2024-09-15T12:24:10.500743+0000","last_clean":"2024-09-15T12:24:10.500743+0000","last_became_active":"2024-09-15T12:22:00.398288+0000","last_became_peered":"2024-09-15T12:22:00.398288+0000","last_unstale":"2024-09-15T12:24:10.500743+0000","last_undegraded":"2024-09-15T12:24:10.500743+0000","last_fullsized":"2024-09-15T12:24:10.500743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1546,"log_dups_size":0,"ondisk_log_size":1546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45613056,"num_objects":696,"num_object_clones":0,"num_object_copies":2088,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1546,"num_write_kb":71744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.899555+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:23:38.899555+0000","last_peered":"2024-09-15T12:23:38.899555+0000","last_clean":"2024-09-15T12:23:38.899555+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:23:38.899555+0000","last_undegraded":"2024-09-15T12:23:38.899555+0000","last_fullsized":"2024-09-15T12:23:38.899555+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"50'1638","reported_seq":1698,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.691281+0000","last_change":"2024-09-15T12:22:00.390143+0000","last_active":"2024-09-15T12:24:10.691281+0000","last_peered":"2024-09-15T12:24:10.691281+0000","last_clean":"2024-09-15T12:24:10.691281+0000","last_became_active":"2024-09-15T12:22:00.370049+0000","last_became_peered":"2024-09-15T12:22:00.370049+0000","last_unstale":"2024-09-15T12:24:10.691281+0000","last_undegraded":"2024-09-15T12:24:10.691281+0000","last_fullsized":"2024-09-15T12:24:10.691281+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1638,"log_dups_size":0,"ondisk_log_size":1638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46661632,"num_objects":712,"num_object_clones":0,"num_object_copies":2136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1638,"num_write_kb":75200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":123,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.899570+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:23:38.899570+0000","last_peered":"2024-09-15T12:23:38.899570+0000","last_clean":"2024-09-15T12:23:38.899570+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:23:38.899570+0000","last_undegraded":"2024-09-15T12:23:38.899570+0000","last_fullsized":"2024-09-15T12:23:38.899570+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"50'1555","reported_seq":1615,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.543073+0000","last_change":"2024-09-15T12:22:00.450159+0000","last_active":"2024-09-15T12:24:10.543073+0000","last_peered":"2024-09-15T12:24:10.543073+0000","last_clean":"2024-09-15T12:24:10.543073+0000","last_became_active":"2024-09-15T12:22:00.437056+0000","last_became_peered":"2024-09-15T12:22:00.437056+0000","last_unstale":"2024-09-15T12:24:10.543073+0000","last_undegraded":"2024-09-15T12:24:10.543073+0000","last_fullsized":"2024-09-15T12:24:10.543073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1555,"log_dups_size":0,"ondisk_log_size":1555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45547520,"num_objects":695,"num_object_clones":0,"num_object_copies":2085,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1555,"num_write_kb":72000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.879479+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:23:38.879479+0000","last_peered":"2024-09-15T12:23:38.879479+0000","last_clean":"2024-09-15T12:23:38.879479+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:23:38.879479+0000","last_undegraded":"2024-09-15T12:23:38.879479+0000","last_fullsized":"2024-09-15T12:23:38.879479+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"50'1590","reported_seq":1650,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.710197+0000","last_change":"2024-09-15T12:22:00.364579+0000","last_active":"2024-09-15T12:24:10.710197+0000","last_peered":"2024-09-15T12:24:10.710197+0000","last_clean":"2024-09-15T12:24:10.710197+0000","last_became_active":"2024-09-15T12:22:00.353614+0000","last_became_peered":"2024-09-15T12:22:00.353614+0000","last_unstale":"2024-09-15T12:24:10.710197+0000","last_undegraded":"2024-09-15T12:24:10.710197+0000","last_fullsized":"2024-09-15T12:24:10.710197+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1590,"log_dups_size":0,"ondisk_log_size":1590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44433408,"num_objects":678,"num_object_clones":0,"num_object_copies":2034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1590,"num_write_kb":72576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.884650+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:23:38.884650+0000","last_peered":"2024-09-15T12:23:38.884650+0000","last_clean":"2024-09-15T12:23:38.884650+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:23:38.884650+0000","last_undegraded":"2024-09-15T12:23:38.884650+0000","last_fullsized":"2024-09-15T12:23:38.884650+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"50'1620","reported_seq":1680,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.526461+0000","last_change":"2024-09-15T12:22:00.384094+0000","last_active":"2024-09-15T12:24:10.526461+0000","last_peered":"2024-09-15T12:24:10.526461+0000","last_clean":"2024-09-15T12:24:10.526461+0000","last_became_active":"2024-09-15T12:22:00.377789+0000","last_became_peered":"2024-09-15T12:22:00.377789+0000","last_unstale":"2024-09-15T12:24:10.526461+0000","last_undegraded":"2024-09-15T12:24:10.526461+0000","last_fullsized":"2024-09-15T12:24:10.526461+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1620,"log_dups_size":0,"ondisk_log_size":1620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46792704,"num_objects":714,"num_object_clones":0,"num_object_copies":2142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1620,"num_write_kb":74688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.879601+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:23:38.879601+0000","last_peered":"2024-09-15T12:23:38.879601+0000","last_clean":"2024-09-15T12:23:38.879601+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:23:38.879601+0000","last_undegraded":"2024-09-15T12:23:38.879601+0000","last_fullsized":"2024-09-15T12:23:38.879601+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"50'1633","reported_seq":1693,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.526897+0000","last_change":"2024-09-15T12:22:00.394121+0000","last_active":"2024-09-15T12:24:10.526897+0000","last_peered":"2024-09-15T12:24:10.526897+0000","last_clean":"2024-09-15T12:24:10.526897+0000","last_became_active":"2024-09-15T12:22:00.388183+0000","last_became_peered":"2024-09-15T12:22:00.388183+0000","last_unstale":"2024-09-15T12:24:10.526897+0000","last_undegraded":"2024-09-15T12:24:10.526897+0000","last_fullsized":"2024-09-15T12:24:10.526897+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1633,"log_dups_size":0,"ondisk_log_size":1633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45547520,"num_objects":695,"num_object_clones":0,"num_object_copies":2085,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1633,"num_write_kb":74496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.906326+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:23:38.906326+0000","last_peered":"2024-09-15T12:23:38.906326+0000","last_clean":"2024-09-15T12:23:38.906326+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:23:38.906326+0000","last_undegraded":"2024-09-15T12:23:38.906326+0000","last_fullsized":"2024-09-15T12:23:38.906326+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":715128856,"num_objects":10913,"num_object_clones":0,"num_object_copies":32739,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":25575,"num_write_kb":1167553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":133607424,"data_stored":2137522248,"data_compressed":101500989,"data_compressed_allocated":133595136,"data_compressed_original":2137522176,"omap_allocated":0,"internal_metadata":0},"log_size":25575,"ondisk_log_size":25575,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673289,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":106788,"kb_used_data":35536,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94265052,"statfs":{"total":96636764160,"available":96527413248,"internally_reserved":0,"allocated":36388864,"data_stored":575295174,"data_compressed":27312935,"data_compressed_allocated":35950592,"data_compressed_original":575127552,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":91084,"kb_used_data":28156,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94280756,"statfs":{"total":96636764160,"available":96543494144,"internally_reserved":0,"allocated":28831744,"data_stored":454250225,"data_compressed":21565071,"data_compressed_allocated":28385280,"data_compressed_original":454082560,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":103112,"kb_used_data":36020,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94268728,"statfs":{"total":96636764160,"available":96531177472,"internally_reserved":0,"allocated":36884480,"data_stored":583486673,"data_compressed":27699912,"data_compressed_allocated":36458496,"data_compressed_original":583335936,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":104440,"kb_used_data":33192,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94267400,"statfs":{"total":96636764160,"available":96529817600,"internally_reserved":0,"allocated":33988608,"data_stored":536760049,"data_compressed":25483079,"data_compressed_allocated":33542144,"data_compressed_original":536592384,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33366016,"data_stored":533790744,"data_compressed":25347239,"data_compressed_allocated":33361920,"data_compressed_original":533790720,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36315136,"data_stored":580976664,"data_compressed":27587880,"data_compressed_allocated":36311040,"data_compressed_original":580976640,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28147712,"data_stored":450297880,"data_compressed":21382551,"data_compressed_allocated":28143616,"data_compressed_original":450297856,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35778560,"data_stored":572456960,"data_compressed":27183319,"data_compressed_allocated":35778560,"data_compressed_original":572456960,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:24:16.518 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:24:16.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:16.685+0000 7fb677b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:16.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:16.693+0000 7fb677b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:18.978 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:24:19.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:19.133+0000 7f17b1e8e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:19.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:19.140+0000 7f17b1e8e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:19.739 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:24:19.739 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-15T12:24:19.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:19.901+0000 7f7c5ac88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:19.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:19.923+0000 7f7c5ac88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:20.848 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.0 to 1 (10000) 2024-09-15T12:24:20.869 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-15T12:24:21.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:21.000+0000 7fac5bb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:21.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:21.014+0000 7fac5bb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:21.679 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:24:21.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:21.838+0000 7fe801f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:21.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:21.847+0000 7fe801f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:21.858 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.1 to 1 (10000) 2024-09-15T12:24:21.877 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-15T12:24:22.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:22.047+0000 7f565ad51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:22.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:22.062+0000 7f565ad51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:22.865 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.2 to 1 (10000) 2024-09-15T12:24:22.890 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-15T12:24:23.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:23.048+0000 7f0a46ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:23.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:23.071+0000 7f0a46ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:24.240 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.3 to 1 (10000) 2024-09-15T12:24:24.259 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-15T12:24:24.259 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:24:24.407 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:24:24.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:24.405+0000 7f8919e9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:24.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:24.427+0000 7f8919e9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:24.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:24.571+0000 7fc26c191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:24.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:24.587+0000 7fc26c191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:24.794 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:24:24.795 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:24:24.816 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":218,"stamp":"2024-09-15T12:24:24.240542+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":715719243,"num_objects":10917,"num_object_clones":0,"num_object_copies":32751,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":25656,"num_write_kb":1168661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25630,"ondisk_log_size":25630,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":405424,"kb_used_data":132904,"kb_used_omap":0,"kb_used_meta":272448,"kb_avail":377081936,"statfs":{"total":386547056640,"available":386131902464,"internally_reserved":0,"allocated":136093696,"data_stored":2149792121,"data_compressed":102060997,"data_compressed_allocated":134336512,"data_compressed_original":2149138432,"omap_allocated":0,"internal_metadata":278986752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.470580"},"pg_stats":[{"pgid":"4.f","version":"50'1628","reported_seq":1688,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.634790+0000","last_change":"2024-09-15T12:22:00.377854+0000","last_active":"2024-09-15T12:24:10.634790+0000","last_peered":"2024-09-15T12:24:10.634790+0000","last_clean":"2024-09-15T12:24:10.634790+0000","last_became_active":"2024-09-15T12:22:00.359790+0000","last_became_peered":"2024-09-15T12:22:00.359790+0000","last_unstale":"2024-09-15T12:24:10.634790+0000","last_undegraded":"2024-09-15T12:24:10.634790+0000","last_fullsized":"2024-09-15T12:24:10.634790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1628,"log_dups_size":0,"ondisk_log_size":1628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46006272,"num_objects":702,"num_object_clones":0,"num_object_copies":2106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1628,"num_write_kb":74560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"50'1613","reported_seq":1673,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.715301+0000","last_change":"2024-09-15T12:22:00.383291+0000","last_active":"2024-09-15T12:24:10.715301+0000","last_peered":"2024-09-15T12:24:10.715301+0000","last_clean":"2024-09-15T12:24:10.715301+0000","last_became_active":"2024-09-15T12:22:00.376330+0000","last_became_peered":"2024-09-15T12:22:00.376330+0000","last_unstale":"2024-09-15T12:24:10.715301+0000","last_undegraded":"2024-09-15T12:24:10.715301+0000","last_fullsized":"2024-09-15T12:24:10.715301+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1613,"log_dups_size":0,"ondisk_log_size":1613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44630016,"num_objects":681,"num_object_clones":0,"num_object_copies":2043,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1613,"num_write_kb":73408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"50'1662","reported_seq":1723,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.585317+0000","last_change":"2024-09-15T12:22:00.413467+0000","last_active":"2024-09-15T12:24:10.585317+0000","last_peered":"2024-09-15T12:24:10.585317+0000","last_clean":"2024-09-15T12:24:10.585317+0000","last_became_active":"2024-09-15T12:22:00.399293+0000","last_became_peered":"2024-09-15T12:22:00.399293+0000","last_unstale":"2024-09-15T12:24:10.585317+0000","last_undegraded":"2024-09-15T12:24:10.585317+0000","last_fullsized":"2024-09-15T12:24:10.585317+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1662,"log_dups_size":0,"ondisk_log_size":1662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46596120,"num_objects":712,"num_object_clones":0,"num_object_copies":2136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1662,"num_write_kb":75905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"50'1587","reported_seq":1647,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:11.488429+0000","last_change":"2024-09-15T12:22:00.397700+0000","last_active":"2024-09-15T12:24:11.488429+0000","last_peered":"2024-09-15T12:24:11.488429+0000","last_clean":"2024-09-15T12:24:11.488429+0000","last_became_active":"2024-09-15T12:22:00.388314+0000","last_became_peered":"2024-09-15T12:22:00.388314+0000","last_unstale":"2024-09-15T12:24:11.488429+0000","last_undegraded":"2024-09-15T12:24:11.488429+0000","last_fullsized":"2024-09-15T12:24:11.488429+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1587,"log_dups_size":0,"ondisk_log_size":1587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41222144,"num_objects":629,"num_object_clones":0,"num_object_copies":1887,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1587,"num_write_kb":70912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"50'1496","reported_seq":1556,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.688491+0000","last_change":"2024-09-15T12:22:00.418610+0000","last_active":"2024-09-15T12:24:10.688491+0000","last_peered":"2024-09-15T12:24:10.688491+0000","last_clean":"2024-09-15T12:24:10.688491+0000","last_became_active":"2024-09-15T12:22:00.404352+0000","last_became_peered":"2024-09-15T12:22:00.404352+0000","last_unstale":"2024-09-15T12:24:10.688491+0000","last_undegraded":"2024-09-15T12:24:10.688491+0000","last_fullsized":"2024-09-15T12:24:10.688491+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1496,"log_dups_size":0,"ondisk_log_size":1496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42336256,"num_objects":646,"num_object_clones":0,"num_object_copies":1938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1496,"num_write_kb":68544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"50'1589","reported_seq":1649,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.658164+0000","last_change":"2024-09-15T12:22:00.408893+0000","last_active":"2024-09-15T12:24:10.658164+0000","last_peered":"2024-09-15T12:24:10.658164+0000","last_clean":"2024-09-15T12:24:10.658164+0000","last_became_active":"2024-09-15T12:22:00.399557+0000","last_became_peered":"2024-09-15T12:22:00.399557+0000","last_unstale":"2024-09-15T12:24:10.658164+0000","last_undegraded":"2024-09-15T12:24:10.658164+0000","last_fullsized":"2024-09-15T12:24:10.658164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1589,"log_dups_size":0,"ondisk_log_size":1589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45154304,"num_objects":689,"num_object_clones":0,"num_object_copies":2067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1589,"num_write_kb":72896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"50'1650","reported_seq":1710,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.696263+0000","last_change":"2024-09-15T12:22:00.458263+0000","last_active":"2024-09-15T12:24:10.696263+0000","last_peered":"2024-09-15T12:24:10.696263+0000","last_clean":"2024-09-15T12:24:10.696263+0000","last_became_active":"2024-09-15T12:22:00.446629+0000","last_became_peered":"2024-09-15T12:22:00.446629+0000","last_unstale":"2024-09-15T12:24:10.696263+0000","last_undegraded":"2024-09-15T12:24:10.696263+0000","last_fullsized":"2024-09-15T12:24:10.696263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1650,"log_dups_size":0,"ondisk_log_size":1650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44433408,"num_objects":678,"num_object_clones":0,"num_object_copies":2034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1650,"num_write_kb":74496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"50'1616","reported_seq":1676,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.486172+0000","last_change":"2024-09-15T12:22:00.432607+0000","last_active":"2024-09-15T12:24:10.486172+0000","last_peered":"2024-09-15T12:24:10.486172+0000","last_clean":"2024-09-15T12:24:10.486172+0000","last_became_active":"2024-09-15T12:22:00.422177+0000","last_became_peered":"2024-09-15T12:22:00.422177+0000","last_unstale":"2024-09-15T12:24:10.486172+0000","last_undegraded":"2024-09-15T12:24:10.486172+0000","last_fullsized":"2024-09-15T12:24:10.486172+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1616,"log_dups_size":0,"ondisk_log_size":1616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46006272,"num_objects":702,"num_object_clones":0,"num_object_copies":2106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1616,"num_write_kb":74176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"50'1543","reported_seq":1603,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.688794+0000","last_change":"2024-09-15T12:22:00.420197+0000","last_active":"2024-09-15T12:24:10.688794+0000","last_peered":"2024-09-15T12:24:10.688794+0000","last_clean":"2024-09-15T12:24:10.688794+0000","last_became_active":"2024-09-15T12:22:00.406666+0000","last_became_peered":"2024-09-15T12:22:00.406666+0000","last_unstale":"2024-09-15T12:24:10.688794+0000","last_undegraded":"2024-09-15T12:24:10.688794+0000","last_fullsized":"2024-09-15T12:24:10.688794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1543,"log_dups_size":0,"ondisk_log_size":1543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40828928,"num_objects":623,"num_object_clones":0,"num_object_copies":1869,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1543,"num_write_kb":69312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":193,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.876676+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:23:38.876676+0000","last_peered":"2024-09-15T12:23:38.876676+0000","last_clean":"2024-09-15T12:23:38.876676+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:23:38.876676+0000","last_undegraded":"2024-09-15T12:23:38.876676+0000","last_fullsized":"2024-09-15T12:23:38.876676+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":122,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.905388+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:23:38.905388+0000","last_peered":"2024-09-15T12:23:38.905388+0000","last_clean":"2024-09-15T12:23:38.905388+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:23:38.905388+0000","last_undegraded":"2024-09-15T12:23:38.905388+0000","last_fullsized":"2024-09-15T12:23:38.905388+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"50'1609","reported_seq":1669,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.643304+0000","last_change":"2024-09-15T12:22:00.381165+0000","last_active":"2024-09-15T12:24:10.643304+0000","last_peered":"2024-09-15T12:24:10.643304+0000","last_clean":"2024-09-15T12:24:10.643304+0000","last_became_active":"2024-09-15T12:22:00.374145+0000","last_became_peered":"2024-09-15T12:22:00.374145+0000","last_unstale":"2024-09-15T12:24:10.643304+0000","last_undegraded":"2024-09-15T12:24:10.643304+0000","last_fullsized":"2024-09-15T12:24:10.643304+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1609,"log_dups_size":0,"ondisk_log_size":1609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43319296,"num_objects":661,"num_object_clones":0,"num_object_copies":1983,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1609,"num_write_kb":72640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.906246+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:23:38.906246+0000","last_peered":"2024-09-15T12:23:38.906246+0000","last_clean":"2024-09-15T12:23:38.906246+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:23:38.906246+0000","last_undegraded":"2024-09-15T12:23:38.906246+0000","last_fullsized":"2024-09-15T12:23:38.906246+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"50'1546","reported_seq":1606,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.500743+0000","last_change":"2024-09-15T12:22:00.405131+0000","last_active":"2024-09-15T12:24:10.500743+0000","last_peered":"2024-09-15T12:24:10.500743+0000","last_clean":"2024-09-15T12:24:10.500743+0000","last_became_active":"2024-09-15T12:22:00.398288+0000","last_became_peered":"2024-09-15T12:22:00.398288+0000","last_unstale":"2024-09-15T12:24:10.500743+0000","last_undegraded":"2024-09-15T12:24:10.500743+0000","last_fullsized":"2024-09-15T12:24:10.500743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1546,"log_dups_size":0,"ondisk_log_size":1546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45613056,"num_objects":696,"num_object_clones":0,"num_object_copies":2088,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1546,"num_write_kb":71744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.899555+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:23:38.899555+0000","last_peered":"2024-09-15T12:23:38.899555+0000","last_clean":"2024-09-15T12:23:38.899555+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:23:38.899555+0000","last_undegraded":"2024-09-15T12:23:38.899555+0000","last_fullsized":"2024-09-15T12:23:38.899555+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"50'1638","reported_seq":1698,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.691281+0000","last_change":"2024-09-15T12:22:00.390143+0000","last_active":"2024-09-15T12:24:10.691281+0000","last_peered":"2024-09-15T12:24:10.691281+0000","last_clean":"2024-09-15T12:24:10.691281+0000","last_became_active":"2024-09-15T12:22:00.370049+0000","last_became_peered":"2024-09-15T12:22:00.370049+0000","last_unstale":"2024-09-15T12:24:10.691281+0000","last_undegraded":"2024-09-15T12:24:10.691281+0000","last_fullsized":"2024-09-15T12:24:10.691281+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1638,"log_dups_size":0,"ondisk_log_size":1638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46661632,"num_objects":712,"num_object_clones":0,"num_object_copies":2136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1638,"num_write_kb":75200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":123,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.899570+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:23:38.899570+0000","last_peered":"2024-09-15T12:23:38.899570+0000","last_clean":"2024-09-15T12:23:38.899570+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:23:38.899570+0000","last_undegraded":"2024-09-15T12:23:38.899570+0000","last_fullsized":"2024-09-15T12:23:38.899570+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"50'1555","reported_seq":1615,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.543073+0000","last_change":"2024-09-15T12:22:00.450159+0000","last_active":"2024-09-15T12:24:10.543073+0000","last_peered":"2024-09-15T12:24:10.543073+0000","last_clean":"2024-09-15T12:24:10.543073+0000","last_became_active":"2024-09-15T12:22:00.437056+0000","last_became_peered":"2024-09-15T12:22:00.437056+0000","last_unstale":"2024-09-15T12:24:10.543073+0000","last_undegraded":"2024-09-15T12:24:10.543073+0000","last_fullsized":"2024-09-15T12:24:10.543073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1555,"log_dups_size":0,"ondisk_log_size":1555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45547520,"num_objects":695,"num_object_clones":0,"num_object_copies":2085,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1555,"num_write_kb":72000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.879479+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:23:38.879479+0000","last_peered":"2024-09-15T12:23:38.879479+0000","last_clean":"2024-09-15T12:23:38.879479+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:23:38.879479+0000","last_undegraded":"2024-09-15T12:23:38.879479+0000","last_fullsized":"2024-09-15T12:23:38.879479+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"50'1590","reported_seq":1650,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.710197+0000","last_change":"2024-09-15T12:22:00.364579+0000","last_active":"2024-09-15T12:24:10.710197+0000","last_peered":"2024-09-15T12:24:10.710197+0000","last_clean":"2024-09-15T12:24:10.710197+0000","last_became_active":"2024-09-15T12:22:00.353614+0000","last_became_peered":"2024-09-15T12:22:00.353614+0000","last_unstale":"2024-09-15T12:24:10.710197+0000","last_undegraded":"2024-09-15T12:24:10.710197+0000","last_fullsized":"2024-09-15T12:24:10.710197+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1590,"log_dups_size":0,"ondisk_log_size":1590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44433408,"num_objects":678,"num_object_clones":0,"num_object_copies":2034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1590,"num_write_kb":72576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.884650+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:23:38.884650+0000","last_peered":"2024-09-15T12:23:38.884650+0000","last_clean":"2024-09-15T12:23:38.884650+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:23:38.884650+0000","last_undegraded":"2024-09-15T12:23:38.884650+0000","last_fullsized":"2024-09-15T12:23:38.884650+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"50'1620","reported_seq":1680,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.526461+0000","last_change":"2024-09-15T12:22:00.384094+0000","last_active":"2024-09-15T12:24:10.526461+0000","last_peered":"2024-09-15T12:24:10.526461+0000","last_clean":"2024-09-15T12:24:10.526461+0000","last_became_active":"2024-09-15T12:22:00.377789+0000","last_became_peered":"2024-09-15T12:22:00.377789+0000","last_unstale":"2024-09-15T12:24:10.526461+0000","last_undegraded":"2024-09-15T12:24:10.526461+0000","last_fullsized":"2024-09-15T12:24:10.526461+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1620,"log_dups_size":0,"ondisk_log_size":1620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46792704,"num_objects":714,"num_object_clones":0,"num_object_copies":2142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1620,"num_write_kb":74688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.879601+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:23:38.879601+0000","last_peered":"2024-09-15T12:23:38.879601+0000","last_clean":"2024-09-15T12:23:38.879601+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:23:38.879601+0000","last_undegraded":"2024-09-15T12:23:38.879601+0000","last_fullsized":"2024-09-15T12:23:38.879601+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"50'1633","reported_seq":1693,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.526897+0000","last_change":"2024-09-15T12:22:00.394121+0000","last_active":"2024-09-15T12:24:10.526897+0000","last_peered":"2024-09-15T12:24:10.526897+0000","last_clean":"2024-09-15T12:24:10.526897+0000","last_became_active":"2024-09-15T12:22:00.388183+0000","last_became_peered":"2024-09-15T12:22:00.388183+0000","last_unstale":"2024-09-15T12:24:10.526897+0000","last_undegraded":"2024-09-15T12:24:10.526897+0000","last_fullsized":"2024-09-15T12:24:10.526897+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1633,"log_dups_size":0,"ondisk_log_size":1633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45547520,"num_objects":695,"num_object_clones":0,"num_object_copies":2085,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1633,"num_write_kb":74496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.906326+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:23:38.906326+0000","last_peered":"2024-09-15T12:23:38.906326+0000","last_clean":"2024-09-15T12:23:38.906326+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:23:38.906326+0000","last_undegraded":"2024-09-15T12:23:38.906326+0000","last_fullsized":"2024-09-15T12:23:38.906326+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":715128856,"num_objects":10913,"num_object_clones":0,"num_object_copies":32739,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":25575,"num_write_kb":1167553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":133607424,"data_stored":2137522248,"data_compressed":101500989,"data_compressed_allocated":133595136,"data_compressed_original":2137522176,"omap_allocated":0,"internal_metadata":0},"log_size":25575,"ondisk_log_size":25575,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673289,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":106788,"kb_used_data":35536,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94265052,"statfs":{"total":96636764160,"available":96527413248,"internally_reserved":0,"allocated":36388864,"data_stored":575295174,"data_compressed":27312935,"data_compressed_allocated":35950592,"data_compressed_original":575127552,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":91084,"kb_used_data":28156,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94280756,"statfs":{"total":96636764160,"available":96543494144,"internally_reserved":0,"allocated":28831744,"data_stored":454250225,"data_compressed":21565071,"data_compressed_allocated":28385280,"data_compressed_original":454082560,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":103112,"kb_used_data":36020,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94268728,"statfs":{"total":96636764160,"available":96531177472,"internally_reserved":0,"allocated":36884480,"data_stored":583486673,"data_compressed":27699912,"data_compressed_allocated":36458496,"data_compressed_original":583335936,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":104440,"kb_used_data":33192,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94267400,"statfs":{"total":96636764160,"available":96529817600,"internally_reserved":0,"allocated":33988608,"data_stored":536760049,"data_compressed":25483079,"data_compressed_allocated":33542144,"data_compressed_original":536592384,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33366016,"data_stored":533790744,"data_compressed":25347239,"data_compressed_allocated":33361920,"data_compressed_original":533790720,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36315136,"data_stored":580976664,"data_compressed":27587880,"data_compressed_allocated":36311040,"data_compressed_original":580976640,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28147712,"data_stored":450297880,"data_compressed":21382551,"data_compressed_allocated":28143616,"data_compressed_original":450297856,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35778560,"data_stored":572456960,"data_compressed":27183319,"data_compressed_allocated":35778560,"data_compressed_original":572456960,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:24:24.818 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:24:25.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:25.023+0000 7f61ae151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:25.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:25.037+0000 7f61ae151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:25.370 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:24:25.370 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:24:25.390 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":218,"stamp":"2024-09-15T12:24:24.240542+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":715719243,"num_objects":10917,"num_object_clones":0,"num_object_copies":32751,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":25656,"num_write_kb":1168661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25630,"ondisk_log_size":25630,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":405424,"kb_used_data":132904,"kb_used_omap":0,"kb_used_meta":272448,"kb_avail":377081936,"statfs":{"total":386547056640,"available":386131902464,"internally_reserved":0,"allocated":136093696,"data_stored":2149792121,"data_compressed":102060997,"data_compressed_allocated":134336512,"data_compressed_original":2149138432,"omap_allocated":0,"internal_metadata":278986752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.470580"},"pg_stats":[{"pgid":"4.f","version":"50'1628","reported_seq":1688,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.634790+0000","last_change":"2024-09-15T12:22:00.377854+0000","last_active":"2024-09-15T12:24:10.634790+0000","last_peered":"2024-09-15T12:24:10.634790+0000","last_clean":"2024-09-15T12:24:10.634790+0000","last_became_active":"2024-09-15T12:22:00.359790+0000","last_became_peered":"2024-09-15T12:22:00.359790+0000","last_unstale":"2024-09-15T12:24:10.634790+0000","last_undegraded":"2024-09-15T12:24:10.634790+0000","last_fullsized":"2024-09-15T12:24:10.634790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1628,"log_dups_size":0,"ondisk_log_size":1628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46006272,"num_objects":702,"num_object_clones":0,"num_object_copies":2106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1628,"num_write_kb":74560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"50'1613","reported_seq":1673,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.715301+0000","last_change":"2024-09-15T12:22:00.383291+0000","last_active":"2024-09-15T12:24:10.715301+0000","last_peered":"2024-09-15T12:24:10.715301+0000","last_clean":"2024-09-15T12:24:10.715301+0000","last_became_active":"2024-09-15T12:22:00.376330+0000","last_became_peered":"2024-09-15T12:22:00.376330+0000","last_unstale":"2024-09-15T12:24:10.715301+0000","last_undegraded":"2024-09-15T12:24:10.715301+0000","last_fullsized":"2024-09-15T12:24:10.715301+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1613,"log_dups_size":0,"ondisk_log_size":1613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44630016,"num_objects":681,"num_object_clones":0,"num_object_copies":2043,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1613,"num_write_kb":73408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"50'1662","reported_seq":1723,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.585317+0000","last_change":"2024-09-15T12:22:00.413467+0000","last_active":"2024-09-15T12:24:10.585317+0000","last_peered":"2024-09-15T12:24:10.585317+0000","last_clean":"2024-09-15T12:24:10.585317+0000","last_became_active":"2024-09-15T12:22:00.399293+0000","last_became_peered":"2024-09-15T12:22:00.399293+0000","last_unstale":"2024-09-15T12:24:10.585317+0000","last_undegraded":"2024-09-15T12:24:10.585317+0000","last_fullsized":"2024-09-15T12:24:10.585317+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1662,"log_dups_size":0,"ondisk_log_size":1662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46596120,"num_objects":712,"num_object_clones":0,"num_object_copies":2136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1662,"num_write_kb":75905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"50'1587","reported_seq":1647,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:11.488429+0000","last_change":"2024-09-15T12:22:00.397700+0000","last_active":"2024-09-15T12:24:11.488429+0000","last_peered":"2024-09-15T12:24:11.488429+0000","last_clean":"2024-09-15T12:24:11.488429+0000","last_became_active":"2024-09-15T12:22:00.388314+0000","last_became_peered":"2024-09-15T12:22:00.388314+0000","last_unstale":"2024-09-15T12:24:11.488429+0000","last_undegraded":"2024-09-15T12:24:11.488429+0000","last_fullsized":"2024-09-15T12:24:11.488429+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1587,"log_dups_size":0,"ondisk_log_size":1587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41222144,"num_objects":629,"num_object_clones":0,"num_object_copies":1887,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1587,"num_write_kb":70912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"50'1496","reported_seq":1556,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.688491+0000","last_change":"2024-09-15T12:22:00.418610+0000","last_active":"2024-09-15T12:24:10.688491+0000","last_peered":"2024-09-15T12:24:10.688491+0000","last_clean":"2024-09-15T12:24:10.688491+0000","last_became_active":"2024-09-15T12:22:00.404352+0000","last_became_peered":"2024-09-15T12:22:00.404352+0000","last_unstale":"2024-09-15T12:24:10.688491+0000","last_undegraded":"2024-09-15T12:24:10.688491+0000","last_fullsized":"2024-09-15T12:24:10.688491+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1496,"log_dups_size":0,"ondisk_log_size":1496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42336256,"num_objects":646,"num_object_clones":0,"num_object_copies":1938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1496,"num_write_kb":68544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"50'1589","reported_seq":1649,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.658164+0000","last_change":"2024-09-15T12:22:00.408893+0000","last_active":"2024-09-15T12:24:10.658164+0000","last_peered":"2024-09-15T12:24:10.658164+0000","last_clean":"2024-09-15T12:24:10.658164+0000","last_became_active":"2024-09-15T12:22:00.399557+0000","last_became_peered":"2024-09-15T12:22:00.399557+0000","last_unstale":"2024-09-15T12:24:10.658164+0000","last_undegraded":"2024-09-15T12:24:10.658164+0000","last_fullsized":"2024-09-15T12:24:10.658164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1589,"log_dups_size":0,"ondisk_log_size":1589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45154304,"num_objects":689,"num_object_clones":0,"num_object_copies":2067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1589,"num_write_kb":72896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"50'1650","reported_seq":1710,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.696263+0000","last_change":"2024-09-15T12:22:00.458263+0000","last_active":"2024-09-15T12:24:10.696263+0000","last_peered":"2024-09-15T12:24:10.696263+0000","last_clean":"2024-09-15T12:24:10.696263+0000","last_became_active":"2024-09-15T12:22:00.446629+0000","last_became_peered":"2024-09-15T12:22:00.446629+0000","last_unstale":"2024-09-15T12:24:10.696263+0000","last_undegraded":"2024-09-15T12:24:10.696263+0000","last_fullsized":"2024-09-15T12:24:10.696263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1650,"log_dups_size":0,"ondisk_log_size":1650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44433408,"num_objects":678,"num_object_clones":0,"num_object_copies":2034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1650,"num_write_kb":74496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"50'1616","reported_seq":1676,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.486172+0000","last_change":"2024-09-15T12:22:00.432607+0000","last_active":"2024-09-15T12:24:10.486172+0000","last_peered":"2024-09-15T12:24:10.486172+0000","last_clean":"2024-09-15T12:24:10.486172+0000","last_became_active":"2024-09-15T12:22:00.422177+0000","last_became_peered":"2024-09-15T12:22:00.422177+0000","last_unstale":"2024-09-15T12:24:10.486172+0000","last_undegraded":"2024-09-15T12:24:10.486172+0000","last_fullsized":"2024-09-15T12:24:10.486172+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1616,"log_dups_size":0,"ondisk_log_size":1616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46006272,"num_objects":702,"num_object_clones":0,"num_object_copies":2106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1616,"num_write_kb":74176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"50'1543","reported_seq":1603,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.688794+0000","last_change":"2024-09-15T12:22:00.420197+0000","last_active":"2024-09-15T12:24:10.688794+0000","last_peered":"2024-09-15T12:24:10.688794+0000","last_clean":"2024-09-15T12:24:10.688794+0000","last_became_active":"2024-09-15T12:22:00.406666+0000","last_became_peered":"2024-09-15T12:22:00.406666+0000","last_unstale":"2024-09-15T12:24:10.688794+0000","last_undegraded":"2024-09-15T12:24:10.688794+0000","last_fullsized":"2024-09-15T12:24:10.688794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1543,"log_dups_size":0,"ondisk_log_size":1543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40828928,"num_objects":623,"num_object_clones":0,"num_object_copies":1869,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1543,"num_write_kb":69312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":193,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.876676+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:23:38.876676+0000","last_peered":"2024-09-15T12:23:38.876676+0000","last_clean":"2024-09-15T12:23:38.876676+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:23:38.876676+0000","last_undegraded":"2024-09-15T12:23:38.876676+0000","last_fullsized":"2024-09-15T12:23:38.876676+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":122,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.905388+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:23:38.905388+0000","last_peered":"2024-09-15T12:23:38.905388+0000","last_clean":"2024-09-15T12:23:38.905388+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:23:38.905388+0000","last_undegraded":"2024-09-15T12:23:38.905388+0000","last_fullsized":"2024-09-15T12:23:38.905388+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"50'1609","reported_seq":1669,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.643304+0000","last_change":"2024-09-15T12:22:00.381165+0000","last_active":"2024-09-15T12:24:10.643304+0000","last_peered":"2024-09-15T12:24:10.643304+0000","last_clean":"2024-09-15T12:24:10.643304+0000","last_became_active":"2024-09-15T12:22:00.374145+0000","last_became_peered":"2024-09-15T12:22:00.374145+0000","last_unstale":"2024-09-15T12:24:10.643304+0000","last_undegraded":"2024-09-15T12:24:10.643304+0000","last_fullsized":"2024-09-15T12:24:10.643304+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1609,"log_dups_size":0,"ondisk_log_size":1609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43319296,"num_objects":661,"num_object_clones":0,"num_object_copies":1983,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1609,"num_write_kb":72640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.906246+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:23:38.906246+0000","last_peered":"2024-09-15T12:23:38.906246+0000","last_clean":"2024-09-15T12:23:38.906246+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:23:38.906246+0000","last_undegraded":"2024-09-15T12:23:38.906246+0000","last_fullsized":"2024-09-15T12:23:38.906246+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"50'1546","reported_seq":1606,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.500743+0000","last_change":"2024-09-15T12:22:00.405131+0000","last_active":"2024-09-15T12:24:10.500743+0000","last_peered":"2024-09-15T12:24:10.500743+0000","last_clean":"2024-09-15T12:24:10.500743+0000","last_became_active":"2024-09-15T12:22:00.398288+0000","last_became_peered":"2024-09-15T12:22:00.398288+0000","last_unstale":"2024-09-15T12:24:10.500743+0000","last_undegraded":"2024-09-15T12:24:10.500743+0000","last_fullsized":"2024-09-15T12:24:10.500743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1546,"log_dups_size":0,"ondisk_log_size":1546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45613056,"num_objects":696,"num_object_clones":0,"num_object_copies":2088,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1546,"num_write_kb":71744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.899555+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:23:38.899555+0000","last_peered":"2024-09-15T12:23:38.899555+0000","last_clean":"2024-09-15T12:23:38.899555+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:23:38.899555+0000","last_undegraded":"2024-09-15T12:23:38.899555+0000","last_fullsized":"2024-09-15T12:23:38.899555+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"50'1638","reported_seq":1698,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.691281+0000","last_change":"2024-09-15T12:22:00.390143+0000","last_active":"2024-09-15T12:24:10.691281+0000","last_peered":"2024-09-15T12:24:10.691281+0000","last_clean":"2024-09-15T12:24:10.691281+0000","last_became_active":"2024-09-15T12:22:00.370049+0000","last_became_peered":"2024-09-15T12:22:00.370049+0000","last_unstale":"2024-09-15T12:24:10.691281+0000","last_undegraded":"2024-09-15T12:24:10.691281+0000","last_fullsized":"2024-09-15T12:24:10.691281+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1638,"log_dups_size":0,"ondisk_log_size":1638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46661632,"num_objects":712,"num_object_clones":0,"num_object_copies":2136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1638,"num_write_kb":75200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":123,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.899570+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:23:38.899570+0000","last_peered":"2024-09-15T12:23:38.899570+0000","last_clean":"2024-09-15T12:23:38.899570+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:23:38.899570+0000","last_undegraded":"2024-09-15T12:23:38.899570+0000","last_fullsized":"2024-09-15T12:23:38.899570+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"50'1555","reported_seq":1615,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.543073+0000","last_change":"2024-09-15T12:22:00.450159+0000","last_active":"2024-09-15T12:24:10.543073+0000","last_peered":"2024-09-15T12:24:10.543073+0000","last_clean":"2024-09-15T12:24:10.543073+0000","last_became_active":"2024-09-15T12:22:00.437056+0000","last_became_peered":"2024-09-15T12:22:00.437056+0000","last_unstale":"2024-09-15T12:24:10.543073+0000","last_undegraded":"2024-09-15T12:24:10.543073+0000","last_fullsized":"2024-09-15T12:24:10.543073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1555,"log_dups_size":0,"ondisk_log_size":1555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45547520,"num_objects":695,"num_object_clones":0,"num_object_copies":2085,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1555,"num_write_kb":72000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.879479+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:23:38.879479+0000","last_peered":"2024-09-15T12:23:38.879479+0000","last_clean":"2024-09-15T12:23:38.879479+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:23:38.879479+0000","last_undegraded":"2024-09-15T12:23:38.879479+0000","last_fullsized":"2024-09-15T12:23:38.879479+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"50'1590","reported_seq":1650,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.710197+0000","last_change":"2024-09-15T12:22:00.364579+0000","last_active":"2024-09-15T12:24:10.710197+0000","last_peered":"2024-09-15T12:24:10.710197+0000","last_clean":"2024-09-15T12:24:10.710197+0000","last_became_active":"2024-09-15T12:22:00.353614+0000","last_became_peered":"2024-09-15T12:22:00.353614+0000","last_unstale":"2024-09-15T12:24:10.710197+0000","last_undegraded":"2024-09-15T12:24:10.710197+0000","last_fullsized":"2024-09-15T12:24:10.710197+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1590,"log_dups_size":0,"ondisk_log_size":1590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44433408,"num_objects":678,"num_object_clones":0,"num_object_copies":2034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1590,"num_write_kb":72576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.884650+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:23:38.884650+0000","last_peered":"2024-09-15T12:23:38.884650+0000","last_clean":"2024-09-15T12:23:38.884650+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:23:38.884650+0000","last_undegraded":"2024-09-15T12:23:38.884650+0000","last_fullsized":"2024-09-15T12:23:38.884650+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"50'1620","reported_seq":1680,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.526461+0000","last_change":"2024-09-15T12:22:00.384094+0000","last_active":"2024-09-15T12:24:10.526461+0000","last_peered":"2024-09-15T12:24:10.526461+0000","last_clean":"2024-09-15T12:24:10.526461+0000","last_became_active":"2024-09-15T12:22:00.377789+0000","last_became_peered":"2024-09-15T12:22:00.377789+0000","last_unstale":"2024-09-15T12:24:10.526461+0000","last_undegraded":"2024-09-15T12:24:10.526461+0000","last_fullsized":"2024-09-15T12:24:10.526461+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1620,"log_dups_size":0,"ondisk_log_size":1620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46792704,"num_objects":714,"num_object_clones":0,"num_object_copies":2142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1620,"num_write_kb":74688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.879601+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:23:38.879601+0000","last_peered":"2024-09-15T12:23:38.879601+0000","last_clean":"2024-09-15T12:23:38.879601+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:23:38.879601+0000","last_undegraded":"2024-09-15T12:23:38.879601+0000","last_fullsized":"2024-09-15T12:23:38.879601+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"50'1633","reported_seq":1693,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.526897+0000","last_change":"2024-09-15T12:22:00.394121+0000","last_active":"2024-09-15T12:24:10.526897+0000","last_peered":"2024-09-15T12:24:10.526897+0000","last_clean":"2024-09-15T12:24:10.526897+0000","last_became_active":"2024-09-15T12:22:00.388183+0000","last_became_peered":"2024-09-15T12:22:00.388183+0000","last_unstale":"2024-09-15T12:24:10.526897+0000","last_undegraded":"2024-09-15T12:24:10.526897+0000","last_fullsized":"2024-09-15T12:24:10.526897+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1633,"log_dups_size":0,"ondisk_log_size":1633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45547520,"num_objects":695,"num_object_clones":0,"num_object_copies":2085,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1633,"num_write_kb":74496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.906326+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:23:38.906326+0000","last_peered":"2024-09-15T12:23:38.906326+0000","last_clean":"2024-09-15T12:23:38.906326+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:23:38.906326+0000","last_undegraded":"2024-09-15T12:23:38.906326+0000","last_fullsized":"2024-09-15T12:23:38.906326+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":715128856,"num_objects":10913,"num_object_clones":0,"num_object_copies":32739,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":25575,"num_write_kb":1167553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":133607424,"data_stored":2137522248,"data_compressed":101500989,"data_compressed_allocated":133595136,"data_compressed_original":2137522176,"omap_allocated":0,"internal_metadata":0},"log_size":25575,"ondisk_log_size":25575,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673289,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":106788,"kb_used_data":35536,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94265052,"statfs":{"total":96636764160,"available":96527413248,"internally_reserved":0,"allocated":36388864,"data_stored":575295174,"data_compressed":27312935,"data_compressed_allocated":35950592,"data_compressed_original":575127552,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":91084,"kb_used_data":28156,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94280756,"statfs":{"total":96636764160,"available":96543494144,"internally_reserved":0,"allocated":28831744,"data_stored":454250225,"data_compressed":21565071,"data_compressed_allocated":28385280,"data_compressed_original":454082560,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":103112,"kb_used_data":36020,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94268728,"statfs":{"total":96636764160,"available":96531177472,"internally_reserved":0,"allocated":36884480,"data_stored":583486673,"data_compressed":27699912,"data_compressed_allocated":36458496,"data_compressed_original":583335936,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":104440,"kb_used_data":33192,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94267400,"statfs":{"total":96636764160,"available":96529817600,"internally_reserved":0,"allocated":33988608,"data_stored":536760049,"data_compressed":25483079,"data_compressed_allocated":33542144,"data_compressed_original":536592384,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33366016,"data_stored":533790744,"data_compressed":25347239,"data_compressed_allocated":33361920,"data_compressed_original":533790720,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36315136,"data_stored":580976664,"data_compressed":27587880,"data_compressed_allocated":36311040,"data_compressed_original":580976640,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28147712,"data_stored":450297880,"data_compressed":21382551,"data_compressed_allocated":28143616,"data_compressed_original":450297856,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35778560,"data_stored":572456960,"data_compressed":27183319,"data_compressed_allocated":35778560,"data_compressed_original":572456960,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:24:25.392 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-15T12:24:25.392 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:24:25.392 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:24:25.392 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:24:25.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:25.538+0000 7f787cf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:25.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:25.552+0000 7f787cf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:25.680 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:24:25.680 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:24:25.680 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:24:25.680 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:24:25.680 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:24:25.681 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:24:25.681 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:24:25.681 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:24:25.681 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:24:25.681 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:24:25.681 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:24:25.681 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:24:25.684 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:24:25.684 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:24:25.684 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:24:25.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:25.831+0000 7f96a3f48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:25.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:25.847+0000 7f96a3f48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:26.021 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:24:26.021 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:24:26.021 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:24:26.021 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:24:26.021 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:24:26.021 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:24:26.021 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:24:26.021 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:24:26.021 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:24:26.021 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:24:26.021 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:24:26.021 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:24:26.024 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:24:26.025 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:24:26.025 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:24:26.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:26.187+0000 7fb581897640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:26.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:26.201+0000 7fb581897640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:26.271 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:24:26.271 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:24:26.271 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:24:26.272 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:24:26.272 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:24:26.272 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:24:26.272 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:24:26.272 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:24:26.272 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:24:26.272 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:24:26.272 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:24:26.272 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:24:26.275 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:24:26.276 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:24:26.276 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:24:26.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:26.419+0000 7f09b4a4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:26.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:26.431+0000 7f09b4a4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:26.488 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:24:26.489 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:24:26.489 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:24:26.489 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:24:26.489 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:24:26.489 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:24:26.489 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:24:26.489 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:24:26.489 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:24:26.489 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:24:26.489 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:24:26.489 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:24:26.492 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:24:26.492 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:24:26.979 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:24:27.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:27.117+0000 7fb6cd591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:27.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:27.125+0000 7fb6cd591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:29.732 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:24:29.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:29.888+0000 7fa7b22bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:29.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:29.898+0000 7fa7b22bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:31.493 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:24:31.493 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:24:31.494 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:24:31.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:31.653+0000 7fe046f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:31.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:31.665+0000 7fe046f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:32.021 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:24:32.022 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:24:32.044 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2024-09-15T12:24:31.772182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":715719243,"num_objects":10917,"num_object_clones":0,"num_object_copies":32751,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":25656,"num_write_kb":1168661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25630,"ondisk_log_size":25630,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":405424,"kb_used_data":132904,"kb_used_omap":0,"kb_used_meta":272448,"kb_avail":377081936,"statfs":{"total":386547056640,"available":386131902464,"internally_reserved":0,"allocated":136093696,"data_stored":2149792121,"data_compressed":102060997,"data_compressed_allocated":134336512,"data_compressed_original":2149138432,"omap_allocated":0,"internal_metadata":278986752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.906536"},"pg_stats":[{"pgid":"4.f","version":"50'1628","reported_seq":1688,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.634790+0000","last_change":"2024-09-15T12:22:00.377854+0000","last_active":"2024-09-15T12:24:10.634790+0000","last_peered":"2024-09-15T12:24:10.634790+0000","last_clean":"2024-09-15T12:24:10.634790+0000","last_became_active":"2024-09-15T12:22:00.359790+0000","last_became_peered":"2024-09-15T12:22:00.359790+0000","last_unstale":"2024-09-15T12:24:10.634790+0000","last_undegraded":"2024-09-15T12:24:10.634790+0000","last_fullsized":"2024-09-15T12:24:10.634790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1628,"log_dups_size":0,"ondisk_log_size":1628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46006272,"num_objects":702,"num_object_clones":0,"num_object_copies":2106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1628,"num_write_kb":74560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"50'1613","reported_seq":1673,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.715301+0000","last_change":"2024-09-15T12:22:00.383291+0000","last_active":"2024-09-15T12:24:10.715301+0000","last_peered":"2024-09-15T12:24:10.715301+0000","last_clean":"2024-09-15T12:24:10.715301+0000","last_became_active":"2024-09-15T12:22:00.376330+0000","last_became_peered":"2024-09-15T12:22:00.376330+0000","last_unstale":"2024-09-15T12:24:10.715301+0000","last_undegraded":"2024-09-15T12:24:10.715301+0000","last_fullsized":"2024-09-15T12:24:10.715301+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1613,"log_dups_size":0,"ondisk_log_size":1613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44630016,"num_objects":681,"num_object_clones":0,"num_object_copies":2043,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1613,"num_write_kb":73408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"50'1662","reported_seq":1723,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.585317+0000","last_change":"2024-09-15T12:22:00.413467+0000","last_active":"2024-09-15T12:24:10.585317+0000","last_peered":"2024-09-15T12:24:10.585317+0000","last_clean":"2024-09-15T12:24:10.585317+0000","last_became_active":"2024-09-15T12:22:00.399293+0000","last_became_peered":"2024-09-15T12:22:00.399293+0000","last_unstale":"2024-09-15T12:24:10.585317+0000","last_undegraded":"2024-09-15T12:24:10.585317+0000","last_fullsized":"2024-09-15T12:24:10.585317+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1662,"log_dups_size":0,"ondisk_log_size":1662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46596120,"num_objects":712,"num_object_clones":0,"num_object_copies":2136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1662,"num_write_kb":75905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"50'1587","reported_seq":1647,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:11.488429+0000","last_change":"2024-09-15T12:22:00.397700+0000","last_active":"2024-09-15T12:24:11.488429+0000","last_peered":"2024-09-15T12:24:11.488429+0000","last_clean":"2024-09-15T12:24:11.488429+0000","last_became_active":"2024-09-15T12:22:00.388314+0000","last_became_peered":"2024-09-15T12:22:00.388314+0000","last_unstale":"2024-09-15T12:24:11.488429+0000","last_undegraded":"2024-09-15T12:24:11.488429+0000","last_fullsized":"2024-09-15T12:24:11.488429+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1587,"log_dups_size":0,"ondisk_log_size":1587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41222144,"num_objects":629,"num_object_clones":0,"num_object_copies":1887,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1587,"num_write_kb":70912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"50'1496","reported_seq":1556,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.688491+0000","last_change":"2024-09-15T12:22:00.418610+0000","last_active":"2024-09-15T12:24:10.688491+0000","last_peered":"2024-09-15T12:24:10.688491+0000","last_clean":"2024-09-15T12:24:10.688491+0000","last_became_active":"2024-09-15T12:22:00.404352+0000","last_became_peered":"2024-09-15T12:22:00.404352+0000","last_unstale":"2024-09-15T12:24:10.688491+0000","last_undegraded":"2024-09-15T12:24:10.688491+0000","last_fullsized":"2024-09-15T12:24:10.688491+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1496,"log_dups_size":0,"ondisk_log_size":1496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42336256,"num_objects":646,"num_object_clones":0,"num_object_copies":1938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1496,"num_write_kb":68544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"50'1589","reported_seq":1649,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.658164+0000","last_change":"2024-09-15T12:22:00.408893+0000","last_active":"2024-09-15T12:24:10.658164+0000","last_peered":"2024-09-15T12:24:10.658164+0000","last_clean":"2024-09-15T12:24:10.658164+0000","last_became_active":"2024-09-15T12:22:00.399557+0000","last_became_peered":"2024-09-15T12:22:00.399557+0000","last_unstale":"2024-09-15T12:24:10.658164+0000","last_undegraded":"2024-09-15T12:24:10.658164+0000","last_fullsized":"2024-09-15T12:24:10.658164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1589,"log_dups_size":0,"ondisk_log_size":1589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45154304,"num_objects":689,"num_object_clones":0,"num_object_copies":2067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1589,"num_write_kb":72896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"50'1650","reported_seq":1710,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.696263+0000","last_change":"2024-09-15T12:22:00.458263+0000","last_active":"2024-09-15T12:24:10.696263+0000","last_peered":"2024-09-15T12:24:10.696263+0000","last_clean":"2024-09-15T12:24:10.696263+0000","last_became_active":"2024-09-15T12:22:00.446629+0000","last_became_peered":"2024-09-15T12:22:00.446629+0000","last_unstale":"2024-09-15T12:24:10.696263+0000","last_undegraded":"2024-09-15T12:24:10.696263+0000","last_fullsized":"2024-09-15T12:24:10.696263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1650,"log_dups_size":0,"ondisk_log_size":1650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44433408,"num_objects":678,"num_object_clones":0,"num_object_copies":2034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1650,"num_write_kb":74496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"50'1616","reported_seq":1676,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.486172+0000","last_change":"2024-09-15T12:22:00.432607+0000","last_active":"2024-09-15T12:24:10.486172+0000","last_peered":"2024-09-15T12:24:10.486172+0000","last_clean":"2024-09-15T12:24:10.486172+0000","last_became_active":"2024-09-15T12:22:00.422177+0000","last_became_peered":"2024-09-15T12:22:00.422177+0000","last_unstale":"2024-09-15T12:24:10.486172+0000","last_undegraded":"2024-09-15T12:24:10.486172+0000","last_fullsized":"2024-09-15T12:24:10.486172+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1616,"log_dups_size":0,"ondisk_log_size":1616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46006272,"num_objects":702,"num_object_clones":0,"num_object_copies":2106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1616,"num_write_kb":74176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"50'1543","reported_seq":1603,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.688794+0000","last_change":"2024-09-15T12:22:00.420197+0000","last_active":"2024-09-15T12:24:10.688794+0000","last_peered":"2024-09-15T12:24:10.688794+0000","last_clean":"2024-09-15T12:24:10.688794+0000","last_became_active":"2024-09-15T12:22:00.406666+0000","last_became_peered":"2024-09-15T12:22:00.406666+0000","last_unstale":"2024-09-15T12:24:10.688794+0000","last_undegraded":"2024-09-15T12:24:10.688794+0000","last_fullsized":"2024-09-15T12:24:10.688794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1543,"log_dups_size":0,"ondisk_log_size":1543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40828928,"num_objects":623,"num_object_clones":0,"num_object_copies":1869,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1543,"num_write_kb":69312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":193,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.876676+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:23:38.876676+0000","last_peered":"2024-09-15T12:23:38.876676+0000","last_clean":"2024-09-15T12:23:38.876676+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:23:38.876676+0000","last_undegraded":"2024-09-15T12:23:38.876676+0000","last_fullsized":"2024-09-15T12:23:38.876676+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":122,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.905388+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:23:38.905388+0000","last_peered":"2024-09-15T12:23:38.905388+0000","last_clean":"2024-09-15T12:23:38.905388+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:23:38.905388+0000","last_undegraded":"2024-09-15T12:23:38.905388+0000","last_fullsized":"2024-09-15T12:23:38.905388+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"50'1609","reported_seq":1669,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.643304+0000","last_change":"2024-09-15T12:22:00.381165+0000","last_active":"2024-09-15T12:24:10.643304+0000","last_peered":"2024-09-15T12:24:10.643304+0000","last_clean":"2024-09-15T12:24:10.643304+0000","last_became_active":"2024-09-15T12:22:00.374145+0000","last_became_peered":"2024-09-15T12:22:00.374145+0000","last_unstale":"2024-09-15T12:24:10.643304+0000","last_undegraded":"2024-09-15T12:24:10.643304+0000","last_fullsized":"2024-09-15T12:24:10.643304+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1609,"log_dups_size":0,"ondisk_log_size":1609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43319296,"num_objects":661,"num_object_clones":0,"num_object_copies":1983,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1609,"num_write_kb":72640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.906246+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:23:38.906246+0000","last_peered":"2024-09-15T12:23:38.906246+0000","last_clean":"2024-09-15T12:23:38.906246+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:23:38.906246+0000","last_undegraded":"2024-09-15T12:23:38.906246+0000","last_fullsized":"2024-09-15T12:23:38.906246+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"50'1546","reported_seq":1606,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.500743+0000","last_change":"2024-09-15T12:22:00.405131+0000","last_active":"2024-09-15T12:24:10.500743+0000","last_peered":"2024-09-15T12:24:10.500743+0000","last_clean":"2024-09-15T12:24:10.500743+0000","last_became_active":"2024-09-15T12:22:00.398288+0000","last_became_peered":"2024-09-15T12:22:00.398288+0000","last_unstale":"2024-09-15T12:24:10.500743+0000","last_undegraded":"2024-09-15T12:24:10.500743+0000","last_fullsized":"2024-09-15T12:24:10.500743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1546,"log_dups_size":0,"ondisk_log_size":1546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45613056,"num_objects":696,"num_object_clones":0,"num_object_copies":2088,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1546,"num_write_kb":71744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.899555+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:23:38.899555+0000","last_peered":"2024-09-15T12:23:38.899555+0000","last_clean":"2024-09-15T12:23:38.899555+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:23:38.899555+0000","last_undegraded":"2024-09-15T12:23:38.899555+0000","last_fullsized":"2024-09-15T12:23:38.899555+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"50'1638","reported_seq":1698,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.691281+0000","last_change":"2024-09-15T12:22:00.390143+0000","last_active":"2024-09-15T12:24:10.691281+0000","last_peered":"2024-09-15T12:24:10.691281+0000","last_clean":"2024-09-15T12:24:10.691281+0000","last_became_active":"2024-09-15T12:22:00.370049+0000","last_became_peered":"2024-09-15T12:22:00.370049+0000","last_unstale":"2024-09-15T12:24:10.691281+0000","last_undegraded":"2024-09-15T12:24:10.691281+0000","last_fullsized":"2024-09-15T12:24:10.691281+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1638,"log_dups_size":0,"ondisk_log_size":1638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46661632,"num_objects":712,"num_object_clones":0,"num_object_copies":2136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1638,"num_write_kb":75200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":123,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.899570+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:23:38.899570+0000","last_peered":"2024-09-15T12:23:38.899570+0000","last_clean":"2024-09-15T12:23:38.899570+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:23:38.899570+0000","last_undegraded":"2024-09-15T12:23:38.899570+0000","last_fullsized":"2024-09-15T12:23:38.899570+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"50'1555","reported_seq":1615,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.543073+0000","last_change":"2024-09-15T12:22:00.450159+0000","last_active":"2024-09-15T12:24:10.543073+0000","last_peered":"2024-09-15T12:24:10.543073+0000","last_clean":"2024-09-15T12:24:10.543073+0000","last_became_active":"2024-09-15T12:22:00.437056+0000","last_became_peered":"2024-09-15T12:22:00.437056+0000","last_unstale":"2024-09-15T12:24:10.543073+0000","last_undegraded":"2024-09-15T12:24:10.543073+0000","last_fullsized":"2024-09-15T12:24:10.543073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1555,"log_dups_size":0,"ondisk_log_size":1555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45547520,"num_objects":695,"num_object_clones":0,"num_object_copies":2085,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1555,"num_write_kb":72000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.879479+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:23:38.879479+0000","last_peered":"2024-09-15T12:23:38.879479+0000","last_clean":"2024-09-15T12:23:38.879479+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:23:38.879479+0000","last_undegraded":"2024-09-15T12:23:38.879479+0000","last_fullsized":"2024-09-15T12:23:38.879479+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"50'1590","reported_seq":1650,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.710197+0000","last_change":"2024-09-15T12:22:00.364579+0000","last_active":"2024-09-15T12:24:10.710197+0000","last_peered":"2024-09-15T12:24:10.710197+0000","last_clean":"2024-09-15T12:24:10.710197+0000","last_became_active":"2024-09-15T12:22:00.353614+0000","last_became_peered":"2024-09-15T12:22:00.353614+0000","last_unstale":"2024-09-15T12:24:10.710197+0000","last_undegraded":"2024-09-15T12:24:10.710197+0000","last_fullsized":"2024-09-15T12:24:10.710197+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1590,"log_dups_size":0,"ondisk_log_size":1590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44433408,"num_objects":678,"num_object_clones":0,"num_object_copies":2034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1590,"num_write_kb":72576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.884650+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:23:38.884650+0000","last_peered":"2024-09-15T12:23:38.884650+0000","last_clean":"2024-09-15T12:23:38.884650+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:23:38.884650+0000","last_undegraded":"2024-09-15T12:23:38.884650+0000","last_fullsized":"2024-09-15T12:23:38.884650+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"50'1620","reported_seq":1680,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.526461+0000","last_change":"2024-09-15T12:22:00.384094+0000","last_active":"2024-09-15T12:24:10.526461+0000","last_peered":"2024-09-15T12:24:10.526461+0000","last_clean":"2024-09-15T12:24:10.526461+0000","last_became_active":"2024-09-15T12:22:00.377789+0000","last_became_peered":"2024-09-15T12:22:00.377789+0000","last_unstale":"2024-09-15T12:24:10.526461+0000","last_undegraded":"2024-09-15T12:24:10.526461+0000","last_fullsized":"2024-09-15T12:24:10.526461+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1620,"log_dups_size":0,"ondisk_log_size":1620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46792704,"num_objects":714,"num_object_clones":0,"num_object_copies":2142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1620,"num_write_kb":74688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.879601+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:23:38.879601+0000","last_peered":"2024-09-15T12:23:38.879601+0000","last_clean":"2024-09-15T12:23:38.879601+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:23:38.879601+0000","last_undegraded":"2024-09-15T12:23:38.879601+0000","last_fullsized":"2024-09-15T12:23:38.879601+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"50'1633","reported_seq":1693,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:24:10.526897+0000","last_change":"2024-09-15T12:22:00.394121+0000","last_active":"2024-09-15T12:24:10.526897+0000","last_peered":"2024-09-15T12:24:10.526897+0000","last_clean":"2024-09-15T12:24:10.526897+0000","last_became_active":"2024-09-15T12:22:00.388183+0000","last_became_peered":"2024-09-15T12:22:00.388183+0000","last_unstale":"2024-09-15T12:24:10.526897+0000","last_undegraded":"2024-09-15T12:24:10.526897+0000","last_fullsized":"2024-09-15T12:24:10.526897+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1633,"log_dups_size":0,"ondisk_log_size":1633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45547520,"num_objects":695,"num_object_clones":0,"num_object_copies":2085,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1633,"num_write_kb":74496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-09-15T12:23:38.906326+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:23:38.906326+0000","last_peered":"2024-09-15T12:23:38.906326+0000","last_clean":"2024-09-15T12:23:38.906326+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:23:38.906326+0000","last_undegraded":"2024-09-15T12:23:38.906326+0000","last_fullsized":"2024-09-15T12:23:38.906326+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":715128856,"num_objects":10913,"num_object_clones":0,"num_object_copies":32739,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":25575,"num_write_kb":1167553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":133607424,"data_stored":2137522248,"data_compressed":101500989,"data_compressed_allocated":133595136,"data_compressed_original":2137522176,"omap_allocated":0,"internal_metadata":0},"log_size":25575,"ondisk_log_size":25575,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673289,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":106788,"kb_used_data":35536,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94265052,"statfs":{"total":96636764160,"available":96527413248,"internally_reserved":0,"allocated":36388864,"data_stored":575295174,"data_compressed":27312935,"data_compressed_allocated":35950592,"data_compressed_original":575127552,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":91084,"kb_used_data":28156,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94280756,"statfs":{"total":96636764160,"available":96543494144,"internally_reserved":0,"allocated":28831744,"data_stored":454250225,"data_compressed":21565071,"data_compressed_allocated":28385280,"data_compressed_original":454082560,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":103112,"kb_used_data":36020,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94268728,"statfs":{"total":96636764160,"available":96531177472,"internally_reserved":0,"allocated":36884480,"data_stored":583486673,"data_compressed":27699912,"data_compressed_allocated":36458496,"data_compressed_original":583335936,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":104440,"kb_used_data":33192,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94267400,"statfs":{"total":96636764160,"available":96529817600,"internally_reserved":0,"allocated":33988608,"data_stored":536760049,"data_compressed":25483079,"data_compressed_allocated":33542144,"data_compressed_original":536592384,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":33366016,"data_stored":533790744,"data_compressed":25347239,"data_compressed_allocated":33361920,"data_compressed_original":533790720,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":36315136,"data_stored":580976664,"data_compressed":27587880,"data_compressed_allocated":36311040,"data_compressed_original":580976640,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28147712,"data_stored":450297880,"data_compressed":21382551,"data_compressed_allocated":28143616,"data_compressed_original":450297856,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35778560,"data_stored":572456960,"data_compressed":27183319,"data_compressed_allocated":35778560,"data_compressed_original":572456960,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:24:32.293 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:24:32.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:32.459+0000 7f803c991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:32.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:32.470+0000 7f803c991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:35.106 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:24:35.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:35.247+0000 7f4f8ab51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:35.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:35.255+0000 7f4f8ab51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:37.045 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:24:37.046 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:24:37.046 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:24:37.046 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:24:37.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:37.177+0000 7f72c2351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:37.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:37.189+0000 7f72c2351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:37.236 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:24:37.236 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:24:37.236 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:24:37.236 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:24:37.236 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:24:37.236 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:24:37.236 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:24:37.237 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:24:37.237 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:24:37.237 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:24:37.237 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:24:37.237 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:24:37.241 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:24:37.241 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:24:37.241 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:24:37.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:37.369+0000 7fd8f4351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:37.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:37.387+0000 7fd8f4351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:37.512 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:24:37.512 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:24:37.512 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:24:37.512 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:24:37.512 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:24:37.512 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:24:37.512 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:24:37.512 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:24:37.512 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:24:37.512 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:24:37.513 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:24:37.513 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:24:37.518 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:24:37.518 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:24:37.518 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:24:37.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:37.680+0000 7f645b148640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:37.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:37.695+0000 7f645b148640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:37.785 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:24:37.785 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:24:37.785 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:24:37.785 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:24:37.785 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:24:37.785 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:24:37.786 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:24:37.786 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:24:37.786 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:24:37.786 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:24:37.786 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:24:37.786 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:24:37.790 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:24:37.791 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:24:37.791 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:24:37.826 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:24:37.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:37.958+0000 7f17f7cc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:37.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:37.977+0000 7f17f7cc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:38.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:37.999+0000 7f27e7391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:38.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:38.014+0000 7f27e7391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:38.062 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:24:38.062 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:24:38.062 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:24:38.062 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:24:38.062 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:24:38.062 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:24:38.062 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:24:38.062 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:24:38.062 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:24:38.062 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:24:38.062 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:24:38.062 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:24:38.068 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:24:38.068 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:24:41.024 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:24:41.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:41.174+0000 7f31668bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:41.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:41.183+0000 7f31668bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:43.069 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:24:43.069 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:24:43.069 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:24:43.069 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:24:43.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:43.209+0000 7f04db911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:43.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:43.226+0000 7f04db911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:43.512 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:24:43.512 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:24:43.512 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:24:43.512 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:24:43.512 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:24:43.512 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:24:43.512 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:24:43.512 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:24:43.512 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:24:43.512 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:24:43.513 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:24:43.513 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:24:43.515 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:24:43.516 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:24:43.516 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:24:43.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:43.658+0000 7f715f2ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:43.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:43.671+0000 7f715f2ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:43.823 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:24:43.823 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:24:43.823 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:24:43.824 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:24:43.824 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:24:43.824 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:24:43.824 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:24:43.824 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:24:43.824 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:24:43.824 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:24:43.824 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:24:43.824 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:24:43.828 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:24:43.828 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:24:43.828 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:24:43.832 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:24:43.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:43.971+0000 7f7285311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:43.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:43.988+0000 7f7285311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:44.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:44.034+0000 7fe360688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:44.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:44.046+0000 7fe360688640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:44.082 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:24:44.082 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:24:44.082 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:24:44.083 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:24:44.083 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:24:44.083 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:24:44.083 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:24:44.083 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:24:44.083 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:24:44.083 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:24:44.083 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:24:44.083 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:24:44.086 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:24:44.087 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:24:44.087 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:24:44.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:44.253+0000 7f6b0cf11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:44.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:44.268+0000 7f6b0cf11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:44.391 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:24:44.392 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:24:44.392 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:24:44.392 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:24:44.392 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:24:44.392 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:24:44.392 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:24:44.392 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:24:44.392 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:24:44.392 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:24:44.392 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:24:44.392 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:24:44.395 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:24:44.395 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:24:46.968 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:24:47.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:47.119+0000 7fe5a6911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:47.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:47.127+0000 7fe5a6911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:49.397 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:24:49.397 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:24:49.397 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:24:49.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:49.535+0000 7fac14591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:49.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:49.552+0000 7fac14591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:49.724 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:24:49.866 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:24:49.866 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:24:49.886 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":231,"stamp":"2024-09-15T12:24:49.775518+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":374932043,"num_objects":5717,"num_object_clones":0,"num_object_copies":17151,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":30856,"num_write_kb":1168661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30830,"ondisk_log_size":30830,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":355460,"kb_used_data":70464,"kb_used_omap":0,"kb_used_meta":284928,"kb_avail":377131900,"statfs":{"total":386547056640,"available":386183065600,"internally_reserved":0,"allocated":72155136,"data_stored":1124730377,"data_compressed":53383096,"data_compressed_allocated":70266880,"data_compressed_original":1124024320,"omap_allocated":0,"internal_metadata":291766272},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-340787200,"num_objects":-5200,"num_object_clones":0,"num_object_copies":-15600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5200,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002266"},"pg_stats":[{"pgid":"4.f","version":"54'1958","reported_seq":2030,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.622315+0000","last_change":"2024-09-15T12:22:00.377854+0000","last_active":"2024-09-15T12:24:40.622315+0000","last_peered":"2024-09-15T12:24:40.622315+0000","last_clean":"2024-09-15T12:24:40.622315+0000","last_became_active":"2024-09-15T12:22:00.359790+0000","last_became_peered":"2024-09-15T12:22:00.359790+0000","last_unstale":"2024-09-15T12:24:40.622315+0000","last_undegraded":"2024-09-15T12:24:40.622315+0000","last_fullsized":"2024-09-15T12:24:40.622315+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1958,"log_dups_size":0,"ondisk_log_size":1958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24379392,"num_objects":372,"num_object_clones":0,"num_object_copies":1116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1958,"num_write_kb":74560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"54'1934","reported_seq":2006,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.604805+0000","last_change":"2024-09-15T12:22:00.383291+0000","last_active":"2024-09-15T12:24:40.604805+0000","last_peered":"2024-09-15T12:24:40.604805+0000","last_clean":"2024-09-15T12:24:40.604805+0000","last_became_active":"2024-09-15T12:22:00.376330+0000","last_became_peered":"2024-09-15T12:22:00.376330+0000","last_unstale":"2024-09-15T12:24:40.604805+0000","last_undegraded":"2024-09-15T12:24:40.604805+0000","last_fullsized":"2024-09-15T12:24:40.604805+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1934,"log_dups_size":0,"ondisk_log_size":1934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23592960,"num_objects":360,"num_object_clones":0,"num_object_copies":1080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1934,"num_write_kb":73408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"54'2004","reported_seq":2077,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.542490+0000","last_change":"2024-09-15T12:22:00.413467+0000","last_active":"2024-09-15T12:24:40.542490+0000","last_peered":"2024-09-15T12:24:40.542490+0000","last_clean":"2024-09-15T12:24:40.542490+0000","last_became_active":"2024-09-15T12:22:00.399293+0000","last_became_peered":"2024-09-15T12:22:00.399293+0000","last_unstale":"2024-09-15T12:24:40.542490+0000","last_undegraded":"2024-09-15T12:24:40.542490+0000","last_fullsized":"2024-09-15T12:24:40.542490+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":2004,"log_dups_size":0,"ondisk_log_size":2004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24182808,"num_objects":370,"num_object_clones":0,"num_object_copies":1110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2004,"num_write_kb":75905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"54'1912","reported_seq":1984,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:41.761425+0000","last_change":"2024-09-15T12:22:00.397700+0000","last_active":"2024-09-15T12:24:41.761425+0000","last_peered":"2024-09-15T12:24:41.761425+0000","last_clean":"2024-09-15T12:24:41.761425+0000","last_became_active":"2024-09-15T12:22:00.388314+0000","last_became_peered":"2024-09-15T12:22:00.388314+0000","last_unstale":"2024-09-15T12:24:41.761425+0000","last_undegraded":"2024-09-15T12:24:41.761425+0000","last_fullsized":"2024-09-15T12:24:41.761425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1912,"log_dups_size":0,"ondisk_log_size":1912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19922944,"num_objects":304,"num_object_clones":0,"num_object_copies":912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1912,"num_write_kb":70912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"54'1783","reported_seq":1855,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.330670+0000","last_change":"2024-09-15T12:22:00.418610+0000","last_active":"2024-09-15T12:24:40.330670+0000","last_peered":"2024-09-15T12:24:40.330670+0000","last_clean":"2024-09-15T12:24:40.330670+0000","last_became_active":"2024-09-15T12:22:00.404352+0000","last_became_peered":"2024-09-15T12:22:00.404352+0000","last_unstale":"2024-09-15T12:24:40.330670+0000","last_undegraded":"2024-09-15T12:24:40.330670+0000","last_fullsized":"2024-09-15T12:24:40.330670+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1783,"log_dups_size":0,"ondisk_log_size":1783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23527424,"num_objects":359,"num_object_clones":0,"num_object_copies":1077,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1783,"num_write_kb":68544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"54'1908","reported_seq":1980,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.616861+0000","last_change":"2024-09-15T12:22:00.408893+0000","last_active":"2024-09-15T12:24:40.616861+0000","last_peered":"2024-09-15T12:24:40.616861+0000","last_clean":"2024-09-15T12:24:40.616861+0000","last_became_active":"2024-09-15T12:22:00.399557+0000","last_became_peered":"2024-09-15T12:22:00.399557+0000","last_unstale":"2024-09-15T12:24:40.616861+0000","last_undegraded":"2024-09-15T12:24:40.616861+0000","last_fullsized":"2024-09-15T12:24:40.616861+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1908,"log_dups_size":0,"ondisk_log_size":1908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24248320,"num_objects":370,"num_object_clones":0,"num_object_copies":1110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1908,"num_write_kb":72896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"54'1984","reported_seq":2056,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.694109+0000","last_change":"2024-09-15T12:22:00.458263+0000","last_active":"2024-09-15T12:24:40.694109+0000","last_peered":"2024-09-15T12:24:40.694109+0000","last_clean":"2024-09-15T12:24:40.694109+0000","last_became_active":"2024-09-15T12:22:00.446629+0000","last_became_peered":"2024-09-15T12:22:00.446629+0000","last_unstale":"2024-09-15T12:24:40.694109+0000","last_undegraded":"2024-09-15T12:24:40.694109+0000","last_fullsized":"2024-09-15T12:24:40.694109+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1984,"log_dups_size":0,"ondisk_log_size":1984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22544384,"num_objects":344,"num_object_clones":0,"num_object_copies":1032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1984,"num_write_kb":74496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"54'1975","reported_seq":2047,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.696784+0000","last_change":"2024-09-15T12:22:00.432607+0000","last_active":"2024-09-15T12:24:40.696784+0000","last_peered":"2024-09-15T12:24:40.696784+0000","last_clean":"2024-09-15T12:24:40.696784+0000","last_became_active":"2024-09-15T12:22:00.422177+0000","last_became_peered":"2024-09-15T12:22:00.422177+0000","last_unstale":"2024-09-15T12:24:40.696784+0000","last_undegraded":"2024-09-15T12:24:40.696784+0000","last_fullsized":"2024-09-15T12:24:40.696784+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1975,"log_dups_size":0,"ondisk_log_size":1975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22478848,"num_objects":343,"num_object_clones":0,"num_object_copies":1029,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1975,"num_write_kb":74176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"54'1844","reported_seq":1916,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.506164+0000","last_change":"2024-09-15T12:22:00.420197+0000","last_active":"2024-09-15T12:24:40.506164+0000","last_peered":"2024-09-15T12:24:40.506164+0000","last_clean":"2024-09-15T12:24:40.506164+0000","last_became_active":"2024-09-15T12:22:00.406666+0000","last_became_peered":"2024-09-15T12:22:00.406666+0000","last_unstale":"2024-09-15T12:24:40.506164+0000","last_undegraded":"2024-09-15T12:24:40.506164+0000","last_fullsized":"2024-09-15T12:24:40.506164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1844,"log_dups_size":0,"ondisk_log_size":1844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21102592,"num_objects":322,"num_object_clones":0,"num_object_copies":966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1844,"num_write_kb":69312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.262544+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:24:24.262544+0000","last_peered":"2024-09-15T12:24:24.262544+0000","last_clean":"2024-09-15T12:24:24.262544+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:24:24.262544+0000","last_undegraded":"2024-09-15T12:24:24.262544+0000","last_fullsized":"2024-09-15T12:24:24.262544+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":134,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.293215+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:24:24.293215+0000","last_peered":"2024-09-15T12:24:24.293215+0000","last_clean":"2024-09-15T12:24:24.293215+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:24:24.293215+0000","last_undegraded":"2024-09-15T12:24:24.293215+0000","last_fullsized":"2024-09-15T12:24:24.293215+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"54'1934","reported_seq":2006,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.738950+0000","last_change":"2024-09-15T12:22:00.381165+0000","last_active":"2024-09-15T12:24:40.738950+0000","last_peered":"2024-09-15T12:24:40.738950+0000","last_clean":"2024-09-15T12:24:40.738950+0000","last_became_active":"2024-09-15T12:22:00.374145+0000","last_became_peered":"2024-09-15T12:22:00.374145+0000","last_unstale":"2024-09-15T12:24:40.738950+0000","last_undegraded":"2024-09-15T12:24:40.738950+0000","last_fullsized":"2024-09-15T12:24:40.738950+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1934,"log_dups_size":0,"ondisk_log_size":1934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22020096,"num_objects":336,"num_object_clones":0,"num_object_copies":1008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1934,"num_write_kb":72640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.331270+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:24:24.331270+0000","last_peered":"2024-09-15T12:24:24.331270+0000","last_clean":"2024-09-15T12:24:24.331270+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:24:24.331270+0000","last_undegraded":"2024-09-15T12:24:24.331270+0000","last_fullsized":"2024-09-15T12:24:24.331270+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"54'1877","reported_seq":1949,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.682498+0000","last_change":"2024-09-15T12:22:00.405131+0000","last_active":"2024-09-15T12:24:40.682498+0000","last_peered":"2024-09-15T12:24:40.682498+0000","last_clean":"2024-09-15T12:24:40.682498+0000","last_became_active":"2024-09-15T12:22:00.398288+0000","last_became_peered":"2024-09-15T12:22:00.398288+0000","last_unstale":"2024-09-15T12:24:40.682498+0000","last_undegraded":"2024-09-15T12:24:40.682498+0000","last_fullsized":"2024-09-15T12:24:40.682498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1877,"log_dups_size":0,"ondisk_log_size":1877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23920640,"num_objects":365,"num_object_clones":0,"num_object_copies":1095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1877,"num_write_kb":71744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.284255+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:24:24.284255+0000","last_peered":"2024-09-15T12:24:24.284255+0000","last_clean":"2024-09-15T12:24:24.284255+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:24:24.284255+0000","last_undegraded":"2024-09-15T12:24:24.284255+0000","last_fullsized":"2024-09-15T12:24:24.284255+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"54'1977","reported_seq":2049,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.711584+0000","last_change":"2024-09-15T12:22:00.390143+0000","last_active":"2024-09-15T12:24:40.711584+0000","last_peered":"2024-09-15T12:24:40.711584+0000","last_clean":"2024-09-15T12:24:40.711584+0000","last_became_active":"2024-09-15T12:22:00.370049+0000","last_became_peered":"2024-09-15T12:22:00.370049+0000","last_unstale":"2024-09-15T12:24:40.711584+0000","last_undegraded":"2024-09-15T12:24:40.711584+0000","last_fullsized":"2024-09-15T12:24:40.711584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1977,"log_dups_size":0,"ondisk_log_size":1977,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24444928,"num_objects":373,"num_object_clones":0,"num_object_copies":1119,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1977,"num_write_kb":75200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.297184+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:24:24.297184+0000","last_peered":"2024-09-15T12:24:24.297184+0000","last_clean":"2024-09-15T12:24:24.297184+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:24:24.297184+0000","last_undegraded":"2024-09-15T12:24:24.297184+0000","last_fullsized":"2024-09-15T12:24:24.297184+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"54'1882","reported_seq":1954,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.516472+0000","last_change":"2024-09-15T12:22:00.450159+0000","last_active":"2024-09-15T12:24:40.516472+0000","last_peered":"2024-09-15T12:24:40.516472+0000","last_clean":"2024-09-15T12:24:40.516472+0000","last_became_active":"2024-09-15T12:22:00.437056+0000","last_became_peered":"2024-09-15T12:22:00.437056+0000","last_unstale":"2024-09-15T12:24:40.516472+0000","last_undegraded":"2024-09-15T12:24:40.516472+0000","last_fullsized":"2024-09-15T12:24:40.516472+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1882,"log_dups_size":0,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24117248,"num_objects":368,"num_object_clones":0,"num_object_copies":1104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1882,"num_write_kb":72000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.287155+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:24:24.287155+0000","last_peered":"2024-09-15T12:24:24.287155+0000","last_clean":"2024-09-15T12:24:24.287155+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:24:24.287155+0000","last_undegraded":"2024-09-15T12:24:24.287155+0000","last_fullsized":"2024-09-15T12:24:24.287155+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"54'1882","reported_seq":1954,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.752122+0000","last_change":"2024-09-15T12:22:00.364579+0000","last_active":"2024-09-15T12:24:40.752122+0000","last_peered":"2024-09-15T12:24:40.752122+0000","last_clean":"2024-09-15T12:24:40.752122+0000","last_became_active":"2024-09-15T12:22:00.353614+0000","last_became_peered":"2024-09-15T12:22:00.353614+0000","last_unstale":"2024-09-15T12:24:40.752122+0000","last_undegraded":"2024-09-15T12:24:40.752122+0000","last_fullsized":"2024-09-15T12:24:40.752122+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1882,"log_dups_size":0,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25296896,"num_objects":386,"num_object_clones":0,"num_object_copies":1158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1882,"num_write_kb":72576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.294001+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:24:24.294001+0000","last_peered":"2024-09-15T12:24:24.294001+0000","last_clean":"2024-09-15T12:24:24.294001+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:24:24.294001+0000","last_undegraded":"2024-09-15T12:24:24.294001+0000","last_fullsized":"2024-09-15T12:24:24.294001+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"54'1962","reported_seq":2034,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.687303+0000","last_change":"2024-09-15T12:22:00.384094+0000","last_active":"2024-09-15T12:24:40.687303+0000","last_peered":"2024-09-15T12:24:40.687303+0000","last_clean":"2024-09-15T12:24:40.687303+0000","last_became_active":"2024-09-15T12:22:00.377789+0000","last_became_peered":"2024-09-15T12:22:00.377789+0000","last_unstale":"2024-09-15T12:24:40.687303+0000","last_undegraded":"2024-09-15T12:24:40.687303+0000","last_fullsized":"2024-09-15T12:24:40.687303+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1962,"log_dups_size":0,"ondisk_log_size":1962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24379392,"num_objects":372,"num_object_clones":0,"num_object_copies":1116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1962,"num_write_kb":74688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.269819+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:24:24.269819+0000","last_peered":"2024-09-15T12:24:24.269819+0000","last_clean":"2024-09-15T12:24:24.269819+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:24:24.269819+0000","last_undegraded":"2024-09-15T12:24:24.269819+0000","last_fullsized":"2024-09-15T12:24:24.269819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"54'1959","reported_seq":2031,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.555019+0000","last_change":"2024-09-15T12:22:00.394121+0000","last_active":"2024-09-15T12:24:40.555019+0000","last_peered":"2024-09-15T12:24:40.555019+0000","last_clean":"2024-09-15T12:24:40.555019+0000","last_became_active":"2024-09-15T12:22:00.388183+0000","last_became_peered":"2024-09-15T12:22:00.388183+0000","last_unstale":"2024-09-15T12:24:40.555019+0000","last_undegraded":"2024-09-15T12:24:40.555019+0000","last_fullsized":"2024-09-15T12:24:40.555019+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1959,"log_dups_size":0,"ondisk_log_size":1959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24182784,"num_objects":369,"num_object_clones":0,"num_object_copies":1107,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1959,"num_write_kb":74496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.335125+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:24:24.335125+0000","last_peered":"2024-09-15T12:24:24.335125+0000","last_clean":"2024-09-15T12:24:24.335125+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:24:24.335125+0000","last_undegraded":"2024-09-15T12:24:24.335125+0000","last_fullsized":"2024-09-15T12:24:24.335125+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":374341656,"num_objects":5713,"num_object_clones":0,"num_object_copies":17139,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":30775,"num_write_kb":1167553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":69754880,"data_stored":1115881544,"data_compressed":52988024,"data_compressed_allocated":69742592,"data_compressed_original":1115881472,"omap_allocated":0,"internal_metadata":0},"log_size":30775,"ondisk_log_size":30775,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673319,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":89692,"kb_used_data":18444,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94282148,"statfs":{"total":96636764160,"available":96544919552,"internally_reserved":0,"allocated":18886656,"data_stored":294748650,"data_compressed":13990464,"data_compressed_allocated":18415616,"data_compressed_original":294567936,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":90672,"kb_used_data":15264,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94281168,"statfs":{"total":96636764160,"available":96543916032,"internally_reserved":0,"allocated":15630336,"data_stored":242516501,"data_compressed":11510200,"data_compressed_allocated":15151104,"data_compressed_original":242335744,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86236,"kb_used_data":19144,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94285604,"statfs":{"total":96636764160,"available":96548458496,"internally_reserved":0,"allocated":19603456,"data_stored":306479093,"data_compressed":14545488,"data_compressed_allocated":19144704,"data_compressed_original":306315264,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":88860,"kb_used_data":17612,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94282980,"statfs":{"total":96636764160,"available":96545771520,"internally_reserved":0,"allocated":18034688,"data_stored":280986133,"data_compressed":13336944,"data_compressed_allocated":17555456,"data_compressed_original":280805376,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17420288,"data_stored":278659096,"data_compressed":13232224,"data_compressed_allocated":17416192,"data_compressed_original":278659072,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19054592,"data_stored":304807960,"data_compressed":14473912,"data_compressed_allocated":19050496,"data_compressed_original":304807936,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14999552,"data_stored":239927320,"data_compressed":11393032,"data_compressed_allocated":14995456,"data_compressed_original":239927296,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18280448,"data_stored":292487168,"data_compressed":13888856,"data_compressed_allocated":18280448,"data_compressed_original":292487168,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:24:49.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:49.890+0000 7fc1c9791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:49.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:49.901+0000 7fc1c9791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:52.118 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:24:52.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:52.285+0000 7fdef46d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:52.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:52.295+0000 7fdef46d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:54.733 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:24:54.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:54.875+0000 7ff1f3391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:54.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:54.885+0000 7ff1f3391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:54.888 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:24:54.888 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:24:54.888 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:24:55.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:55.046+0000 7ff8e0646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:55.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:55.064+0000 7ff8e0646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:55.425 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:24:55.425 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:24:55.447 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":233,"stamp":"2024-09-15T12:24:53.776210+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":374932043,"num_objects":5717,"num_object_clones":0,"num_object_copies":17151,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":30856,"num_write_kb":1168661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30830,"ondisk_log_size":30830,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":355460,"kb_used_data":70464,"kb_used_omap":0,"kb_used_meta":284928,"kb_avail":377131900,"statfs":{"total":386547056640,"available":386183065600,"internally_reserved":0,"allocated":72155136,"data_stored":1124730377,"data_compressed":53383096,"data_compressed_allocated":70266880,"data_compressed_original":1124024320,"omap_allocated":0,"internal_metadata":291766272},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-21299200,"num_objects":-325,"num_object_clones":0,"num_object_copies":-975,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":325,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002332"},"pg_stats":[{"pgid":"4.f","version":"54'1958","reported_seq":2030,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.622315+0000","last_change":"2024-09-15T12:22:00.377854+0000","last_active":"2024-09-15T12:24:40.622315+0000","last_peered":"2024-09-15T12:24:40.622315+0000","last_clean":"2024-09-15T12:24:40.622315+0000","last_became_active":"2024-09-15T12:22:00.359790+0000","last_became_peered":"2024-09-15T12:22:00.359790+0000","last_unstale":"2024-09-15T12:24:40.622315+0000","last_undegraded":"2024-09-15T12:24:40.622315+0000","last_fullsized":"2024-09-15T12:24:40.622315+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1958,"log_dups_size":0,"ondisk_log_size":1958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24379392,"num_objects":372,"num_object_clones":0,"num_object_copies":1116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1958,"num_write_kb":74560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"54'1934","reported_seq":2006,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.604805+0000","last_change":"2024-09-15T12:22:00.383291+0000","last_active":"2024-09-15T12:24:40.604805+0000","last_peered":"2024-09-15T12:24:40.604805+0000","last_clean":"2024-09-15T12:24:40.604805+0000","last_became_active":"2024-09-15T12:22:00.376330+0000","last_became_peered":"2024-09-15T12:22:00.376330+0000","last_unstale":"2024-09-15T12:24:40.604805+0000","last_undegraded":"2024-09-15T12:24:40.604805+0000","last_fullsized":"2024-09-15T12:24:40.604805+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1934,"log_dups_size":0,"ondisk_log_size":1934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23592960,"num_objects":360,"num_object_clones":0,"num_object_copies":1080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1934,"num_write_kb":73408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"54'2004","reported_seq":2077,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.542490+0000","last_change":"2024-09-15T12:22:00.413467+0000","last_active":"2024-09-15T12:24:40.542490+0000","last_peered":"2024-09-15T12:24:40.542490+0000","last_clean":"2024-09-15T12:24:40.542490+0000","last_became_active":"2024-09-15T12:22:00.399293+0000","last_became_peered":"2024-09-15T12:22:00.399293+0000","last_unstale":"2024-09-15T12:24:40.542490+0000","last_undegraded":"2024-09-15T12:24:40.542490+0000","last_fullsized":"2024-09-15T12:24:40.542490+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":2004,"log_dups_size":0,"ondisk_log_size":2004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24182808,"num_objects":370,"num_object_clones":0,"num_object_copies":1110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2004,"num_write_kb":75905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"54'1912","reported_seq":1984,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:41.761425+0000","last_change":"2024-09-15T12:22:00.397700+0000","last_active":"2024-09-15T12:24:41.761425+0000","last_peered":"2024-09-15T12:24:41.761425+0000","last_clean":"2024-09-15T12:24:41.761425+0000","last_became_active":"2024-09-15T12:22:00.388314+0000","last_became_peered":"2024-09-15T12:22:00.388314+0000","last_unstale":"2024-09-15T12:24:41.761425+0000","last_undegraded":"2024-09-15T12:24:41.761425+0000","last_fullsized":"2024-09-15T12:24:41.761425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1912,"log_dups_size":0,"ondisk_log_size":1912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19922944,"num_objects":304,"num_object_clones":0,"num_object_copies":912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1912,"num_write_kb":70912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"54'1783","reported_seq":1855,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.330670+0000","last_change":"2024-09-15T12:22:00.418610+0000","last_active":"2024-09-15T12:24:40.330670+0000","last_peered":"2024-09-15T12:24:40.330670+0000","last_clean":"2024-09-15T12:24:40.330670+0000","last_became_active":"2024-09-15T12:22:00.404352+0000","last_became_peered":"2024-09-15T12:22:00.404352+0000","last_unstale":"2024-09-15T12:24:40.330670+0000","last_undegraded":"2024-09-15T12:24:40.330670+0000","last_fullsized":"2024-09-15T12:24:40.330670+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1783,"log_dups_size":0,"ondisk_log_size":1783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23527424,"num_objects":359,"num_object_clones":0,"num_object_copies":1077,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1783,"num_write_kb":68544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"54'1908","reported_seq":1980,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.616861+0000","last_change":"2024-09-15T12:22:00.408893+0000","last_active":"2024-09-15T12:24:40.616861+0000","last_peered":"2024-09-15T12:24:40.616861+0000","last_clean":"2024-09-15T12:24:40.616861+0000","last_became_active":"2024-09-15T12:22:00.399557+0000","last_became_peered":"2024-09-15T12:22:00.399557+0000","last_unstale":"2024-09-15T12:24:40.616861+0000","last_undegraded":"2024-09-15T12:24:40.616861+0000","last_fullsized":"2024-09-15T12:24:40.616861+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1908,"log_dups_size":0,"ondisk_log_size":1908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24248320,"num_objects":370,"num_object_clones":0,"num_object_copies":1110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1908,"num_write_kb":72896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"54'1984","reported_seq":2056,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.694109+0000","last_change":"2024-09-15T12:22:00.458263+0000","last_active":"2024-09-15T12:24:40.694109+0000","last_peered":"2024-09-15T12:24:40.694109+0000","last_clean":"2024-09-15T12:24:40.694109+0000","last_became_active":"2024-09-15T12:22:00.446629+0000","last_became_peered":"2024-09-15T12:22:00.446629+0000","last_unstale":"2024-09-15T12:24:40.694109+0000","last_undegraded":"2024-09-15T12:24:40.694109+0000","last_fullsized":"2024-09-15T12:24:40.694109+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1984,"log_dups_size":0,"ondisk_log_size":1984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22544384,"num_objects":344,"num_object_clones":0,"num_object_copies":1032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1984,"num_write_kb":74496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"54'1975","reported_seq":2047,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.696784+0000","last_change":"2024-09-15T12:22:00.432607+0000","last_active":"2024-09-15T12:24:40.696784+0000","last_peered":"2024-09-15T12:24:40.696784+0000","last_clean":"2024-09-15T12:24:40.696784+0000","last_became_active":"2024-09-15T12:22:00.422177+0000","last_became_peered":"2024-09-15T12:22:00.422177+0000","last_unstale":"2024-09-15T12:24:40.696784+0000","last_undegraded":"2024-09-15T12:24:40.696784+0000","last_fullsized":"2024-09-15T12:24:40.696784+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1975,"log_dups_size":0,"ondisk_log_size":1975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22478848,"num_objects":343,"num_object_clones":0,"num_object_copies":1029,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1975,"num_write_kb":74176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"54'1844","reported_seq":1916,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.506164+0000","last_change":"2024-09-15T12:22:00.420197+0000","last_active":"2024-09-15T12:24:40.506164+0000","last_peered":"2024-09-15T12:24:40.506164+0000","last_clean":"2024-09-15T12:24:40.506164+0000","last_became_active":"2024-09-15T12:22:00.406666+0000","last_became_peered":"2024-09-15T12:22:00.406666+0000","last_unstale":"2024-09-15T12:24:40.506164+0000","last_undegraded":"2024-09-15T12:24:40.506164+0000","last_fullsized":"2024-09-15T12:24:40.506164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1844,"log_dups_size":0,"ondisk_log_size":1844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21102592,"num_objects":322,"num_object_clones":0,"num_object_copies":966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1844,"num_write_kb":69312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.262544+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:24:24.262544+0000","last_peered":"2024-09-15T12:24:24.262544+0000","last_clean":"2024-09-15T12:24:24.262544+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:24:24.262544+0000","last_undegraded":"2024-09-15T12:24:24.262544+0000","last_fullsized":"2024-09-15T12:24:24.262544+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":134,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.293215+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:24:24.293215+0000","last_peered":"2024-09-15T12:24:24.293215+0000","last_clean":"2024-09-15T12:24:24.293215+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:24:24.293215+0000","last_undegraded":"2024-09-15T12:24:24.293215+0000","last_fullsized":"2024-09-15T12:24:24.293215+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"54'1934","reported_seq":2006,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.738950+0000","last_change":"2024-09-15T12:22:00.381165+0000","last_active":"2024-09-15T12:24:40.738950+0000","last_peered":"2024-09-15T12:24:40.738950+0000","last_clean":"2024-09-15T12:24:40.738950+0000","last_became_active":"2024-09-15T12:22:00.374145+0000","last_became_peered":"2024-09-15T12:22:00.374145+0000","last_unstale":"2024-09-15T12:24:40.738950+0000","last_undegraded":"2024-09-15T12:24:40.738950+0000","last_fullsized":"2024-09-15T12:24:40.738950+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1934,"log_dups_size":0,"ondisk_log_size":1934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22020096,"num_objects":336,"num_object_clones":0,"num_object_copies":1008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1934,"num_write_kb":72640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.331270+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:24:24.331270+0000","last_peered":"2024-09-15T12:24:24.331270+0000","last_clean":"2024-09-15T12:24:24.331270+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:24:24.331270+0000","last_undegraded":"2024-09-15T12:24:24.331270+0000","last_fullsized":"2024-09-15T12:24:24.331270+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"54'1877","reported_seq":1949,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.682498+0000","last_change":"2024-09-15T12:22:00.405131+0000","last_active":"2024-09-15T12:24:40.682498+0000","last_peered":"2024-09-15T12:24:40.682498+0000","last_clean":"2024-09-15T12:24:40.682498+0000","last_became_active":"2024-09-15T12:22:00.398288+0000","last_became_peered":"2024-09-15T12:22:00.398288+0000","last_unstale":"2024-09-15T12:24:40.682498+0000","last_undegraded":"2024-09-15T12:24:40.682498+0000","last_fullsized":"2024-09-15T12:24:40.682498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1877,"log_dups_size":0,"ondisk_log_size":1877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23920640,"num_objects":365,"num_object_clones":0,"num_object_copies":1095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1877,"num_write_kb":71744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.284255+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:24:24.284255+0000","last_peered":"2024-09-15T12:24:24.284255+0000","last_clean":"2024-09-15T12:24:24.284255+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:24:24.284255+0000","last_undegraded":"2024-09-15T12:24:24.284255+0000","last_fullsized":"2024-09-15T12:24:24.284255+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"54'1977","reported_seq":2049,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.711584+0000","last_change":"2024-09-15T12:22:00.390143+0000","last_active":"2024-09-15T12:24:40.711584+0000","last_peered":"2024-09-15T12:24:40.711584+0000","last_clean":"2024-09-15T12:24:40.711584+0000","last_became_active":"2024-09-15T12:22:00.370049+0000","last_became_peered":"2024-09-15T12:22:00.370049+0000","last_unstale":"2024-09-15T12:24:40.711584+0000","last_undegraded":"2024-09-15T12:24:40.711584+0000","last_fullsized":"2024-09-15T12:24:40.711584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1977,"log_dups_size":0,"ondisk_log_size":1977,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24444928,"num_objects":373,"num_object_clones":0,"num_object_copies":1119,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1977,"num_write_kb":75200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.297184+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:24:24.297184+0000","last_peered":"2024-09-15T12:24:24.297184+0000","last_clean":"2024-09-15T12:24:24.297184+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:24:24.297184+0000","last_undegraded":"2024-09-15T12:24:24.297184+0000","last_fullsized":"2024-09-15T12:24:24.297184+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"54'1882","reported_seq":1954,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.516472+0000","last_change":"2024-09-15T12:22:00.450159+0000","last_active":"2024-09-15T12:24:40.516472+0000","last_peered":"2024-09-15T12:24:40.516472+0000","last_clean":"2024-09-15T12:24:40.516472+0000","last_became_active":"2024-09-15T12:22:00.437056+0000","last_became_peered":"2024-09-15T12:22:00.437056+0000","last_unstale":"2024-09-15T12:24:40.516472+0000","last_undegraded":"2024-09-15T12:24:40.516472+0000","last_fullsized":"2024-09-15T12:24:40.516472+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1882,"log_dups_size":0,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24117248,"num_objects":368,"num_object_clones":0,"num_object_copies":1104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1882,"num_write_kb":72000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.287155+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:24:24.287155+0000","last_peered":"2024-09-15T12:24:24.287155+0000","last_clean":"2024-09-15T12:24:24.287155+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:24:24.287155+0000","last_undegraded":"2024-09-15T12:24:24.287155+0000","last_fullsized":"2024-09-15T12:24:24.287155+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"54'1882","reported_seq":1954,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.752122+0000","last_change":"2024-09-15T12:22:00.364579+0000","last_active":"2024-09-15T12:24:40.752122+0000","last_peered":"2024-09-15T12:24:40.752122+0000","last_clean":"2024-09-15T12:24:40.752122+0000","last_became_active":"2024-09-15T12:22:00.353614+0000","last_became_peered":"2024-09-15T12:22:00.353614+0000","last_unstale":"2024-09-15T12:24:40.752122+0000","last_undegraded":"2024-09-15T12:24:40.752122+0000","last_fullsized":"2024-09-15T12:24:40.752122+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1882,"log_dups_size":0,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25296896,"num_objects":386,"num_object_clones":0,"num_object_copies":1158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1882,"num_write_kb":72576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.294001+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:24:24.294001+0000","last_peered":"2024-09-15T12:24:24.294001+0000","last_clean":"2024-09-15T12:24:24.294001+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:24:24.294001+0000","last_undegraded":"2024-09-15T12:24:24.294001+0000","last_fullsized":"2024-09-15T12:24:24.294001+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"54'1962","reported_seq":2034,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.687303+0000","last_change":"2024-09-15T12:22:00.384094+0000","last_active":"2024-09-15T12:24:40.687303+0000","last_peered":"2024-09-15T12:24:40.687303+0000","last_clean":"2024-09-15T12:24:40.687303+0000","last_became_active":"2024-09-15T12:22:00.377789+0000","last_became_peered":"2024-09-15T12:22:00.377789+0000","last_unstale":"2024-09-15T12:24:40.687303+0000","last_undegraded":"2024-09-15T12:24:40.687303+0000","last_fullsized":"2024-09-15T12:24:40.687303+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1962,"log_dups_size":0,"ondisk_log_size":1962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24379392,"num_objects":372,"num_object_clones":0,"num_object_copies":1116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1962,"num_write_kb":74688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.269819+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:24:24.269819+0000","last_peered":"2024-09-15T12:24:24.269819+0000","last_clean":"2024-09-15T12:24:24.269819+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:24:24.269819+0000","last_undegraded":"2024-09-15T12:24:24.269819+0000","last_fullsized":"2024-09-15T12:24:24.269819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"54'1959","reported_seq":2031,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.555019+0000","last_change":"2024-09-15T12:22:00.394121+0000","last_active":"2024-09-15T12:24:40.555019+0000","last_peered":"2024-09-15T12:24:40.555019+0000","last_clean":"2024-09-15T12:24:40.555019+0000","last_became_active":"2024-09-15T12:22:00.388183+0000","last_became_peered":"2024-09-15T12:22:00.388183+0000","last_unstale":"2024-09-15T12:24:40.555019+0000","last_undegraded":"2024-09-15T12:24:40.555019+0000","last_fullsized":"2024-09-15T12:24:40.555019+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1959,"log_dups_size":0,"ondisk_log_size":1959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24182784,"num_objects":369,"num_object_clones":0,"num_object_copies":1107,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1959,"num_write_kb":74496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.335125+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:24:24.335125+0000","last_peered":"2024-09-15T12:24:24.335125+0000","last_clean":"2024-09-15T12:24:24.335125+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:24:24.335125+0000","last_undegraded":"2024-09-15T12:24:24.335125+0000","last_fullsized":"2024-09-15T12:24:24.335125+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":374341656,"num_objects":5713,"num_object_clones":0,"num_object_copies":17139,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":30775,"num_write_kb":1167553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":69754880,"data_stored":1115881544,"data_compressed":52988024,"data_compressed_allocated":69742592,"data_compressed_original":1115881472,"omap_allocated":0,"internal_metadata":0},"log_size":30775,"ondisk_log_size":30775,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673319,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":89692,"kb_used_data":18444,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94282148,"statfs":{"total":96636764160,"available":96544919552,"internally_reserved":0,"allocated":18886656,"data_stored":294748650,"data_compressed":13990464,"data_compressed_allocated":18415616,"data_compressed_original":294567936,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":90672,"kb_used_data":15264,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94281168,"statfs":{"total":96636764160,"available":96543916032,"internally_reserved":0,"allocated":15630336,"data_stored":242516501,"data_compressed":11510200,"data_compressed_allocated":15151104,"data_compressed_original":242335744,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86236,"kb_used_data":19144,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94285604,"statfs":{"total":96636764160,"available":96548458496,"internally_reserved":0,"allocated":19603456,"data_stored":306479093,"data_compressed":14545488,"data_compressed_allocated":19144704,"data_compressed_original":306315264,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":88860,"kb_used_data":17612,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94282980,"statfs":{"total":96636764160,"available":96545771520,"internally_reserved":0,"allocated":18034688,"data_stored":280986133,"data_compressed":13336944,"data_compressed_allocated":17555456,"data_compressed_original":280805376,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17420288,"data_stored":278659096,"data_compressed":13232224,"data_compressed_allocated":17416192,"data_compressed_original":278659072,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19054592,"data_stored":304807960,"data_compressed":14473912,"data_compressed_allocated":19050496,"data_compressed_original":304807936,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14999552,"data_stored":239927320,"data_compressed":11393032,"data_compressed_allocated":14995456,"data_compressed_original":239927296,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18280448,"data_stored":292487168,"data_compressed":13888856,"data_compressed_allocated":18280448,"data_compressed_original":292487168,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:24:57.909 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:24:58.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:58.067+0000 7f31aaf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:24:58.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:24:58.078+0000 7f31aaf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:00.449 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:25:00.449 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:25:00.449 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:25:00.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:00.596+0000 7f867eafd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:00.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:00.611+0000 7f867eafd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:00.734 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:25:00.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:00.891+0000 7f6908111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:00.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:00.904+0000 7f6908111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:00.923 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:25:00.923 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:25:00.941 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2024-09-15T12:24:59.777278+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":374932043,"num_objects":5717,"num_object_clones":0,"num_object_copies":17151,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":30856,"num_write_kb":1168661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30830,"ondisk_log_size":30830,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":355460,"kb_used_data":70464,"kb_used_omap":0,"kb_used_meta":284928,"kb_avail":377131900,"statfs":{"total":386547056640,"available":386183065600,"internally_reserved":0,"allocated":72155136,"data_stored":1124730377,"data_compressed":53383096,"data_compressed_allocated":70266880,"data_compressed_original":1124024320,"omap_allocated":0,"internal_metadata":291766272},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002108"},"pg_stats":[{"pgid":"4.f","version":"54'1958","reported_seq":2030,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.622315+0000","last_change":"2024-09-15T12:22:00.377854+0000","last_active":"2024-09-15T12:24:40.622315+0000","last_peered":"2024-09-15T12:24:40.622315+0000","last_clean":"2024-09-15T12:24:40.622315+0000","last_became_active":"2024-09-15T12:22:00.359790+0000","last_became_peered":"2024-09-15T12:22:00.359790+0000","last_unstale":"2024-09-15T12:24:40.622315+0000","last_undegraded":"2024-09-15T12:24:40.622315+0000","last_fullsized":"2024-09-15T12:24:40.622315+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1958,"log_dups_size":0,"ondisk_log_size":1958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24379392,"num_objects":372,"num_object_clones":0,"num_object_copies":1116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1958,"num_write_kb":74560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"54'1934","reported_seq":2006,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.604805+0000","last_change":"2024-09-15T12:22:00.383291+0000","last_active":"2024-09-15T12:24:40.604805+0000","last_peered":"2024-09-15T12:24:40.604805+0000","last_clean":"2024-09-15T12:24:40.604805+0000","last_became_active":"2024-09-15T12:22:00.376330+0000","last_became_peered":"2024-09-15T12:22:00.376330+0000","last_unstale":"2024-09-15T12:24:40.604805+0000","last_undegraded":"2024-09-15T12:24:40.604805+0000","last_fullsized":"2024-09-15T12:24:40.604805+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1934,"log_dups_size":0,"ondisk_log_size":1934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23592960,"num_objects":360,"num_object_clones":0,"num_object_copies":1080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1934,"num_write_kb":73408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"54'2004","reported_seq":2077,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.542490+0000","last_change":"2024-09-15T12:22:00.413467+0000","last_active":"2024-09-15T12:24:40.542490+0000","last_peered":"2024-09-15T12:24:40.542490+0000","last_clean":"2024-09-15T12:24:40.542490+0000","last_became_active":"2024-09-15T12:22:00.399293+0000","last_became_peered":"2024-09-15T12:22:00.399293+0000","last_unstale":"2024-09-15T12:24:40.542490+0000","last_undegraded":"2024-09-15T12:24:40.542490+0000","last_fullsized":"2024-09-15T12:24:40.542490+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":2004,"log_dups_size":0,"ondisk_log_size":2004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24182808,"num_objects":370,"num_object_clones":0,"num_object_copies":1110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2004,"num_write_kb":75905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"54'1912","reported_seq":1984,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:41.761425+0000","last_change":"2024-09-15T12:22:00.397700+0000","last_active":"2024-09-15T12:24:41.761425+0000","last_peered":"2024-09-15T12:24:41.761425+0000","last_clean":"2024-09-15T12:24:41.761425+0000","last_became_active":"2024-09-15T12:22:00.388314+0000","last_became_peered":"2024-09-15T12:22:00.388314+0000","last_unstale":"2024-09-15T12:24:41.761425+0000","last_undegraded":"2024-09-15T12:24:41.761425+0000","last_fullsized":"2024-09-15T12:24:41.761425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1912,"log_dups_size":0,"ondisk_log_size":1912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19922944,"num_objects":304,"num_object_clones":0,"num_object_copies":912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1912,"num_write_kb":70912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"54'1783","reported_seq":1855,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.330670+0000","last_change":"2024-09-15T12:22:00.418610+0000","last_active":"2024-09-15T12:24:40.330670+0000","last_peered":"2024-09-15T12:24:40.330670+0000","last_clean":"2024-09-15T12:24:40.330670+0000","last_became_active":"2024-09-15T12:22:00.404352+0000","last_became_peered":"2024-09-15T12:22:00.404352+0000","last_unstale":"2024-09-15T12:24:40.330670+0000","last_undegraded":"2024-09-15T12:24:40.330670+0000","last_fullsized":"2024-09-15T12:24:40.330670+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1783,"log_dups_size":0,"ondisk_log_size":1783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23527424,"num_objects":359,"num_object_clones":0,"num_object_copies":1077,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1783,"num_write_kb":68544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"54'1908","reported_seq":1980,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.616861+0000","last_change":"2024-09-15T12:22:00.408893+0000","last_active":"2024-09-15T12:24:40.616861+0000","last_peered":"2024-09-15T12:24:40.616861+0000","last_clean":"2024-09-15T12:24:40.616861+0000","last_became_active":"2024-09-15T12:22:00.399557+0000","last_became_peered":"2024-09-15T12:22:00.399557+0000","last_unstale":"2024-09-15T12:24:40.616861+0000","last_undegraded":"2024-09-15T12:24:40.616861+0000","last_fullsized":"2024-09-15T12:24:40.616861+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1908,"log_dups_size":0,"ondisk_log_size":1908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24248320,"num_objects":370,"num_object_clones":0,"num_object_copies":1110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1908,"num_write_kb":72896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"54'1984","reported_seq":2056,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.694109+0000","last_change":"2024-09-15T12:22:00.458263+0000","last_active":"2024-09-15T12:24:40.694109+0000","last_peered":"2024-09-15T12:24:40.694109+0000","last_clean":"2024-09-15T12:24:40.694109+0000","last_became_active":"2024-09-15T12:22:00.446629+0000","last_became_peered":"2024-09-15T12:22:00.446629+0000","last_unstale":"2024-09-15T12:24:40.694109+0000","last_undegraded":"2024-09-15T12:24:40.694109+0000","last_fullsized":"2024-09-15T12:24:40.694109+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1984,"log_dups_size":0,"ondisk_log_size":1984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22544384,"num_objects":344,"num_object_clones":0,"num_object_copies":1032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1984,"num_write_kb":74496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"54'1975","reported_seq":2047,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.696784+0000","last_change":"2024-09-15T12:22:00.432607+0000","last_active":"2024-09-15T12:24:40.696784+0000","last_peered":"2024-09-15T12:24:40.696784+0000","last_clean":"2024-09-15T12:24:40.696784+0000","last_became_active":"2024-09-15T12:22:00.422177+0000","last_became_peered":"2024-09-15T12:22:00.422177+0000","last_unstale":"2024-09-15T12:24:40.696784+0000","last_undegraded":"2024-09-15T12:24:40.696784+0000","last_fullsized":"2024-09-15T12:24:40.696784+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1975,"log_dups_size":0,"ondisk_log_size":1975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22478848,"num_objects":343,"num_object_clones":0,"num_object_copies":1029,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1975,"num_write_kb":74176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"54'1844","reported_seq":1916,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.506164+0000","last_change":"2024-09-15T12:22:00.420197+0000","last_active":"2024-09-15T12:24:40.506164+0000","last_peered":"2024-09-15T12:24:40.506164+0000","last_clean":"2024-09-15T12:24:40.506164+0000","last_became_active":"2024-09-15T12:22:00.406666+0000","last_became_peered":"2024-09-15T12:22:00.406666+0000","last_unstale":"2024-09-15T12:24:40.506164+0000","last_undegraded":"2024-09-15T12:24:40.506164+0000","last_fullsized":"2024-09-15T12:24:40.506164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1844,"log_dups_size":0,"ondisk_log_size":1844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21102592,"num_objects":322,"num_object_clones":0,"num_object_copies":966,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1844,"num_write_kb":69312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.262544+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:24:24.262544+0000","last_peered":"2024-09-15T12:24:24.262544+0000","last_clean":"2024-09-15T12:24:24.262544+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:24:24.262544+0000","last_undegraded":"2024-09-15T12:24:24.262544+0000","last_fullsized":"2024-09-15T12:24:24.262544+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":134,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.293215+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:24:24.293215+0000","last_peered":"2024-09-15T12:24:24.293215+0000","last_clean":"2024-09-15T12:24:24.293215+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:24:24.293215+0000","last_undegraded":"2024-09-15T12:24:24.293215+0000","last_fullsized":"2024-09-15T12:24:24.293215+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"54'1934","reported_seq":2006,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.738950+0000","last_change":"2024-09-15T12:22:00.381165+0000","last_active":"2024-09-15T12:24:40.738950+0000","last_peered":"2024-09-15T12:24:40.738950+0000","last_clean":"2024-09-15T12:24:40.738950+0000","last_became_active":"2024-09-15T12:22:00.374145+0000","last_became_peered":"2024-09-15T12:22:00.374145+0000","last_unstale":"2024-09-15T12:24:40.738950+0000","last_undegraded":"2024-09-15T12:24:40.738950+0000","last_fullsized":"2024-09-15T12:24:40.738950+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1934,"log_dups_size":0,"ondisk_log_size":1934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22020096,"num_objects":336,"num_object_clones":0,"num_object_copies":1008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1934,"num_write_kb":72640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.331270+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:24:24.331270+0000","last_peered":"2024-09-15T12:24:24.331270+0000","last_clean":"2024-09-15T12:24:24.331270+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:24:24.331270+0000","last_undegraded":"2024-09-15T12:24:24.331270+0000","last_fullsized":"2024-09-15T12:24:24.331270+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"54'1877","reported_seq":1949,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.682498+0000","last_change":"2024-09-15T12:22:00.405131+0000","last_active":"2024-09-15T12:24:40.682498+0000","last_peered":"2024-09-15T12:24:40.682498+0000","last_clean":"2024-09-15T12:24:40.682498+0000","last_became_active":"2024-09-15T12:22:00.398288+0000","last_became_peered":"2024-09-15T12:22:00.398288+0000","last_unstale":"2024-09-15T12:24:40.682498+0000","last_undegraded":"2024-09-15T12:24:40.682498+0000","last_fullsized":"2024-09-15T12:24:40.682498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1877,"log_dups_size":0,"ondisk_log_size":1877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23920640,"num_objects":365,"num_object_clones":0,"num_object_copies":1095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1877,"num_write_kb":71744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.284255+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:24:24.284255+0000","last_peered":"2024-09-15T12:24:24.284255+0000","last_clean":"2024-09-15T12:24:24.284255+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:24:24.284255+0000","last_undegraded":"2024-09-15T12:24:24.284255+0000","last_fullsized":"2024-09-15T12:24:24.284255+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"54'1977","reported_seq":2049,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.711584+0000","last_change":"2024-09-15T12:22:00.390143+0000","last_active":"2024-09-15T12:24:40.711584+0000","last_peered":"2024-09-15T12:24:40.711584+0000","last_clean":"2024-09-15T12:24:40.711584+0000","last_became_active":"2024-09-15T12:22:00.370049+0000","last_became_peered":"2024-09-15T12:22:00.370049+0000","last_unstale":"2024-09-15T12:24:40.711584+0000","last_undegraded":"2024-09-15T12:24:40.711584+0000","last_fullsized":"2024-09-15T12:24:40.711584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1977,"log_dups_size":0,"ondisk_log_size":1977,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24444928,"num_objects":373,"num_object_clones":0,"num_object_copies":1119,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1977,"num_write_kb":75200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.297184+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:24:24.297184+0000","last_peered":"2024-09-15T12:24:24.297184+0000","last_clean":"2024-09-15T12:24:24.297184+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:24:24.297184+0000","last_undegraded":"2024-09-15T12:24:24.297184+0000","last_fullsized":"2024-09-15T12:24:24.297184+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"54'1882","reported_seq":1954,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.516472+0000","last_change":"2024-09-15T12:22:00.450159+0000","last_active":"2024-09-15T12:24:40.516472+0000","last_peered":"2024-09-15T12:24:40.516472+0000","last_clean":"2024-09-15T12:24:40.516472+0000","last_became_active":"2024-09-15T12:22:00.437056+0000","last_became_peered":"2024-09-15T12:22:00.437056+0000","last_unstale":"2024-09-15T12:24:40.516472+0000","last_undegraded":"2024-09-15T12:24:40.516472+0000","last_fullsized":"2024-09-15T12:24:40.516472+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1882,"log_dups_size":0,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24117248,"num_objects":368,"num_object_clones":0,"num_object_copies":1104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1882,"num_write_kb":72000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.287155+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:24:24.287155+0000","last_peered":"2024-09-15T12:24:24.287155+0000","last_clean":"2024-09-15T12:24:24.287155+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:24:24.287155+0000","last_undegraded":"2024-09-15T12:24:24.287155+0000","last_fullsized":"2024-09-15T12:24:24.287155+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"54'1882","reported_seq":1954,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.752122+0000","last_change":"2024-09-15T12:22:00.364579+0000","last_active":"2024-09-15T12:24:40.752122+0000","last_peered":"2024-09-15T12:24:40.752122+0000","last_clean":"2024-09-15T12:24:40.752122+0000","last_became_active":"2024-09-15T12:22:00.353614+0000","last_became_peered":"2024-09-15T12:22:00.353614+0000","last_unstale":"2024-09-15T12:24:40.752122+0000","last_undegraded":"2024-09-15T12:24:40.752122+0000","last_fullsized":"2024-09-15T12:24:40.752122+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1882,"log_dups_size":0,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25296896,"num_objects":386,"num_object_clones":0,"num_object_copies":1158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1882,"num_write_kb":72576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.294001+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:24:24.294001+0000","last_peered":"2024-09-15T12:24:24.294001+0000","last_clean":"2024-09-15T12:24:24.294001+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:24:24.294001+0000","last_undegraded":"2024-09-15T12:24:24.294001+0000","last_fullsized":"2024-09-15T12:24:24.294001+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"54'1962","reported_seq":2034,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.687303+0000","last_change":"2024-09-15T12:22:00.384094+0000","last_active":"2024-09-15T12:24:40.687303+0000","last_peered":"2024-09-15T12:24:40.687303+0000","last_clean":"2024-09-15T12:24:40.687303+0000","last_became_active":"2024-09-15T12:22:00.377789+0000","last_became_peered":"2024-09-15T12:22:00.377789+0000","last_unstale":"2024-09-15T12:24:40.687303+0000","last_undegraded":"2024-09-15T12:24:40.687303+0000","last_fullsized":"2024-09-15T12:24:40.687303+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1962,"log_dups_size":0,"ondisk_log_size":1962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24379392,"num_objects":372,"num_object_clones":0,"num_object_copies":1116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1962,"num_write_kb":74688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.269819+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:24:24.269819+0000","last_peered":"2024-09-15T12:24:24.269819+0000","last_clean":"2024-09-15T12:24:24.269819+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:24:24.269819+0000","last_undegraded":"2024-09-15T12:24:24.269819+0000","last_fullsized":"2024-09-15T12:24:24.269819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"54'1959","reported_seq":2031,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:40.555019+0000","last_change":"2024-09-15T12:22:00.394121+0000","last_active":"2024-09-15T12:24:40.555019+0000","last_peered":"2024-09-15T12:24:40.555019+0000","last_clean":"2024-09-15T12:24:40.555019+0000","last_became_active":"2024-09-15T12:22:00.388183+0000","last_became_peered":"2024-09-15T12:22:00.388183+0000","last_unstale":"2024-09-15T12:24:40.555019+0000","last_undegraded":"2024-09-15T12:24:40.555019+0000","last_fullsized":"2024-09-15T12:24:40.555019+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1959,"log_dups_size":0,"ondisk_log_size":1959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24182784,"num_objects":369,"num_object_clones":0,"num_object_copies":1107,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1959,"num_write_kb":74496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.335125+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:24:24.335125+0000","last_peered":"2024-09-15T12:24:24.335125+0000","last_clean":"2024-09-15T12:24:24.335125+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:24:24.335125+0000","last_undegraded":"2024-09-15T12:24:24.335125+0000","last_fullsized":"2024-09-15T12:24:24.335125+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":374341656,"num_objects":5713,"num_object_clones":0,"num_object_copies":17139,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":30775,"num_write_kb":1167553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":69754880,"data_stored":1115881544,"data_compressed":52988024,"data_compressed_allocated":69742592,"data_compressed_original":1115881472,"omap_allocated":0,"internal_metadata":0},"log_size":30775,"ondisk_log_size":30775,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673319,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":89692,"kb_used_data":18444,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94282148,"statfs":{"total":96636764160,"available":96544919552,"internally_reserved":0,"allocated":18886656,"data_stored":294748650,"data_compressed":13990464,"data_compressed_allocated":18415616,"data_compressed_original":294567936,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":90672,"kb_used_data":15264,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94281168,"statfs":{"total":96636764160,"available":96543916032,"internally_reserved":0,"allocated":15630336,"data_stored":242516501,"data_compressed":11510200,"data_compressed_allocated":15151104,"data_compressed_original":242335744,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86236,"kb_used_data":19144,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94285604,"statfs":{"total":96636764160,"available":96548458496,"internally_reserved":0,"allocated":19603456,"data_stored":306479093,"data_compressed":14545488,"data_compressed_allocated":19144704,"data_compressed_original":306315264,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706023,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":88860,"kb_used_data":17612,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94282980,"statfs":{"total":96636764160,"available":96545771520,"internally_reserved":0,"allocated":18034688,"data_stored":280986133,"data_compressed":13336944,"data_compressed_allocated":17555456,"data_compressed_original":280805376,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17420288,"data_stored":278659096,"data_compressed":13232224,"data_compressed_allocated":17416192,"data_compressed_original":278659072,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":19054592,"data_stored":304807960,"data_compressed":14473912,"data_compressed_allocated":19050496,"data_compressed_original":304807936,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14999552,"data_stored":239927320,"data_compressed":11393032,"data_compressed_allocated":14995456,"data_compressed_original":239927296,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18280448,"data_stored":292487168,"data_compressed":13888856,"data_compressed_allocated":18280448,"data_compressed_original":292487168,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:25:03.269 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:25:03.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:03.415+0000 7f828464f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:03.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:03.428+0000 7f828464f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:05.934 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:25:05.943 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:25:05.943 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:25:05.943 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:25:05.943 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:25:06.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:06.086+0000 7f6cb1591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:06.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:06.095+0000 7f6cb1591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:06.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:06.158+0000 7fd5ee551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:06.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:06.176+0000 7fd5ee551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:06.510 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:25:06.510 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:25:06.510 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:25:06.511 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:25:06.511 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:25:06.511 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:25:06.511 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:25:06.511 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:25:06.511 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:25:06.511 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:25:06.511 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:25:06.511 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:25:06.515 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:25:06.515 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:25:06.515 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:25:06.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:06.686+0000 7fa1aa711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:06.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:06.704+0000 7fa1aa711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:07.054 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:25:07.054 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:25:07.054 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:25:07.054 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:25:07.054 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:25:07.054 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:25:07.054 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:25:07.054 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:25:07.054 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:25:07.054 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:25:07.054 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:25:07.054 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:25:07.058 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:25:07.058 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:25:07.058 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:25:07.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:07.208+0000 7feb48b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:07.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:07.228+0000 7feb48b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:07.308 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:25:07.308 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:25:07.308 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:25:07.308 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:25:07.309 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:25:07.309 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:25:07.309 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:25:07.309 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:25:07.309 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:25:07.309 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:25:07.309 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:25:07.309 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:25:07.314 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:25:07.314 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:25:07.314 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:25:07.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:07.461+0000 7fc141d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:07.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:07.474+0000 7fc141d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:07.494 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:25:07.494 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:25:07.494 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:25:07.494 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:25:07.494 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:25:07.494 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:25:07.494 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:25:07.494 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:25:07.494 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:25:07.495 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:25:07.495 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:25:07.495 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:25:07.497 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:25:07.498 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:25:08.812 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:25:08.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:08.943+0000 7f26a564f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:08.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:08.951+0000 7f26a564f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:11.397 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:25:11.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:11.545+0000 7f8fd38fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:11.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:11.552+0000 7f8fd38fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:12.498 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:25:12.498 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:25:12.499 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:25:12.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:12.657+0000 7ff320ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:12.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:12.668+0000 7ff320ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:12.965 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:25:12.965 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:25:12.987 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":242,"stamp":"2024-09-15T12:25:11.779392+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":71893579,"num_objects":1093,"num_object_clones":0,"num_object_copies":3279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":35480,"num_write_kb":1168661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35454,"ondisk_log_size":35454,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":308248,"kb_used_data":27416,"kb_used_omap":0,"kb_used_meta":280768,"kb_avail":377179112,"statfs":{"total":386547056640,"available":386231410688,"internally_reserved":0,"allocated":28073984,"data_stored":419431945,"data_compressed":19891752,"data_compressed_allocated":26185728,"data_compressed_original":418725888,"omap_allocated":0,"internal_metadata":287506432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-303038464,"num_objects":-4624,"num_object_clones":0,"num_object_copies":-13872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4624,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002114"},"pg_stats":[{"pgid":"4.f","version":"54'2277","reported_seq":2349,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:25:10.465807+0000","last_change":"2024-09-15T12:22:00.377854+0000","last_active":"2024-09-15T12:25:10.465807+0000","last_peered":"2024-09-15T12:25:10.465807+0000","last_clean":"2024-09-15T12:25:10.465807+0000","last_became_active":"2024-09-15T12:22:00.359790+0000","last_became_peered":"2024-09-15T12:22:00.359790+0000","last_unstale":"2024-09-15T12:25:10.465807+0000","last_undegraded":"2024-09-15T12:25:10.465807+0000","last_fullsized":"2024-09-15T12:25:10.465807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":2277,"log_dups_size":0,"ondisk_log_size":2277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3473408,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2277,"num_write_kb":74560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"54'2243","reported_seq":2315,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:25:10.603870+0000","last_change":"2024-09-15T12:22:00.383291+0000","last_active":"2024-09-15T12:25:10.603870+0000","last_peered":"2024-09-15T12:25:10.603870+0000","last_clean":"2024-09-15T12:25:10.603870+0000","last_became_active":"2024-09-15T12:22:00.376330+0000","last_became_peered":"2024-09-15T12:22:00.376330+0000","last_unstale":"2024-09-15T12:25:10.603870+0000","last_undegraded":"2024-09-15T12:25:10.603870+0000","last_fullsized":"2024-09-15T12:25:10.603870+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":2243,"log_dups_size":0,"ondisk_log_size":2243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3342336,"num_objects":51,"num_object_clones":0,"num_object_copies":153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2243,"num_write_kb":73408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"54'2315","reported_seq":2388,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:25:10.705574+0000","last_change":"2024-09-15T12:22:00.413467+0000","last_active":"2024-09-15T12:25:10.705574+0000","last_peered":"2024-09-15T12:25:10.705574+0000","last_clean":"2024-09-15T12:25:10.705574+0000","last_became_active":"2024-09-15T12:22:00.399293+0000","last_became_peered":"2024-09-15T12:22:00.399293+0000","last_unstale":"2024-09-15T12:25:10.705574+0000","last_undegraded":"2024-09-15T12:25:10.705574+0000","last_fullsized":"2024-09-15T12:25:10.705574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":2315,"log_dups_size":0,"ondisk_log_size":2315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3801112,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2315,"num_write_kb":75905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"54'1912","reported_seq":1984,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:41.761425+0000","last_change":"2024-09-15T12:22:00.397700+0000","last_active":"2024-09-15T12:24:41.761425+0000","last_peered":"2024-09-15T12:24:41.761425+0000","last_clean":"2024-09-15T12:24:41.761425+0000","last_became_active":"2024-09-15T12:22:00.388314+0000","last_became_peered":"2024-09-15T12:22:00.388314+0000","last_unstale":"2024-09-15T12:24:41.761425+0000","last_undegraded":"2024-09-15T12:24:41.761425+0000","last_fullsized":"2024-09-15T12:24:41.761425+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":1912,"log_dups_size":0,"ondisk_log_size":1912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19922944,"num_objects":304,"num_object_clones":0,"num_object_copies":912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1912,"num_write_kb":70912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"54'2090","reported_seq":2162,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:25:10.757545+0000","last_change":"2024-09-15T12:22:00.418610+0000","last_active":"2024-09-15T12:25:10.757545+0000","last_peered":"2024-09-15T12:25:10.757545+0000","last_clean":"2024-09-15T12:25:10.757545+0000","last_became_active":"2024-09-15T12:22:00.404352+0000","last_became_peered":"2024-09-15T12:22:00.404352+0000","last_unstale":"2024-09-15T12:25:10.757545+0000","last_undegraded":"2024-09-15T12:25:10.757545+0000","last_fullsized":"2024-09-15T12:25:10.757545+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":2090,"log_dups_size":0,"ondisk_log_size":2090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3407872,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2090,"num_write_kb":68544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"54'2221","reported_seq":2293,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:25:10.508851+0000","last_change":"2024-09-15T12:22:00.408893+0000","last_active":"2024-09-15T12:25:10.508851+0000","last_peered":"2024-09-15T12:25:10.508851+0000","last_clean":"2024-09-15T12:25:10.508851+0000","last_became_active":"2024-09-15T12:22:00.399557+0000","last_became_peered":"2024-09-15T12:22:00.399557+0000","last_unstale":"2024-09-15T12:25:10.508851+0000","last_undegraded":"2024-09-15T12:25:10.508851+0000","last_fullsized":"2024-09-15T12:25:10.508851+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":2221,"log_dups_size":0,"ondisk_log_size":2221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3735552,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2221,"num_write_kb":72896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"54'2274","reported_seq":2346,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:25:10.554646+0000","last_change":"2024-09-15T12:22:00.458263+0000","last_active":"2024-09-15T12:25:10.554646+0000","last_peered":"2024-09-15T12:25:10.554646+0000","last_clean":"2024-09-15T12:25:10.554646+0000","last_became_active":"2024-09-15T12:22:00.446629+0000","last_became_peered":"2024-09-15T12:22:00.446629+0000","last_unstale":"2024-09-15T12:25:10.554646+0000","last_undegraded":"2024-09-15T12:25:10.554646+0000","last_fullsized":"2024-09-15T12:25:10.554646+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":2274,"log_dups_size":0,"ondisk_log_size":2274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2274,"num_write_kb":74496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"54'2269","reported_seq":2341,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:25:10.426020+0000","last_change":"2024-09-15T12:22:00.432607+0000","last_active":"2024-09-15T12:25:10.426020+0000","last_peered":"2024-09-15T12:25:10.426020+0000","last_clean":"2024-09-15T12:25:10.426020+0000","last_became_active":"2024-09-15T12:22:00.422177+0000","last_became_peered":"2024-09-15T12:22:00.422177+0000","last_unstale":"2024-09-15T12:25:10.426020+0000","last_undegraded":"2024-09-15T12:25:10.426020+0000","last_fullsized":"2024-09-15T12:25:10.426020+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":2269,"log_dups_size":0,"ondisk_log_size":2269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3211264,"num_objects":49,"num_object_clones":0,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2269,"num_write_kb":74176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"54'2121","reported_seq":2193,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:25:10.611183+0000","last_change":"2024-09-15T12:22:00.420197+0000","last_active":"2024-09-15T12:25:10.611183+0000","last_peered":"2024-09-15T12:25:10.611183+0000","last_clean":"2024-09-15T12:25:10.611183+0000","last_became_active":"2024-09-15T12:22:00.406666+0000","last_became_peered":"2024-09-15T12:22:00.406666+0000","last_unstale":"2024-09-15T12:25:10.611183+0000","last_undegraded":"2024-09-15T12:25:10.611183+0000","last_fullsized":"2024-09-15T12:25:10.611183+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":2121,"log_dups_size":0,"ondisk_log_size":2121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2949120,"num_objects":45,"num_object_clones":0,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2121,"num_write_kb":69312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.262544+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:24:24.262544+0000","last_peered":"2024-09-15T12:24:24.262544+0000","last_clean":"2024-09-15T12:24:24.262544+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:24:24.262544+0000","last_undegraded":"2024-09-15T12:24:24.262544+0000","last_fullsized":"2024-09-15T12:24:24.262544+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":134,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.293215+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:24:24.293215+0000","last_peered":"2024-09-15T12:24:24.293215+0000","last_clean":"2024-09-15T12:24:24.293215+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:24:24.293215+0000","last_undegraded":"2024-09-15T12:24:24.293215+0000","last_fullsized":"2024-09-15T12:24:24.293215+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"54'2232","reported_seq":2304,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:25:10.731323+0000","last_change":"2024-09-15T12:22:00.381165+0000","last_active":"2024-09-15T12:25:10.731323+0000","last_peered":"2024-09-15T12:25:10.731323+0000","last_clean":"2024-09-15T12:25:10.731323+0000","last_became_active":"2024-09-15T12:22:00.374145+0000","last_became_peered":"2024-09-15T12:22:00.374145+0000","last_unstale":"2024-09-15T12:25:10.731323+0000","last_undegraded":"2024-09-15T12:25:10.731323+0000","last_fullsized":"2024-09-15T12:25:10.731323+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":2232,"log_dups_size":0,"ondisk_log_size":2232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2490368,"num_objects":38,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2232,"num_write_kb":72640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.331270+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:24:24.331270+0000","last_peered":"2024-09-15T12:24:24.331270+0000","last_clean":"2024-09-15T12:24:24.331270+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:24:24.331270+0000","last_undegraded":"2024-09-15T12:24:24.331270+0000","last_fullsized":"2024-09-15T12:24:24.331270+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"54'2188","reported_seq":2260,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:25:09.916653+0000","last_change":"2024-09-15T12:22:00.405131+0000","last_active":"2024-09-15T12:25:09.916653+0000","last_peered":"2024-09-15T12:25:09.916653+0000","last_clean":"2024-09-15T12:25:09.916653+0000","last_became_active":"2024-09-15T12:22:00.398288+0000","last_became_peered":"2024-09-15T12:22:00.398288+0000","last_unstale":"2024-09-15T12:25:09.916653+0000","last_undegraded":"2024-09-15T12:25:09.916653+0000","last_fullsized":"2024-09-15T12:25:09.916653+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":2188,"log_dups_size":0,"ondisk_log_size":2188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2188,"num_write_kb":71744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.284255+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:24:24.284255+0000","last_peered":"2024-09-15T12:24:24.284255+0000","last_clean":"2024-09-15T12:24:24.284255+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:24:24.284255+0000","last_undegraded":"2024-09-15T12:24:24.284255+0000","last_fullsized":"2024-09-15T12:24:24.284255+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"54'2303","reported_seq":2375,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:25:10.614487+0000","last_change":"2024-09-15T12:22:00.390143+0000","last_active":"2024-09-15T12:25:10.614487+0000","last_peered":"2024-09-15T12:25:10.614487+0000","last_clean":"2024-09-15T12:25:10.614487+0000","last_became_active":"2024-09-15T12:22:00.370049+0000","last_became_peered":"2024-09-15T12:22:00.370049+0000","last_unstale":"2024-09-15T12:25:10.614487+0000","last_undegraded":"2024-09-15T12:25:10.614487+0000","last_fullsized":"2024-09-15T12:25:10.614487+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":2303,"log_dups_size":0,"ondisk_log_size":2303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3080192,"num_objects":47,"num_object_clones":0,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2303,"num_write_kb":75200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.297184+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:24:24.297184+0000","last_peered":"2024-09-15T12:24:24.297184+0000","last_clean":"2024-09-15T12:24:24.297184+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:24:24.297184+0000","last_undegraded":"2024-09-15T12:24:24.297184+0000","last_fullsized":"2024-09-15T12:24:24.297184+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"54'2195","reported_seq":2267,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:25:10.583204+0000","last_change":"2024-09-15T12:22:00.450159+0000","last_active":"2024-09-15T12:25:10.583204+0000","last_peered":"2024-09-15T12:25:10.583204+0000","last_clean":"2024-09-15T12:25:10.583204+0000","last_became_active":"2024-09-15T12:22:00.437056+0000","last_became_peered":"2024-09-15T12:22:00.437056+0000","last_unstale":"2024-09-15T12:25:10.583204+0000","last_undegraded":"2024-09-15T12:25:10.583204+0000","last_fullsized":"2024-09-15T12:25:10.583204+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":2195,"log_dups_size":0,"ondisk_log_size":2195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3604480,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2195,"num_write_kb":72000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.287155+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:24:24.287155+0000","last_peered":"2024-09-15T12:24:24.287155+0000","last_clean":"2024-09-15T12:24:24.287155+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:24:24.287155+0000","last_undegraded":"2024-09-15T12:24:24.287155+0000","last_fullsized":"2024-09-15T12:24:24.287155+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"54'2207","reported_seq":2279,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:25:10.694319+0000","last_change":"2024-09-15T12:22:00.364579+0000","last_active":"2024-09-15T12:25:10.694319+0000","last_peered":"2024-09-15T12:25:10.694319+0000","last_clean":"2024-09-15T12:25:10.694319+0000","last_became_active":"2024-09-15T12:22:00.353614+0000","last_became_peered":"2024-09-15T12:22:00.353614+0000","last_unstale":"2024-09-15T12:25:10.694319+0000","last_undegraded":"2024-09-15T12:25:10.694319+0000","last_fullsized":"2024-09-15T12:25:10.694319+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":2207,"log_dups_size":0,"ondisk_log_size":2207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3997696,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2207,"num_write_kb":72576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.294001+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:24:24.294001+0000","last_peered":"2024-09-15T12:24:24.294001+0000","last_clean":"2024-09-15T12:24:24.294001+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:24:24.294001+0000","last_undegraded":"2024-09-15T12:24:24.294001+0000","last_fullsized":"2024-09-15T12:24:24.294001+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"54'2280","reported_seq":2352,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:25:10.447220+0000","last_change":"2024-09-15T12:22:00.384094+0000","last_active":"2024-09-15T12:25:10.447220+0000","last_peered":"2024-09-15T12:25:10.447220+0000","last_clean":"2024-09-15T12:25:10.447220+0000","last_became_active":"2024-09-15T12:22:00.377789+0000","last_became_peered":"2024-09-15T12:22:00.377789+0000","last_unstale":"2024-09-15T12:25:10.447220+0000","last_undegraded":"2024-09-15T12:25:10.447220+0000","last_fullsized":"2024-09-15T12:25:10.447220+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":2280,"log_dups_size":0,"ondisk_log_size":2280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3538944,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2280,"num_write_kb":74688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.269819+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:24:24.269819+0000","last_peered":"2024-09-15T12:24:24.269819+0000","last_clean":"2024-09-15T12:24:24.269819+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:24:24.269819+0000","last_undegraded":"2024-09-15T12:24:24.269819+0000","last_fullsized":"2024-09-15T12:24:24.269819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"54'2272","reported_seq":2344,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:25:10.665050+0000","last_change":"2024-09-15T12:22:00.394121+0000","last_active":"2024-09-15T12:25:10.665050+0000","last_peered":"2024-09-15T12:25:10.665050+0000","last_clean":"2024-09-15T12:25:10.665050+0000","last_became_active":"2024-09-15T12:22:00.388183+0000","last_became_peered":"2024-09-15T12:22:00.388183+0000","last_unstale":"2024-09-15T12:25:10.665050+0000","last_undegraded":"2024-09-15T12:25:10.665050+0000","last_fullsized":"2024-09-15T12:25:10.665050+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:21:59.235820+0000","last_clean_scrub_stamp":"2024-09-15T12:21:59.235820+0000","objects_scrubbed":0,"log_size":2272,"log_dups_size":0,"ondisk_log_size":2272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3670016,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2272,"num_write_kb":74496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.335125+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:24:24.335125+0000","last_peered":"2024-09-15T12:24:24.335125+0000","last_clean":"2024-09-15T12:24:24.335125+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:24:24.335125+0000","last_undegraded":"2024-09-15T12:24:24.335125+0000","last_fullsized":"2024-09-15T12:24:24.335125+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":71303192,"num_objects":1089,"num_object_clones":0,"num_object_copies":3267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":35399,"num_write_kb":1167553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":25862144,"data_stored":413597768,"data_compressed":19639832,"data_compressed_allocated":25849856,"data_compressed_original":413597696,"omap_allocated":0,"internal_metadata":0},"log_size":35399,"ondisk_log_size":35399,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673319,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":89692,"kb_used_data":18444,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94282148,"statfs":{"total":96636764160,"available":96544919552,"internally_reserved":0,"allocated":18886656,"data_stored":294748650,"data_compressed":13990464,"data_compressed_allocated":18415616,"data_compressed_original":294567936,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706053,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73944,"kb_used_data":2696,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94297896,"statfs":{"total":96636764160,"available":96561045504,"internally_reserved":0,"allocated":2760704,"data_stored":36602389,"data_compressed":1732296,"data_compressed_allocated":2281472,"data_compressed_original":36421632,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706053,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70320,"kb_used_data":3232,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94301520,"statfs":{"total":96636764160,"available":96564756480,"internally_reserved":0,"allocated":3309568,"data_stored":45776885,"data_compressed":2165952,"data_compressed_allocated":2850816,"data_compressed_original":45613056,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706053,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74292,"kb_used_data":3044,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94297548,"statfs":{"total":96636764160,"available":96560689152,"internally_reserved":0,"allocated":3117056,"data_stored":42304021,"data_compressed":2003040,"data_compressed_allocated":2637824,"data_compressed_original":42123264,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2572288,"data_stored":41091096,"data_compressed":1951224,"data_compressed_allocated":2568192,"data_compressed_original":41091072,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2830336,"data_stored":45219864,"data_compressed":2147280,"data_compressed_allocated":2826240,"data_compressed_original":45219840,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2179072,"data_stored":34799640,"data_compressed":1652472,"data_compressed_allocated":2174976,"data_compressed_original":34799616,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18280448,"data_stored":292487168,"data_compressed":13888856,"data_compressed_allocated":18280448,"data_compressed_original":292487168,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:25:13.921 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:25:14.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:14.071+0000 7f05c0f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:14.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:14.082+0000 7f05c0f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:16.235 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Removed 18243 objects 2024-09-15T12:25:16.235 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Clean up completed and total clean up time :103.86 2024-09-15T12:25:16.432 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:25:16.516 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_1 2024-09-15T12:25:16.516 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_1 unique_pool_1 --yes-i-really-really-mean-it 2024-09-15T12:25:16.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:16.535+0000 7fc292f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:16.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:16.541+0000 7fc292f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:16.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:16.635+0000 7fe4d2f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:16.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:16.647+0000 7fe4d2f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:17.279 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'unique_pool_1' removed 2024-09-15T12:25:17.295 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-15T12:25:17.296 INFO:tasks.radosbench:Beginning radosbench... 2024-09-15T12:25:17.297 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_2 2024-09-15T12:25:17.297 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_2 16 2024-09-15T12:25:17.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:17.447+0000 7f4e2aebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:17.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:17.459+0000 7f4e2aebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:17.988 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:25:17.989 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:25:17.989 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:25:17.989 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:25:18.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:18.129+0000 7f3658f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:18.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:18.140+0000 7f3658f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:18.166 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:25:18.166 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:25:18.166 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:25:18.166 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:25:18.166 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:25:18.166 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:25:18.167 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:25:18.167 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:25:18.167 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:25:18.167 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:25:18.167 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:25:18.167 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:25:18.171 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:25:18.171 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:25:18.171 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:25:18.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:18.277+0000 7fa2812d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:18.286 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'unique_pool_2' created 2024-09-15T12:25:18.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:18.295+0000 7fa2812d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:18.308 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_2 rados --yes-i-really-mean-it || true 2024-09-15T12:25:18.357 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:25:18.357 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:25:18.357 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:25:18.357 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:25:18.357 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:25:18.357 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:25:18.357 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:25:18.357 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:25:18.357 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:25:18.357 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:25:18.357 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:25:18.357 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:25:18.365 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:25:18.365 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:25:18.365 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:25:18.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:18.448+0000 7fcb762bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:18.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:18.465+0000 7fcb762bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:18.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:18.497+0000 7fd4c7191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:18.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:18.506+0000 7fd4c7191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:18.524 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:25:18.524 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:25:18.524 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:25:18.524 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:25:18.524 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:25:18.524 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:25:18.524 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:25:18.524 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:25:18.524 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:25:18.524 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:25:18.524 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:25:18.524 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:25:18.527 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:25:18.527 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:25:18.527 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:25:18.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:18.635+0000 7fc3f1991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:18.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:18.644+0000 7fc3f1991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:18.661 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:25:18.661 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:25:18.661 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:25:18.661 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:25:18.662 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:25:18.662 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:25:18.662 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:25:18.662 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:25:18.662 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:25:18.662 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:25:18.662 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:25:18.662 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:25:18.664 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:25:18.665 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:25:18.666 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:25:18.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:18.808+0000 7f26d087d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:18.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:18.813+0000 7f26d087d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:19.293 INFO:teuthology.orchestra.run.smithi077.stderr:enabled application 'rados' on pool 'unique_pool_2' 2024-09-15T12:25:20.313 DEBUG:teuthology.orchestra.run.smithi077:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_2 bench 90 write' 2024-09-15T12:25:20.315 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-15T12:25:20.316 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-15T12:25:20.379 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:hints = 1 2024-09-15T12:25:20.379 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-15T12:25:20.379 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Object prefix: benchmark_data_smithi077_45470 2024-09-15T12:25:20.379 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-15T12:25:20.379 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 0 0 0 0 0 0 - 0 2024-09-15T12:25:20.915 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:25:21.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:21.087+0000 7f7bc12bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:21.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:21.097+0000 7f7bc12bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:21.379 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 1 16 225 209 13.0618 13.0625 0.0853872 0.0732354 2024-09-15T12:25:22.379 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 2 16 441 425 13.2803 13.5 0.0860938 0.0738696 2024-09-15T12:25:23.379 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 3 16 678 662 13.7906 14.8125 0.0544317 0.0717559 2024-09-15T12:25:23.383 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:25:23.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:23.538+0000 7f24ab246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:23.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:23.547+0000 7f24ab246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:23.667 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:25:23.667 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:25:23.667 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:25:23.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:23.836+0000 7fcec6391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:23.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:23.850+0000 7fcec6391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:24.180 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:25:24.180 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:25:24.201 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":252,"stamp":"2024-09-15T12:25:23.781705+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":292472,"kb_used_data":11636,"kb_used_omap":0,"kb_used_meta":280768,"kb_avail":377194888,"statfs":{"total":386547056640,"available":386247565312,"internally_reserved":0,"allocated":11915264,"data_stored":160892425,"data_compressed":7614912,"data_compressed_allocated":10027008,"data_compressed_original":160186368,"omap_allocated":0,"internal_metadata":287506432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001050"},"pg_stats":[{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.262544+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:24:24.262544+0000","last_peered":"2024-09-15T12:24:24.262544+0000","last_clean":"2024-09-15T12:24:24.262544+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:24:24.262544+0000","last_undegraded":"2024-09-15T12:24:24.262544+0000","last_fullsized":"2024-09-15T12:24:24.262544+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":134,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.293215+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:24:24.293215+0000","last_peered":"2024-09-15T12:24:24.293215+0000","last_clean":"2024-09-15T12:24:24.293215+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:24:24.293215+0000","last_undegraded":"2024-09-15T12:24:24.293215+0000","last_fullsized":"2024-09-15T12:24:24.293215+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.331270+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:24:24.331270+0000","last_peered":"2024-09-15T12:24:24.331270+0000","last_clean":"2024-09-15T12:24:24.331270+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:24:24.331270+0000","last_undegraded":"2024-09-15T12:24:24.331270+0000","last_fullsized":"2024-09-15T12:24:24.331270+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.284255+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:24:24.284255+0000","last_peered":"2024-09-15T12:24:24.284255+0000","last_clean":"2024-09-15T12:24:24.284255+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:24:24.284255+0000","last_undegraded":"2024-09-15T12:24:24.284255+0000","last_fullsized":"2024-09-15T12:24:24.284255+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.297184+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:24:24.297184+0000","last_peered":"2024-09-15T12:24:24.297184+0000","last_clean":"2024-09-15T12:24:24.297184+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:24:24.297184+0000","last_undegraded":"2024-09-15T12:24:24.297184+0000","last_fullsized":"2024-09-15T12:24:24.297184+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.287155+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:24:24.287155+0000","last_peered":"2024-09-15T12:24:24.287155+0000","last_clean":"2024-09-15T12:24:24.287155+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:24:24.287155+0000","last_undegraded":"2024-09-15T12:24:24.287155+0000","last_fullsized":"2024-09-15T12:24:24.287155+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.294001+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:24:24.294001+0000","last_peered":"2024-09-15T12:24:24.294001+0000","last_clean":"2024-09-15T12:24:24.294001+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:24:24.294001+0000","last_undegraded":"2024-09-15T12:24:24.294001+0000","last_fullsized":"2024-09-15T12:24:24.294001+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.269819+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:24:24.269819+0000","last_peered":"2024-09-15T12:24:24.269819+0000","last_clean":"2024-09-15T12:24:24.269819+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:24:24.269819+0000","last_undegraded":"2024-09-15T12:24:24.269819+0000","last_fullsized":"2024-09-15T12:24:24.269819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.335125+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:24:24.335125+0000","last_peered":"2024-09-15T12:24:24.335125+0000","last_clean":"2024-09-15T12:24:24.335125+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:24:24.335125+0000","last_undegraded":"2024-09-15T12:24:24.335125+0000","last_fullsized":"2024-09-15T12:24:24.335125+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73916,"kb_used_data":2664,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94297924,"statfs":{"total":96636764160,"available":96561074176,"internally_reserved":0,"allocated":2727936,"data_stored":36209130,"data_compressed":1713624,"data_compressed_allocated":2256896,"data_compressed_original":36028416,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706053,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73944,"kb_used_data":2696,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94297896,"statfs":{"total":96636764160,"available":96561045504,"internally_reserved":0,"allocated":2760704,"data_stored":36602389,"data_compressed":1732296,"data_compressed_allocated":2281472,"data_compressed_original":36421632,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706053,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70320,"kb_used_data":3232,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94301520,"statfs":{"total":96636764160,"available":96564756480,"internally_reserved":0,"allocated":3309568,"data_stored":45776885,"data_compressed":2165952,"data_compressed_allocated":2850816,"data_compressed_original":45613056,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706053,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74292,"kb_used_data":3044,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94297548,"statfs":{"total":96636764160,"available":96560689152,"internally_reserved":0,"allocated":3117056,"data_stored":42304021,"data_compressed":2003040,"data_compressed_allocated":2637824,"data_compressed_original":42123264,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:25:24.379 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 4 16 905 889 13.8895 14.1875 0.0933962 0.0714524 2024-09-15T12:25:25.379 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 5 16 1129 1113 13.9114 14 0.0641264 0.0713164 2024-09-15T12:25:25.803 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:25:25.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:25.960+0000 7ff1e3a84640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:25.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:25.969+0000 7ff1e3a84640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:26.379 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 6 16 1346 1330 13.853 13.5625 0.0639285 0.0717762 2024-09-15T12:25:27.379 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 7 16 1558 1542 13.7667 13.25 0.0461821 0.0722728 2024-09-15T12:25:28.328 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:25:28.380 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 8 16 1786 1770 13.827 14.25 0.0424946 0.0721128 2024-09-15T12:25:28.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:28.493+0000 7f6918ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:28.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:28.504+0000 7f6918ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:29.203 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:25:29.203 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:25:29.203 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:25:29.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:29.356+0000 7f17b0d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:29.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:29.372+0000 7f17b0d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:29.379 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 9 16 1995 1979 13.7419 13.0625 0.0754271 0.0724388 2024-09-15T12:25:29.684 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:25:29.684 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:25:29.703 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":254,"stamp":"2024-09-15T12:25:27.782405+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":292472,"kb_used_data":11636,"kb_used_omap":0,"kb_used_meta":280768,"kb_avail":377194888,"statfs":{"total":386547056640,"available":386247565312,"internally_reserved":0,"allocated":11915264,"data_stored":160892425,"data_compressed":7614912,"data_compressed_allocated":10027008,"data_compressed_original":160186368,"omap_allocated":0,"internal_metadata":287506432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.487115"},"pg_stats":[{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.262544+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:24:24.262544+0000","last_peered":"2024-09-15T12:24:24.262544+0000","last_clean":"2024-09-15T12:24:24.262544+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:24:24.262544+0000","last_undegraded":"2024-09-15T12:24:24.262544+0000","last_fullsized":"2024-09-15T12:24:24.262544+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":134,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.293215+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:24:24.293215+0000","last_peered":"2024-09-15T12:24:24.293215+0000","last_clean":"2024-09-15T12:24:24.293215+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:24:24.293215+0000","last_undegraded":"2024-09-15T12:24:24.293215+0000","last_fullsized":"2024-09-15T12:24:24.293215+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.331270+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:24:24.331270+0000","last_peered":"2024-09-15T12:24:24.331270+0000","last_clean":"2024-09-15T12:24:24.331270+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:24:24.331270+0000","last_undegraded":"2024-09-15T12:24:24.331270+0000","last_fullsized":"2024-09-15T12:24:24.331270+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.284255+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:24:24.284255+0000","last_peered":"2024-09-15T12:24:24.284255+0000","last_clean":"2024-09-15T12:24:24.284255+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:24:24.284255+0000","last_undegraded":"2024-09-15T12:24:24.284255+0000","last_fullsized":"2024-09-15T12:24:24.284255+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.297184+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:24:24.297184+0000","last_peered":"2024-09-15T12:24:24.297184+0000","last_clean":"2024-09-15T12:24:24.297184+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:24:24.297184+0000","last_undegraded":"2024-09-15T12:24:24.297184+0000","last_fullsized":"2024-09-15T12:24:24.297184+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.287155+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:24:24.287155+0000","last_peered":"2024-09-15T12:24:24.287155+0000","last_clean":"2024-09-15T12:24:24.287155+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:24:24.287155+0000","last_undegraded":"2024-09-15T12:24:24.287155+0000","last_fullsized":"2024-09-15T12:24:24.287155+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.294001+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:24:24.294001+0000","last_peered":"2024-09-15T12:24:24.294001+0000","last_clean":"2024-09-15T12:24:24.294001+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:24:24.294001+0000","last_undegraded":"2024-09-15T12:24:24.294001+0000","last_fullsized":"2024-09-15T12:24:24.294001+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.269819+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:24:24.269819+0000","last_peered":"2024-09-15T12:24:24.269819+0000","last_clean":"2024-09-15T12:24:24.269819+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:24:24.269819+0000","last_undegraded":"2024-09-15T12:24:24.269819+0000","last_fullsized":"2024-09-15T12:24:24.269819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.335125+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:24:24.335125+0000","last_peered":"2024-09-15T12:24:24.335125+0000","last_clean":"2024-09-15T12:24:24.335125+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:24:24.335125+0000","last_undegraded":"2024-09-15T12:24:24.335125+0000","last_fullsized":"2024-09-15T12:24:24.335125+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73916,"kb_used_data":2664,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94297924,"statfs":{"total":96636764160,"available":96561074176,"internally_reserved":0,"allocated":2727936,"data_stored":36209130,"data_compressed":1713624,"data_compressed_allocated":2256896,"data_compressed_original":36028416,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706053,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73944,"kb_used_data":2696,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94297896,"statfs":{"total":96636764160,"available":96561045504,"internally_reserved":0,"allocated":2760704,"data_stored":36602389,"data_compressed":1732296,"data_compressed_allocated":2281472,"data_compressed_original":36421632,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706053,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70320,"kb_used_data":3232,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94301520,"statfs":{"total":96636764160,"available":96564756480,"internally_reserved":0,"allocated":3309568,"data_stored":45776885,"data_compressed":2165952,"data_compressed_allocated":2850816,"data_compressed_original":45613056,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706053,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74292,"kb_used_data":3044,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94297548,"statfs":{"total":96636764160,"available":96560689152,"internally_reserved":0,"allocated":3117056,"data_stored":42304021,"data_compressed":2003040,"data_compressed_allocated":2637824,"data_compressed_original":42123264,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:25:30.380 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 10 16 2222 2206 13.7863 14.1875 0.0627572 0.0722868 2024-09-15T12:25:30.791 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:25:30.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:30.948+0000 7ff17e511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:30.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:30.956+0000 7ff17e511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:31.380 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 11 16 2432 2416 13.7261 13.125 0.0415071 0.0724788 2024-09-15T12:25:32.380 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 12 16 2661 2645 13.7749 14.3125 0.0544033 0.0723787 2024-09-15T12:25:33.353 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:25:33.380 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 13 15 2883 2868 13.7873 13.9375 0.0849853 0.0722717 2024-09-15T12:25:33.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:33.513+0000 7f3950511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:33.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:33.522+0000 7f3950511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:34.380 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 14 16 3093 3077 13.7354 13.0625 0.0987807 0.0725632 2024-09-15T12:25:34.705 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:25:34.705 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-15T12:25:34.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:34.874+0000 7faa4dd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:34.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:34.890+0000 7faa4dd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:35.265 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.0 to 1 (10000) 2024-09-15T12:25:35.286 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-15T12:25:35.380 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 15 16 3315 3299 13.7446 13.875 0.0760344 0.0725812 2024-09-15T12:25:35.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:35.456+0000 7f5add24f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:35.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:35.475+0000 7f5add24f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:35.777 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:25:35.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:35.941+0000 7f8895f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:35.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:35.950+0000 7f8895f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:36.273 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.1 to 1 (10000) 2024-09-15T12:25:36.298 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-15T12:25:36.380 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 16 16 3505 3489 13.6277 11.875 0.0614408 0.0732757 2024-09-15T12:25:36.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:36.501+0000 7fd9662d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:36.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:36.520+0000 7fd9662d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:37.275 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.2 to 1 (10000) 2024-09-15T12:25:37.299 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-15T12:25:37.380 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 17 16 3705 3689 13.5613 12.5 0.0283914 0.0736087 2024-09-15T12:25:37.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:37.506+0000 7f4819afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:37.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:37.521+0000 7f4819afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:38.284 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.3 to 1 (10000) 2024-09-15T12:25:38.296 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:25:38.305 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-15T12:25:38.305 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:25:38.380 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 18 16 3888 3872 13.4433 11.4375 0.0715502 0.0740549 2024-09-15T12:25:38.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:38.446+0000 7fe37a591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:38.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:38.457+0000 7fe37a591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:38.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:38.500+0000 7f9505f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:38.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:38.513+0000 7f9505f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:38.834 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:25:38.834 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:25:38.855 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":263,"stamp":"2024-09-15T12:25:38.284178+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":292472,"kb_used_data":11636,"kb_used_omap":0,"kb_used_meta":280768,"kb_avail":377194888,"statfs":{"total":386547056640,"available":386247565312,"internally_reserved":0,"allocated":11915264,"data_stored":160892425,"data_compressed":7614912,"data_compressed_allocated":10027008,"data_compressed_original":160186368,"omap_allocated":0,"internal_metadata":287506432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.500618"},"pg_stats":[{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.262544+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:24:24.262544+0000","last_peered":"2024-09-15T12:24:24.262544+0000","last_clean":"2024-09-15T12:24:24.262544+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:24:24.262544+0000","last_undegraded":"2024-09-15T12:24:24.262544+0000","last_fullsized":"2024-09-15T12:24:24.262544+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":134,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.293215+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:24:24.293215+0000","last_peered":"2024-09-15T12:24:24.293215+0000","last_clean":"2024-09-15T12:24:24.293215+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:24:24.293215+0000","last_undegraded":"2024-09-15T12:24:24.293215+0000","last_fullsized":"2024-09-15T12:24:24.293215+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.331270+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:24:24.331270+0000","last_peered":"2024-09-15T12:24:24.331270+0000","last_clean":"2024-09-15T12:24:24.331270+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:24:24.331270+0000","last_undegraded":"2024-09-15T12:24:24.331270+0000","last_fullsized":"2024-09-15T12:24:24.331270+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.284255+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:24:24.284255+0000","last_peered":"2024-09-15T12:24:24.284255+0000","last_clean":"2024-09-15T12:24:24.284255+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:24:24.284255+0000","last_undegraded":"2024-09-15T12:24:24.284255+0000","last_fullsized":"2024-09-15T12:24:24.284255+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.297184+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:24:24.297184+0000","last_peered":"2024-09-15T12:24:24.297184+0000","last_clean":"2024-09-15T12:24:24.297184+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:24:24.297184+0000","last_undegraded":"2024-09-15T12:24:24.297184+0000","last_fullsized":"2024-09-15T12:24:24.297184+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.287155+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:24:24.287155+0000","last_peered":"2024-09-15T12:24:24.287155+0000","last_clean":"2024-09-15T12:24:24.287155+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:24:24.287155+0000","last_undegraded":"2024-09-15T12:24:24.287155+0000","last_fullsized":"2024-09-15T12:24:24.287155+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.294001+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:24:24.294001+0000","last_peered":"2024-09-15T12:24:24.294001+0000","last_clean":"2024-09-15T12:24:24.294001+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:24:24.294001+0000","last_undegraded":"2024-09-15T12:24:24.294001+0000","last_fullsized":"2024-09-15T12:24:24.294001+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.269819+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:24:24.269819+0000","last_peered":"2024-09-15T12:24:24.269819+0000","last_clean":"2024-09-15T12:24:24.269819+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:24:24.269819+0000","last_undegraded":"2024-09-15T12:24:24.269819+0000","last_fullsized":"2024-09-15T12:24:24.269819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.335125+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:24:24.335125+0000","last_peered":"2024-09-15T12:24:24.335125+0000","last_clean":"2024-09-15T12:24:24.335125+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:24:24.335125+0000","last_undegraded":"2024-09-15T12:24:24.335125+0000","last_fullsized":"2024-09-15T12:24:24.335125+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73916,"kb_used_data":2664,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94297924,"statfs":{"total":96636764160,"available":96561074176,"internally_reserved":0,"allocated":2727936,"data_stored":36209130,"data_compressed":1713624,"data_compressed_allocated":2256896,"data_compressed_original":36028416,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706053,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73944,"kb_used_data":2696,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94297896,"statfs":{"total":96636764160,"available":96561045504,"internally_reserved":0,"allocated":2760704,"data_stored":36602389,"data_compressed":1732296,"data_compressed_allocated":2281472,"data_compressed_original":36421632,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706053,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70320,"kb_used_data":3232,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94301520,"statfs":{"total":96636764160,"available":96564756480,"internally_reserved":0,"allocated":3309568,"data_stored":45776885,"data_compressed":2165952,"data_compressed_allocated":2850816,"data_compressed_original":45613056,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706053,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74292,"kb_used_data":3044,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94297548,"statfs":{"total":96636764160,"available":96560689152,"internally_reserved":0,"allocated":3117056,"data_stored":42304021,"data_compressed":2003040,"data_compressed_allocated":2637824,"data_compressed_original":42123264,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:25:38.856 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:25:39.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:38.995+0000 7f97714d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:39.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:39.006+0000 7f97714d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:39.346 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:25:39.347 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:25:39.374 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":263,"stamp":"2024-09-15T12:25:38.284178+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":292472,"kb_used_data":11636,"kb_used_omap":0,"kb_used_meta":280768,"kb_avail":377194888,"statfs":{"total":386547056640,"available":386247565312,"internally_reserved":0,"allocated":11915264,"data_stored":160892425,"data_compressed":7614912,"data_compressed_allocated":10027008,"data_compressed_original":160186368,"omap_allocated":0,"internal_metadata":287506432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.500618"},"pg_stats":[{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.262544+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:24:24.262544+0000","last_peered":"2024-09-15T12:24:24.262544+0000","last_clean":"2024-09-15T12:24:24.262544+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:24:24.262544+0000","last_undegraded":"2024-09-15T12:24:24.262544+0000","last_fullsized":"2024-09-15T12:24:24.262544+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":134,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.293215+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:24:24.293215+0000","last_peered":"2024-09-15T12:24:24.293215+0000","last_clean":"2024-09-15T12:24:24.293215+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:24:24.293215+0000","last_undegraded":"2024-09-15T12:24:24.293215+0000","last_fullsized":"2024-09-15T12:24:24.293215+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.331270+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:24:24.331270+0000","last_peered":"2024-09-15T12:24:24.331270+0000","last_clean":"2024-09-15T12:24:24.331270+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:24:24.331270+0000","last_undegraded":"2024-09-15T12:24:24.331270+0000","last_fullsized":"2024-09-15T12:24:24.331270+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.284255+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:24:24.284255+0000","last_peered":"2024-09-15T12:24:24.284255+0000","last_clean":"2024-09-15T12:24:24.284255+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:24:24.284255+0000","last_undegraded":"2024-09-15T12:24:24.284255+0000","last_fullsized":"2024-09-15T12:24:24.284255+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.297184+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:24:24.297184+0000","last_peered":"2024-09-15T12:24:24.297184+0000","last_clean":"2024-09-15T12:24:24.297184+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:24:24.297184+0000","last_undegraded":"2024-09-15T12:24:24.297184+0000","last_fullsized":"2024-09-15T12:24:24.297184+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.287155+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:24:24.287155+0000","last_peered":"2024-09-15T12:24:24.287155+0000","last_clean":"2024-09-15T12:24:24.287155+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:24:24.287155+0000","last_undegraded":"2024-09-15T12:24:24.287155+0000","last_fullsized":"2024-09-15T12:24:24.287155+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.294001+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:24:24.294001+0000","last_peered":"2024-09-15T12:24:24.294001+0000","last_clean":"2024-09-15T12:24:24.294001+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:24:24.294001+0000","last_undegraded":"2024-09-15T12:24:24.294001+0000","last_fullsized":"2024-09-15T12:24:24.294001+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.269819+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:24:24.269819+0000","last_peered":"2024-09-15T12:24:24.269819+0000","last_clean":"2024-09-15T12:24:24.269819+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:24:24.269819+0000","last_undegraded":"2024-09-15T12:24:24.269819+0000","last_fullsized":"2024-09-15T12:24:24.269819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.335125+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:24:24.335125+0000","last_peered":"2024-09-15T12:24:24.335125+0000","last_clean":"2024-09-15T12:24:24.335125+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:24:24.335125+0000","last_undegraded":"2024-09-15T12:24:24.335125+0000","last_fullsized":"2024-09-15T12:24:24.335125+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73916,"kb_used_data":2664,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94297924,"statfs":{"total":96636764160,"available":96561074176,"internally_reserved":0,"allocated":2727936,"data_stored":36209130,"data_compressed":1713624,"data_compressed_allocated":2256896,"data_compressed_original":36028416,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706053,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73944,"kb_used_data":2696,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94297896,"statfs":{"total":96636764160,"available":96561045504,"internally_reserved":0,"allocated":2760704,"data_stored":36602389,"data_compressed":1732296,"data_compressed_allocated":2281472,"data_compressed_original":36421632,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706053,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70320,"kb_used_data":3232,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94301520,"statfs":{"total":96636764160,"available":96564756480,"internally_reserved":0,"allocated":3309568,"data_stored":45776885,"data_compressed":2165952,"data_compressed_allocated":2850816,"data_compressed_original":45613056,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706053,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74292,"kb_used_data":3044,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94297548,"statfs":{"total":96636764160,"available":96560689152,"internally_reserved":0,"allocated":3117056,"data_stored":42304021,"data_compressed":2003040,"data_compressed_allocated":2637824,"data_compressed_original":42123264,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:25:39.376 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T12:25:39.381 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 19 16 4094 4078 13.4133 12.875 0.111925 0.0743926 2024-09-15T12:25:39.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:39.540+0000 7f03a3f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:39.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:39.553+0000 7f03a3f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:39.992 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:25:39.992 INFO:teuthology.orchestra.run.smithi077.stdout:{"fsid":"0010d80b-83bc-42b2-8185-928cfe1dc364","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":3,"quorum":[0],"quorum_names":["a"],"quorum_age":426,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":1},"osdmap":{"epoch":62,"num_osds":4,"num_up_osds":4,"osd_up_since":1726402721,"num_in_osds":4,"osd_in_since":1726402715,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":16},{"state_name":"active+clean","count":9}],"num_pgs":25,"num_pools":3,"num_objects":4,"data_bytes":590387,"bytes_used":299491328,"bytes_avail":386247565312,"bytes_total":386547056640,"unknown_pgs_ratio":0.63999998569488525},"fsmap":{"epoch":1,"btime":"2024-09-15T12:18:33:200776+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-15T12:19:39.712688+0000","services":{}},"progress_events":{}} 2024-09-15T12:25:40.015 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T12:25:40.015 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:25:40.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:40.210+0000 7f5bb8791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:40.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:40.222+0000 7f5bb8791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:40.381 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:2024-09-15T12:25:40.380455+0000 min lat: 0.0157862 max lat: 0.16893 avg lat: 0.0743804 2024-09-15T12:25:40.381 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-15T12:25:40.381 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 20 16 4309 4293 13.4145 13.4375 0.0518878 0.0743804 2024-09-15T12:25:40.553 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:25:40.553 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:25:40.574 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":264,"stamp":"2024-09-15T12:25:39.784774+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":292472,"kb_used_data":11636,"kb_used_omap":0,"kb_used_meta":280768,"kb_avail":377194888,"statfs":{"total":386547056640,"available":386247565312,"internally_reserved":0,"allocated":11915264,"data_stored":160892425,"data_compressed":7614912,"data_compressed_allocated":10027008,"data_compressed_original":160186368,"omap_allocated":0,"internal_metadata":287506432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.520423"},"pg_stats":[{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":205,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.262544+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:24:24.262544+0000","last_peered":"2024-09-15T12:24:24.262544+0000","last_clean":"2024-09-15T12:24:24.262544+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:24:24.262544+0000","last_undegraded":"2024-09-15T12:24:24.262544+0000","last_fullsized":"2024-09-15T12:24:24.262544+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":134,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.293215+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:24:24.293215+0000","last_peered":"2024-09-15T12:24:24.293215+0000","last_clean":"2024-09-15T12:24:24.293215+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:24:24.293215+0000","last_undegraded":"2024-09-15T12:24:24.293215+0000","last_fullsized":"2024-09-15T12:24:24.293215+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.331270+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:24:24.331270+0000","last_peered":"2024-09-15T12:24:24.331270+0000","last_clean":"2024-09-15T12:24:24.331270+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:24:24.331270+0000","last_undegraded":"2024-09-15T12:24:24.331270+0000","last_fullsized":"2024-09-15T12:24:24.331270+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.284255+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:24:24.284255+0000","last_peered":"2024-09-15T12:24:24.284255+0000","last_clean":"2024-09-15T12:24:24.284255+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:24:24.284255+0000","last_undegraded":"2024-09-15T12:24:24.284255+0000","last_fullsized":"2024-09-15T12:24:24.284255+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":135,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.297184+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:24:24.297184+0000","last_peered":"2024-09-15T12:24:24.297184+0000","last_clean":"2024-09-15T12:24:24.297184+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:24:24.297184+0000","last_undegraded":"2024-09-15T12:24:24.297184+0000","last_fullsized":"2024-09-15T12:24:24.297184+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.287155+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:24:24.287155+0000","last_peered":"2024-09-15T12:24:24.287155+0000","last_clean":"2024-09-15T12:24:24.287155+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:24:24.287155+0000","last_undegraded":"2024-09-15T12:24:24.287155+0000","last_fullsized":"2024-09-15T12:24:24.287155+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.294001+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:24:24.294001+0000","last_peered":"2024-09-15T12:24:24.294001+0000","last_clean":"2024-09-15T12:24:24.294001+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:24:24.294001+0000","last_undegraded":"2024-09-15T12:24:24.294001+0000","last_fullsized":"2024-09-15T12:24:24.294001+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.269819+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:24:24.269819+0000","last_peered":"2024-09-15T12:24:24.269819+0000","last_clean":"2024-09-15T12:24:24.269819+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:24:24.269819+0000","last_undegraded":"2024-09-15T12:24:24.269819+0000","last_fullsized":"2024-09-15T12:24:24.269819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:25:18.278836+0000","last_change":"2024-09-15T12:25:18.278836+0000","last_active":"2024-09-15T12:25:18.278836+0000","last_peered":"2024-09-15T12:25:18.278836+0000","last_clean":"2024-09-15T12:25:18.278836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:25:18.278836+0000","last_undegraded":"2024-09-15T12:25:18.278836+0000","last_fullsized":"2024-09-15T12:25:18.278836+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":133,"reported_epoch":54,"state":"active+clean","last_fresh":"2024-09-15T12:24:24.335125+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:24:24.335125+0000","last_peered":"2024-09-15T12:24:24.335125+0000","last_clean":"2024-09-15T12:24:24.335125+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:24:24.335125+0000","last_undegraded":"2024-09-15T12:24:24.335125+0000","last_fullsized":"2024-09-15T12:24:24.335125+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673349,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73916,"kb_used_data":2664,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94297924,"statfs":{"total":96636764160,"available":96561074176,"internally_reserved":0,"allocated":2727936,"data_stored":36209130,"data_compressed":1713624,"data_compressed_allocated":2256896,"data_compressed_original":36028416,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706053,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":73944,"kb_used_data":2696,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94297896,"statfs":{"total":96636764160,"available":96561045504,"internally_reserved":0,"allocated":2760704,"data_stored":36602389,"data_compressed":1732296,"data_compressed_allocated":2281472,"data_compressed_original":36421632,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706053,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70320,"kb_used_data":3232,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94301520,"statfs":{"total":96636764160,"available":96564756480,"internally_reserved":0,"allocated":3309568,"data_stored":45776885,"data_compressed":2165952,"data_compressed_allocated":2850816,"data_compressed_original":45613056,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706053,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74292,"kb_used_data":3044,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94297548,"statfs":{"total":96636764160,"available":96560689152,"internally_reserved":0,"allocated":3117056,"data_stored":42304021,"data_compressed":2003040,"data_compressed_allocated":2637824,"data_compressed_original":42123264,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:25:40.772 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:25:40.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:40.921+0000 7fa07dac8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:40.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:40.930+0000 7fa07dac8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:41.381 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 21 16 4526 4510 13.4214 13.5625 0.091941 0.0744067 2024-09-15T12:25:42.381 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 22 16 4737 4721 13.4108 13.1875 0.0485486 0.0744493 2024-09-15T12:25:43.236 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:25:43.381 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 23 16 4941 4925 13.382 12.75 0.0899043 0.0746084 2024-09-15T12:25:43.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:43.391+0000 7f886f591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:43.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:43.400+0000 7f886f591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:43.576 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:25:43.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:43.743+0000 7f00f3efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:43.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:43.754+0000 7f00f3efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:44.120 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:25:44.121 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:25:44.145 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":266,"stamp":"2024-09-15T12:25:43.785585+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":290259507,"num_objects":4424,"num_object_clones":0,"num_object_copies":13272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4501,"num_write_kb":283988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4475,"ondisk_log_size":4475,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":362212,"kb_used_data":53604,"kb_used_omap":0,"kb_used_meta":308544,"kb_avail":377125148,"statfs":{"total":386547056640,"available":386176151552,"internally_reserved":0,"allocated":54890496,"data_stored":844345021,"data_compressed":40060406,"data_compressed_allocated":52736000,"data_compressed_original":843530240,"omap_allocated":0,"internal_metadata":315949056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":289669120,"num_objects":4420,"num_object_clones":0,"num_object_copies":13260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4420,"num_write_kb":282880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.510325"},"pg_stats":[{"pgid":"5.f","version":"62'270","reported_seq":294,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.679349+0000","last_change":"2024-09-15T12:25:19.440663+0000","last_active":"2024-09-15T12:25:40.679349+0000","last_peered":"2024-09-15T12:25:40.679349+0000","last_clean":"2024-09-15T12:25:40.679349+0000","last_became_active":"2024-09-15T12:25:19.421824+0000","last_became_peered":"2024-09-15T12:25:19.421824+0000","last_unstale":"2024-09-15T12:25:40.679349+0000","last_undegraded":"2024-09-15T12:25:40.679349+0000","last_fullsized":"2024-09-15T12:25:40.679349+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17694720,"num_objects":270,"num_object_clones":0,"num_object_copies":810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":17280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"62'268","reported_seq":292,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.668579+0000","last_change":"2024-09-15T12:25:19.444566+0000","last_active":"2024-09-15T12:25:40.668579+0000","last_peered":"2024-09-15T12:25:40.668579+0000","last_clean":"2024-09-15T12:25:40.668579+0000","last_became_active":"2024-09-15T12:25:19.436490+0000","last_became_peered":"2024-09-15T12:25:19.436490+0000","last_unstale":"2024-09-15T12:25:40.668579+0000","last_undegraded":"2024-09-15T12:25:40.668579+0000","last_fullsized":"2024-09-15T12:25:40.668579+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17563648,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":268,"num_write_kb":17152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"62'265","reported_seq":289,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.749331+0000","last_change":"2024-09-15T12:25:19.466585+0000","last_active":"2024-09-15T12:25:40.749331+0000","last_peered":"2024-09-15T12:25:40.749331+0000","last_clean":"2024-09-15T12:25:40.749331+0000","last_became_active":"2024-09-15T12:25:19.449036+0000","last_became_peered":"2024-09-15T12:25:19.449036+0000","last_unstale":"2024-09-15T12:25:40.749331+0000","last_undegraded":"2024-09-15T12:25:40.749331+0000","last_fullsized":"2024-09-15T12:25:40.749331+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17367040,"num_objects":265,"num_object_clones":0,"num_object_copies":795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":265,"num_write_kb":16960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"62'327","reported_seq":351,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:41.679122+0000","last_change":"2024-09-15T12:25:19.412052+0000","last_active":"2024-09-15T12:25:41.679122+0000","last_peered":"2024-09-15T12:25:41.679122+0000","last_clean":"2024-09-15T12:25:41.679122+0000","last_became_active":"2024-09-15T12:25:19.396072+0000","last_became_peered":"2024-09-15T12:25:19.396072+0000","last_unstale":"2024-09-15T12:25:41.679122+0000","last_undegraded":"2024-09-15T12:25:41.679122+0000","last_fullsized":"2024-09-15T12:25:41.679122+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21430272,"num_objects":327,"num_object_clones":0,"num_object_copies":981,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":327,"num_write_kb":20928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"62'262","reported_seq":286,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.502078+0000","last_change":"2024-09-15T12:25:19.447319+0000","last_active":"2024-09-15T12:25:40.502078+0000","last_peered":"2024-09-15T12:25:40.502078+0000","last_clean":"2024-09-15T12:25:40.502078+0000","last_became_active":"2024-09-15T12:25:19.436362+0000","last_became_peered":"2024-09-15T12:25:19.436362+0000","last_unstale":"2024-09-15T12:25:40.502078+0000","last_undegraded":"2024-09-15T12:25:40.502078+0000","last_fullsized":"2024-09-15T12:25:40.502078+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17170432,"num_objects":262,"num_object_clones":0,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":262,"num_write_kb":16768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"62'287","reported_seq":311,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.642733+0000","last_change":"2024-09-15T12:25:19.475504+0000","last_active":"2024-09-15T12:25:40.642733+0000","last_peered":"2024-09-15T12:25:40.642733+0000","last_clean":"2024-09-15T12:25:40.642733+0000","last_became_active":"2024-09-15T12:25:19.467940+0000","last_became_peered":"2024-09-15T12:25:19.467940+0000","last_unstale":"2024-09-15T12:25:40.642733+0000","last_undegraded":"2024-09-15T12:25:40.642733+0000","last_fullsized":"2024-09-15T12:25:40.642733+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18808832,"num_objects":287,"num_object_clones":0,"num_object_copies":861,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":287,"num_write_kb":18368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"62'254","reported_seq":278,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.641918+0000","last_change":"2024-09-15T12:25:19.403222+0000","last_active":"2024-09-15T12:25:40.641918+0000","last_peered":"2024-09-15T12:25:40.641918+0000","last_clean":"2024-09-15T12:25:40.641918+0000","last_became_active":"2024-09-15T12:25:19.396442+0000","last_became_peered":"2024-09-15T12:25:19.396442+0000","last_unstale":"2024-09-15T12:25:40.641918+0000","last_undegraded":"2024-09-15T12:25:40.641918+0000","last_fullsized":"2024-09-15T12:25:40.641918+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16646144,"num_objects":254,"num_object_clones":0,"num_object_copies":762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":254,"num_write_kb":16256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"62'266","reported_seq":290,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.641971+0000","last_change":"2024-09-15T12:25:19.418093+0000","last_active":"2024-09-15T12:25:40.641971+0000","last_peered":"2024-09-15T12:25:40.641971+0000","last_clean":"2024-09-15T12:25:40.641971+0000","last_became_active":"2024-09-15T12:25:19.412762+0000","last_became_peered":"2024-09-15T12:25:19.412762+0000","last_unstale":"2024-09-15T12:25:40.641971+0000","last_undegraded":"2024-09-15T12:25:40.641971+0000","last_fullsized":"2024-09-15T12:25:40.641971+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17432576,"num_objects":266,"num_object_clones":0,"num_object_copies":798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":17024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"62'266","reported_seq":290,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.402829+0000","last_change":"2024-09-15T12:25:19.514099+0000","last_active":"2024-09-15T12:25:40.402829+0000","last_peered":"2024-09-15T12:25:40.402829+0000","last_clean":"2024-09-15T12:25:40.402829+0000","last_became_active":"2024-09-15T12:25:19.506892+0000","last_became_peered":"2024-09-15T12:25:19.506892+0000","last_unstale":"2024-09-15T12:25:40.402829+0000","last_undegraded":"2024-09-15T12:25:40.402829+0000","last_fullsized":"2024-09-15T12:25:40.402829+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17432576,"num_objects":266,"num_object_clones":0,"num_object_copies":798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":17024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":229,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:38.317805+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:25:38.317805+0000","last_peered":"2024-09-15T12:25:38.317805+0000","last_clean":"2024-09-15T12:25:38.317805+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:25:38.317805+0000","last_undegraded":"2024-09-15T12:25:38.317805+0000","last_fullsized":"2024-09-15T12:25:38.317805+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":158,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:38.320028+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:25:38.320028+0000","last_peered":"2024-09-15T12:25:38.320028+0000","last_clean":"2024-09-15T12:25:38.320028+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:25:38.320028+0000","last_undegraded":"2024-09-15T12:25:38.320028+0000","last_fullsized":"2024-09-15T12:25:38.320028+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"62'258","reported_seq":282,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.399547+0000","last_change":"2024-09-15T12:25:19.470256+0000","last_active":"2024-09-15T12:25:40.399547+0000","last_peered":"2024-09-15T12:25:40.399547+0000","last_clean":"2024-09-15T12:25:40.399547+0000","last_became_active":"2024-09-15T12:25:19.458317+0000","last_became_peered":"2024-09-15T12:25:19.458317+0000","last_unstale":"2024-09-15T12:25:40.399547+0000","last_undegraded":"2024-09-15T12:25:40.399547+0000","last_fullsized":"2024-09-15T12:25:40.399547+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16908288,"num_objects":258,"num_object_clones":0,"num_object_copies":774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":258,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":157,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:38.380195+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:25:38.380195+0000","last_peered":"2024-09-15T12:25:38.380195+0000","last_clean":"2024-09-15T12:25:38.380195+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:25:38.380195+0000","last_undegraded":"2024-09-15T12:25:38.380195+0000","last_fullsized":"2024-09-15T12:25:38.380195+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"62'249","reported_seq":273,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.496197+0000","last_change":"2024-09-15T12:25:19.478666+0000","last_active":"2024-09-15T12:25:40.496197+0000","last_peered":"2024-09-15T12:25:40.496197+0000","last_clean":"2024-09-15T12:25:40.496197+0000","last_became_active":"2024-09-15T12:25:19.468663+0000","last_became_peered":"2024-09-15T12:25:19.468663+0000","last_unstale":"2024-09-15T12:25:40.496197+0000","last_undegraded":"2024-09-15T12:25:40.496197+0000","last_fullsized":"2024-09-15T12:25:40.496197+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16318464,"num_objects":249,"num_object_clones":0,"num_object_copies":747,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":249,"num_write_kb":15936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":157,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:38.316599+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:25:38.316599+0000","last_peered":"2024-09-15T12:25:38.316599+0000","last_clean":"2024-09-15T12:25:38.316599+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:25:38.316599+0000","last_undegraded":"2024-09-15T12:25:38.316599+0000","last_fullsized":"2024-09-15T12:25:38.316599+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"62'280","reported_seq":304,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.724060+0000","last_change":"2024-09-15T12:25:19.499536+0000","last_active":"2024-09-15T12:25:40.724060+0000","last_peered":"2024-09-15T12:25:40.724060+0000","last_clean":"2024-09-15T12:25:40.724060+0000","last_became_active":"2024-09-15T12:25:19.493017+0000","last_became_peered":"2024-09-15T12:25:19.493017+0000","last_unstale":"2024-09-15T12:25:40.724060+0000","last_undegraded":"2024-09-15T12:25:40.724060+0000","last_fullsized":"2024-09-15T12:25:40.724060+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18350080,"num_objects":280,"num_object_clones":0,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":17920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":159,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:38.379730+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:25:38.379730+0000","last_peered":"2024-09-15T12:25:38.379730+0000","last_clean":"2024-09-15T12:25:38.379730+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:25:38.379730+0000","last_undegraded":"2024-09-15T12:25:38.379730+0000","last_fullsized":"2024-09-15T12:25:38.379730+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"62'296","reported_seq":320,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.681696+0000","last_change":"2024-09-15T12:25:19.413209+0000","last_active":"2024-09-15T12:25:40.681696+0000","last_peered":"2024-09-15T12:25:40.681696+0000","last_clean":"2024-09-15T12:25:40.681696+0000","last_became_active":"2024-09-15T12:25:19.403123+0000","last_became_peered":"2024-09-15T12:25:19.403123+0000","last_unstale":"2024-09-15T12:25:40.681696+0000","last_undegraded":"2024-09-15T12:25:40.681696+0000","last_fullsized":"2024-09-15T12:25:40.681696+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19398656,"num_objects":296,"num_object_clones":0,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":18944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":157,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:38.320169+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:25:38.320169+0000","last_peered":"2024-09-15T12:25:38.320169+0000","last_clean":"2024-09-15T12:25:38.320169+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:25:38.320169+0000","last_undegraded":"2024-09-15T12:25:38.320169+0000","last_fullsized":"2024-09-15T12:25:38.320169+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"62'304","reported_seq":328,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.674969+0000","last_change":"2024-09-15T12:25:19.429640+0000","last_active":"2024-09-15T12:25:40.674969+0000","last_peered":"2024-09-15T12:25:40.674969+0000","last_clean":"2024-09-15T12:25:40.674969+0000","last_became_active":"2024-09-15T12:25:19.422585+0000","last_became_peered":"2024-09-15T12:25:19.422585+0000","last_unstale":"2024-09-15T12:25:40.674969+0000","last_undegraded":"2024-09-15T12:25:40.674969+0000","last_fullsized":"2024-09-15T12:25:40.674969+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19922944,"num_objects":304,"num_object_clones":0,"num_object_copies":912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":19456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":157,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:38.322590+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:25:38.322590+0000","last_peered":"2024-09-15T12:25:38.322590+0000","last_clean":"2024-09-15T12:25:38.322590+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:25:38.322590+0000","last_undegraded":"2024-09-15T12:25:38.322590+0000","last_fullsized":"2024-09-15T12:25:38.322590+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"62'292","reported_seq":316,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:41.588687+0000","last_change":"2024-09-15T12:25:19.429532+0000","last_active":"2024-09-15T12:25:41.588687+0000","last_peered":"2024-09-15T12:25:41.588687+0000","last_clean":"2024-09-15T12:25:41.588687+0000","last_became_active":"2024-09-15T12:25:19.424570+0000","last_became_peered":"2024-09-15T12:25:19.424570+0000","last_unstale":"2024-09-15T12:25:41.588687+0000","last_undegraded":"2024-09-15T12:25:41.588687+0000","last_fullsized":"2024-09-15T12:25:41.588687+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19136512,"num_objects":292,"num_object_clones":0,"num_object_copies":876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":292,"num_write_kb":18688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":157,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:38.319527+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:25:38.319527+0000","last_peered":"2024-09-15T12:25:38.319527+0000","last_clean":"2024-09-15T12:25:38.319527+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:25:38.319527+0000","last_undegraded":"2024-09-15T12:25:38.319527+0000","last_fullsized":"2024-09-15T12:25:38.319527+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"62'276","reported_seq":300,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.370091+0000","last_change":"2024-09-15T12:25:19.453184+0000","last_active":"2024-09-15T12:25:40.370091+0000","last_peered":"2024-09-15T12:25:40.370091+0000","last_clean":"2024-09-15T12:25:40.370091+0000","last_became_active":"2024-09-15T12:25:19.441520+0000","last_became_peered":"2024-09-15T12:25:19.441520+0000","last_unstale":"2024-09-15T12:25:40.370091+0000","last_undegraded":"2024-09-15T12:25:40.370091+0000","last_fullsized":"2024-09-15T12:25:40.370091+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18087936,"num_objects":276,"num_object_clones":0,"num_object_copies":828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":17664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":157,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:38.319106+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:25:38.319106+0000","last_peered":"2024-09-15T12:25:38.319106+0000","last_clean":"2024-09-15T12:25:38.319106+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:25:38.319106+0000","last_undegraded":"2024-09-15T12:25:38.319106+0000","last_fullsized":"2024-09-15T12:25:38.319106+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":289669120,"num_objects":4420,"num_object_clones":0,"num_object_copies":13260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4420,"num_write_kb":282880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":54464512,"data_stored":871432192,"data_compressed":41376934,"data_compressed_allocated":54464512,"data_compressed_original":871432192,"omap_allocated":0,"internal_metadata":0},"log_size":4420,"ondisk_log_size":4420,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673378,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":102160,"kb_used_data":12864,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94269680,"statfs":{"total":96636764160,"available":96532152320,"internally_reserved":0,"allocated":13172736,"data_stored":202239017,"data_compressed":9595594,"data_compressed_allocated":12632064,"data_compressed_original":202031104,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706083,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86992,"kb_used_data":15744,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94284848,"statfs":{"total":96636764160,"available":96547684352,"internally_reserved":0,"allocated":16121856,"data_stored":249359420,"data_compressed":11832880,"data_compressed_allocated":15577088,"data_compressed_original":249151488,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706082,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":92084,"kb_used_data":11108,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94279756,"statfs":{"total":96636764160,"available":96542470144,"internally_reserved":0,"allocated":11374592,"data_stored":173795868,"data_compressed":8242944,"data_compressed_allocated":10850304,"data_compressed_original":173604864,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706082,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":80976,"kb_used_data":13888,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94290864,"statfs":{"total":96636764160,"available":96553844736,"internally_reserved":0,"allocated":14221312,"data_stored":218950716,"data_compressed":10388988,"data_compressed_allocated":13676544,"data_compressed_original":218742784,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14356480,"data_stored":229703680,"data_compressed":10906668,"data_compressed_allocated":14356480,"data_compressed_original":229703680,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11341824,"data_stored":181469184,"data_compressed":8616384,"data_compressed_allocated":11341824,"data_compressed_original":181469184,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15630336,"data_stored":250085376,"data_compressed":11874424,"data_compressed_allocated":15630336,"data_compressed_original":250085376,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13135872,"data_stored":210173952,"data_compressed":9979458,"data_compressed_allocated":13135872,"data_compressed_original":210173952,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:25:44.147 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-15T12:25:44.147 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:25:44.147 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:25:44.147 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:25:44.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:44.304+0000 7f191f391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:44.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:44.322+0000 7f191f391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:44.381 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 24 16 5150 5134 13.3686 13.0625 0.0851419 0.0746543 2024-09-15T12:25:44.396 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:25:44.396 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:25:44.396 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:25:44.397 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:25:44.397 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:25:44.397 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:25:44.397 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:25:44.397 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:25:44.397 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:25:44.397 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:25:44.397 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:25:44.397 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:25:44.400 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:25:44.401 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:25:44.402 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:25:44.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:44.564+0000 7f37c3191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:44.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:44.581+0000 7f37c3191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:44.655 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:25:44.656 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:25:44.656 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:25:44.656 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:25:44.656 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:25:44.656 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:25:44.656 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:25:44.656 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:25:44.656 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:25:44.656 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:25:44.656 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:25:44.656 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:25:44.660 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:25:44.660 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:25:44.660 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:25:44.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:44.821+0000 7f876acd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:44.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:44.839+0000 7f876acd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:44.918 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:25:44.918 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:25:44.918 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:25:44.918 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:25:44.918 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:25:44.918 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:25:44.918 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:25:44.918 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:25:44.918 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:25:44.918 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:25:44.918 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:25:44.918 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:25:44.922 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:25:44.922 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:25:44.922 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:25:45.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:45.089+0000 7f3c1caac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:45.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:45.107+0000 7f3c1caac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:45.150 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:25:45.150 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:25:45.150 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:25:45.150 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:25:45.150 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:25:45.150 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:25:45.150 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:25:45.150 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:25:45.150 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:25:45.150 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:25:45.150 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:25:45.151 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:25:45.155 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:25:45.155 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:25:45.381 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 25 16 5362 5346 13.3638 13.25 0.101331 0.0746592 2024-09-15T12:25:45.708 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:25:45.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:45.853+0000 7f950bd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:45.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:45.864+0000 7f950bd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:46.381 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 26 16 5566 5550 13.3402 12.75 0.0255086 0.074803 2024-09-15T12:25:47.381 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 27 16 5794 5778 13.3738 14.25 0.0587504 0.074698 2024-09-15T12:25:48.177 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:25:48.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:48.327+0000 7f89b4f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:48.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:48.339+0000 7f89b4f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:48.381 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 28 16 5999 5983 13.3537 12.8125 0.0836173 0.0747422 2024-09-15T12:25:49.381 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 29 16 6195 6179 13.3156 12.25 0.074105 0.074945 2024-09-15T12:25:50.156 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:25:50.156 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:25:50.157 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:25:50.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:50.308+0000 7fb1c5791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:50.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:50.323+0000 7fb1c5791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:50.382 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 30 16 6402 6386 13.303 12.9375 0.107132 0.0750236 2024-09-15T12:25:50.633 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:25:50.633 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:25:50.654 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":269,"stamp":"2024-09-15T12:25:49.786749+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":290259507,"num_objects":4424,"num_object_clones":0,"num_object_copies":13272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4501,"num_write_kb":283988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4475,"ondisk_log_size":4475,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":362212,"kb_used_data":53604,"kb_used_omap":0,"kb_used_meta":308544,"kb_avail":377125148,"statfs":{"total":386547056640,"available":386176151552,"internally_reserved":0,"allocated":54890496,"data_stored":844345021,"data_compressed":40060406,"data_compressed_allocated":52736000,"data_compressed_original":843530240,"omap_allocated":0,"internal_metadata":315949056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":289669120,"num_objects":4420,"num_object_clones":0,"num_object_copies":13260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4420,"num_write_kb":282880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.502571"},"pg_stats":[{"pgid":"5.f","version":"62'270","reported_seq":294,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.679349+0000","last_change":"2024-09-15T12:25:19.440663+0000","last_active":"2024-09-15T12:25:40.679349+0000","last_peered":"2024-09-15T12:25:40.679349+0000","last_clean":"2024-09-15T12:25:40.679349+0000","last_became_active":"2024-09-15T12:25:19.421824+0000","last_became_peered":"2024-09-15T12:25:19.421824+0000","last_unstale":"2024-09-15T12:25:40.679349+0000","last_undegraded":"2024-09-15T12:25:40.679349+0000","last_fullsized":"2024-09-15T12:25:40.679349+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17694720,"num_objects":270,"num_object_clones":0,"num_object_copies":810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":17280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"62'268","reported_seq":292,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.668579+0000","last_change":"2024-09-15T12:25:19.444566+0000","last_active":"2024-09-15T12:25:40.668579+0000","last_peered":"2024-09-15T12:25:40.668579+0000","last_clean":"2024-09-15T12:25:40.668579+0000","last_became_active":"2024-09-15T12:25:19.436490+0000","last_became_peered":"2024-09-15T12:25:19.436490+0000","last_unstale":"2024-09-15T12:25:40.668579+0000","last_undegraded":"2024-09-15T12:25:40.668579+0000","last_fullsized":"2024-09-15T12:25:40.668579+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17563648,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":268,"num_write_kb":17152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"62'265","reported_seq":289,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.749331+0000","last_change":"2024-09-15T12:25:19.466585+0000","last_active":"2024-09-15T12:25:40.749331+0000","last_peered":"2024-09-15T12:25:40.749331+0000","last_clean":"2024-09-15T12:25:40.749331+0000","last_became_active":"2024-09-15T12:25:19.449036+0000","last_became_peered":"2024-09-15T12:25:19.449036+0000","last_unstale":"2024-09-15T12:25:40.749331+0000","last_undegraded":"2024-09-15T12:25:40.749331+0000","last_fullsized":"2024-09-15T12:25:40.749331+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17367040,"num_objects":265,"num_object_clones":0,"num_object_copies":795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":265,"num_write_kb":16960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"62'327","reported_seq":351,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:41.679122+0000","last_change":"2024-09-15T12:25:19.412052+0000","last_active":"2024-09-15T12:25:41.679122+0000","last_peered":"2024-09-15T12:25:41.679122+0000","last_clean":"2024-09-15T12:25:41.679122+0000","last_became_active":"2024-09-15T12:25:19.396072+0000","last_became_peered":"2024-09-15T12:25:19.396072+0000","last_unstale":"2024-09-15T12:25:41.679122+0000","last_undegraded":"2024-09-15T12:25:41.679122+0000","last_fullsized":"2024-09-15T12:25:41.679122+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21430272,"num_objects":327,"num_object_clones":0,"num_object_copies":981,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":327,"num_write_kb":20928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"62'262","reported_seq":286,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.502078+0000","last_change":"2024-09-15T12:25:19.447319+0000","last_active":"2024-09-15T12:25:40.502078+0000","last_peered":"2024-09-15T12:25:40.502078+0000","last_clean":"2024-09-15T12:25:40.502078+0000","last_became_active":"2024-09-15T12:25:19.436362+0000","last_became_peered":"2024-09-15T12:25:19.436362+0000","last_unstale":"2024-09-15T12:25:40.502078+0000","last_undegraded":"2024-09-15T12:25:40.502078+0000","last_fullsized":"2024-09-15T12:25:40.502078+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17170432,"num_objects":262,"num_object_clones":0,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":262,"num_write_kb":16768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"62'287","reported_seq":311,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.642733+0000","last_change":"2024-09-15T12:25:19.475504+0000","last_active":"2024-09-15T12:25:40.642733+0000","last_peered":"2024-09-15T12:25:40.642733+0000","last_clean":"2024-09-15T12:25:40.642733+0000","last_became_active":"2024-09-15T12:25:19.467940+0000","last_became_peered":"2024-09-15T12:25:19.467940+0000","last_unstale":"2024-09-15T12:25:40.642733+0000","last_undegraded":"2024-09-15T12:25:40.642733+0000","last_fullsized":"2024-09-15T12:25:40.642733+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18808832,"num_objects":287,"num_object_clones":0,"num_object_copies":861,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":287,"num_write_kb":18368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"62'254","reported_seq":278,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.641918+0000","last_change":"2024-09-15T12:25:19.403222+0000","last_active":"2024-09-15T12:25:40.641918+0000","last_peered":"2024-09-15T12:25:40.641918+0000","last_clean":"2024-09-15T12:25:40.641918+0000","last_became_active":"2024-09-15T12:25:19.396442+0000","last_became_peered":"2024-09-15T12:25:19.396442+0000","last_unstale":"2024-09-15T12:25:40.641918+0000","last_undegraded":"2024-09-15T12:25:40.641918+0000","last_fullsized":"2024-09-15T12:25:40.641918+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16646144,"num_objects":254,"num_object_clones":0,"num_object_copies":762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":254,"num_write_kb":16256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"62'266","reported_seq":290,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.641971+0000","last_change":"2024-09-15T12:25:19.418093+0000","last_active":"2024-09-15T12:25:40.641971+0000","last_peered":"2024-09-15T12:25:40.641971+0000","last_clean":"2024-09-15T12:25:40.641971+0000","last_became_active":"2024-09-15T12:25:19.412762+0000","last_became_peered":"2024-09-15T12:25:19.412762+0000","last_unstale":"2024-09-15T12:25:40.641971+0000","last_undegraded":"2024-09-15T12:25:40.641971+0000","last_fullsized":"2024-09-15T12:25:40.641971+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17432576,"num_objects":266,"num_object_clones":0,"num_object_copies":798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":17024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"62'266","reported_seq":290,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.402829+0000","last_change":"2024-09-15T12:25:19.514099+0000","last_active":"2024-09-15T12:25:40.402829+0000","last_peered":"2024-09-15T12:25:40.402829+0000","last_clean":"2024-09-15T12:25:40.402829+0000","last_became_active":"2024-09-15T12:25:19.506892+0000","last_became_peered":"2024-09-15T12:25:19.506892+0000","last_unstale":"2024-09-15T12:25:40.402829+0000","last_undegraded":"2024-09-15T12:25:40.402829+0000","last_fullsized":"2024-09-15T12:25:40.402829+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17432576,"num_objects":266,"num_object_clones":0,"num_object_copies":798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":17024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":229,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:38.317805+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:25:38.317805+0000","last_peered":"2024-09-15T12:25:38.317805+0000","last_clean":"2024-09-15T12:25:38.317805+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:25:38.317805+0000","last_undegraded":"2024-09-15T12:25:38.317805+0000","last_fullsized":"2024-09-15T12:25:38.317805+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":158,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:38.320028+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:25:38.320028+0000","last_peered":"2024-09-15T12:25:38.320028+0000","last_clean":"2024-09-15T12:25:38.320028+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:25:38.320028+0000","last_undegraded":"2024-09-15T12:25:38.320028+0000","last_fullsized":"2024-09-15T12:25:38.320028+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"62'258","reported_seq":282,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.399547+0000","last_change":"2024-09-15T12:25:19.470256+0000","last_active":"2024-09-15T12:25:40.399547+0000","last_peered":"2024-09-15T12:25:40.399547+0000","last_clean":"2024-09-15T12:25:40.399547+0000","last_became_active":"2024-09-15T12:25:19.458317+0000","last_became_peered":"2024-09-15T12:25:19.458317+0000","last_unstale":"2024-09-15T12:25:40.399547+0000","last_undegraded":"2024-09-15T12:25:40.399547+0000","last_fullsized":"2024-09-15T12:25:40.399547+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16908288,"num_objects":258,"num_object_clones":0,"num_object_copies":774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":258,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":157,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:38.380195+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:25:38.380195+0000","last_peered":"2024-09-15T12:25:38.380195+0000","last_clean":"2024-09-15T12:25:38.380195+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:25:38.380195+0000","last_undegraded":"2024-09-15T12:25:38.380195+0000","last_fullsized":"2024-09-15T12:25:38.380195+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"62'249","reported_seq":273,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.496197+0000","last_change":"2024-09-15T12:25:19.478666+0000","last_active":"2024-09-15T12:25:40.496197+0000","last_peered":"2024-09-15T12:25:40.496197+0000","last_clean":"2024-09-15T12:25:40.496197+0000","last_became_active":"2024-09-15T12:25:19.468663+0000","last_became_peered":"2024-09-15T12:25:19.468663+0000","last_unstale":"2024-09-15T12:25:40.496197+0000","last_undegraded":"2024-09-15T12:25:40.496197+0000","last_fullsized":"2024-09-15T12:25:40.496197+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16318464,"num_objects":249,"num_object_clones":0,"num_object_copies":747,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":249,"num_write_kb":15936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":157,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:38.316599+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:25:38.316599+0000","last_peered":"2024-09-15T12:25:38.316599+0000","last_clean":"2024-09-15T12:25:38.316599+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:25:38.316599+0000","last_undegraded":"2024-09-15T12:25:38.316599+0000","last_fullsized":"2024-09-15T12:25:38.316599+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"62'280","reported_seq":304,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.724060+0000","last_change":"2024-09-15T12:25:19.499536+0000","last_active":"2024-09-15T12:25:40.724060+0000","last_peered":"2024-09-15T12:25:40.724060+0000","last_clean":"2024-09-15T12:25:40.724060+0000","last_became_active":"2024-09-15T12:25:19.493017+0000","last_became_peered":"2024-09-15T12:25:19.493017+0000","last_unstale":"2024-09-15T12:25:40.724060+0000","last_undegraded":"2024-09-15T12:25:40.724060+0000","last_fullsized":"2024-09-15T12:25:40.724060+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18350080,"num_objects":280,"num_object_clones":0,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":17920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":159,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:38.379730+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:25:38.379730+0000","last_peered":"2024-09-15T12:25:38.379730+0000","last_clean":"2024-09-15T12:25:38.379730+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:25:38.379730+0000","last_undegraded":"2024-09-15T12:25:38.379730+0000","last_fullsized":"2024-09-15T12:25:38.379730+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"62'296","reported_seq":320,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.681696+0000","last_change":"2024-09-15T12:25:19.413209+0000","last_active":"2024-09-15T12:25:40.681696+0000","last_peered":"2024-09-15T12:25:40.681696+0000","last_clean":"2024-09-15T12:25:40.681696+0000","last_became_active":"2024-09-15T12:25:19.403123+0000","last_became_peered":"2024-09-15T12:25:19.403123+0000","last_unstale":"2024-09-15T12:25:40.681696+0000","last_undegraded":"2024-09-15T12:25:40.681696+0000","last_fullsized":"2024-09-15T12:25:40.681696+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19398656,"num_objects":296,"num_object_clones":0,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":18944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":157,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:38.320169+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:25:38.320169+0000","last_peered":"2024-09-15T12:25:38.320169+0000","last_clean":"2024-09-15T12:25:38.320169+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:25:38.320169+0000","last_undegraded":"2024-09-15T12:25:38.320169+0000","last_fullsized":"2024-09-15T12:25:38.320169+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"62'304","reported_seq":328,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.674969+0000","last_change":"2024-09-15T12:25:19.429640+0000","last_active":"2024-09-15T12:25:40.674969+0000","last_peered":"2024-09-15T12:25:40.674969+0000","last_clean":"2024-09-15T12:25:40.674969+0000","last_became_active":"2024-09-15T12:25:19.422585+0000","last_became_peered":"2024-09-15T12:25:19.422585+0000","last_unstale":"2024-09-15T12:25:40.674969+0000","last_undegraded":"2024-09-15T12:25:40.674969+0000","last_fullsized":"2024-09-15T12:25:40.674969+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19922944,"num_objects":304,"num_object_clones":0,"num_object_copies":912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":19456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":157,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:38.322590+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:25:38.322590+0000","last_peered":"2024-09-15T12:25:38.322590+0000","last_clean":"2024-09-15T12:25:38.322590+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:25:38.322590+0000","last_undegraded":"2024-09-15T12:25:38.322590+0000","last_fullsized":"2024-09-15T12:25:38.322590+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"62'292","reported_seq":316,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:41.588687+0000","last_change":"2024-09-15T12:25:19.429532+0000","last_active":"2024-09-15T12:25:41.588687+0000","last_peered":"2024-09-15T12:25:41.588687+0000","last_clean":"2024-09-15T12:25:41.588687+0000","last_became_active":"2024-09-15T12:25:19.424570+0000","last_became_peered":"2024-09-15T12:25:19.424570+0000","last_unstale":"2024-09-15T12:25:41.588687+0000","last_undegraded":"2024-09-15T12:25:41.588687+0000","last_fullsized":"2024-09-15T12:25:41.588687+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19136512,"num_objects":292,"num_object_clones":0,"num_object_copies":876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":292,"num_write_kb":18688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":157,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:38.319527+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:25:38.319527+0000","last_peered":"2024-09-15T12:25:38.319527+0000","last_clean":"2024-09-15T12:25:38.319527+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:25:38.319527+0000","last_undegraded":"2024-09-15T12:25:38.319527+0000","last_fullsized":"2024-09-15T12:25:38.319527+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"62'276","reported_seq":300,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.370091+0000","last_change":"2024-09-15T12:25:19.453184+0000","last_active":"2024-09-15T12:25:40.370091+0000","last_peered":"2024-09-15T12:25:40.370091+0000","last_clean":"2024-09-15T12:25:40.370091+0000","last_became_active":"2024-09-15T12:25:19.441520+0000","last_became_peered":"2024-09-15T12:25:19.441520+0000","last_unstale":"2024-09-15T12:25:40.370091+0000","last_undegraded":"2024-09-15T12:25:40.370091+0000","last_fullsized":"2024-09-15T12:25:40.370091+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18087936,"num_objects":276,"num_object_clones":0,"num_object_copies":828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":17664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":157,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:38.319106+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:25:38.319106+0000","last_peered":"2024-09-15T12:25:38.319106+0000","last_clean":"2024-09-15T12:25:38.319106+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:25:38.319106+0000","last_undegraded":"2024-09-15T12:25:38.319106+0000","last_fullsized":"2024-09-15T12:25:38.319106+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":289669120,"num_objects":4420,"num_object_clones":0,"num_object_copies":13260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4420,"num_write_kb":282880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":54464512,"data_stored":871432192,"data_compressed":41376934,"data_compressed_allocated":54464512,"data_compressed_original":871432192,"omap_allocated":0,"internal_metadata":0},"log_size":4420,"ondisk_log_size":4420,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673378,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":102160,"kb_used_data":12864,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94269680,"statfs":{"total":96636764160,"available":96532152320,"internally_reserved":0,"allocated":13172736,"data_stored":202239017,"data_compressed":9595594,"data_compressed_allocated":12632064,"data_compressed_original":202031104,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706083,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86992,"kb_used_data":15744,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94284848,"statfs":{"total":96636764160,"available":96547684352,"internally_reserved":0,"allocated":16121856,"data_stored":249359420,"data_compressed":11832880,"data_compressed_allocated":15577088,"data_compressed_original":249151488,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706082,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":92084,"kb_used_data":11108,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94279756,"statfs":{"total":96636764160,"available":96542470144,"internally_reserved":0,"allocated":11374592,"data_stored":173795868,"data_compressed":8242944,"data_compressed_allocated":10850304,"data_compressed_original":173604864,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706082,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":80976,"kb_used_data":13888,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94290864,"statfs":{"total":96636764160,"available":96553844736,"internally_reserved":0,"allocated":14221312,"data_stored":218950716,"data_compressed":10388988,"data_compressed_allocated":13676544,"data_compressed_original":218742784,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14356480,"data_stored":229703680,"data_compressed":10906668,"data_compressed_allocated":14356480,"data_compressed_original":229703680,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11341824,"data_stored":181469184,"data_compressed":8616384,"data_compressed_allocated":11341824,"data_compressed_original":181469184,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15630336,"data_stored":250085376,"data_compressed":11874424,"data_compressed_allocated":15630336,"data_compressed_original":250085376,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13135872,"data_stored":210173952,"data_compressed":9979458,"data_compressed_allocated":13135872,"data_compressed_original":210173952,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:25:50.667 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:25:50.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:50.817+0000 7fd0fd8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:50.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:50.831+0000 7fd0fd8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:51.382 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 31 16 6603 6587 13.2791 12.5625 0.0412637 0.0751803 2024-09-15T12:25:52.383 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 32 16 6819 6803 13.2855 13.5 0.0533546 0.0751808 2024-09-15T12:25:53.095 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:25:53.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:53.255+0000 7fe12fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:53.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:53.266+0000 7fe12fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:53.383 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 33 16 7023 7007 13.2692 12.75 0.100534 0.0752612 2024-09-15T12:25:54.383 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 34 16 7233 7217 13.265 13.125 0.0680858 0.0752505 2024-09-15T12:25:55.383 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 35 16 7434 7418 13.2449 12.5625 0.0628025 0.0754106 2024-09-15T12:25:55.587 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:25:55.656 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:25:55.656 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:25:55.656 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:25:55.656 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:25:55.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:55.749+0000 7fec67a74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:55.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:55.758+0000 7fec67a74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:55.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:55.813+0000 7f002125c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:55.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:55.830+0000 7f002125c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:56.077 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:25:56.077 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:25:56.077 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:25:56.077 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:25:56.077 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:25:56.077 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:25:56.077 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:25:56.077 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:25:56.077 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:25:56.077 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:25:56.078 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:25:56.078 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:25:56.081 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:25:56.082 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:25:56.082 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:25:56.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:56.270+0000 7f0725b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:56.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:56.289+0000 7f0725b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:56.371 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:25:56.371 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:25:56.371 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:25:56.371 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:25:56.371 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:25:56.371 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:25:56.371 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:25:56.371 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:25:56.372 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:25:56.372 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:25:56.372 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:25:56.372 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:25:56.376 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:25:56.376 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:25:56.376 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:25:56.383 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 36 16 7635 7619 13.2259 12.5625 0.0722473 0.0755184 2024-09-15T12:25:56.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:56.506+0000 7f2334b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:56.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:56.522+0000 7f2334b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:56.650 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:25:56.651 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:25:56.651 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:25:56.651 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:25:56.651 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:25:56.651 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:25:56.651 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:25:56.651 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:25:56.651 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:25:56.651 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:25:56.651 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:25:56.651 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:25:56.654 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:25:56.654 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:25:56.655 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:25:56.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:56.843+0000 7fa06d85a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:56.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:56.858+0000 7fa06d85a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:56.935 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:25:56.936 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:25:56.936 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:25:56.936 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:25:56.936 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:25:56.936 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:25:56.936 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:25:56.936 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:25:56.936 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:25:56.936 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:25:56.936 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:25:56.936 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:25:56.940 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:25:56.941 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:25:57.383 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 37 16 7830 7814 13.1978 12.1875 0.0858815 0.0756658 2024-09-15T12:25:58.068 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:25:58.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:58.223+0000 7fc853646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:58.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:25:58.231+0000 7fc853646640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:25:58.383 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 38 16 8032 8016 13.1827 12.625 0.0780529 0.0757688 2024-09-15T12:25:59.383 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 39 16 8233 8217 13.1667 12.5625 0.0527704 0.0758659 2024-09-15T12:26:00.384 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:2024-09-15T12:26:00.383304+0000 min lat: 0.0157862 max lat: 0.16893 avg lat: 0.0761736 2024-09-15T12:26:00.384 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-15T12:26:00.384 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 40 16 8410 8394 13.1141 11.0625 0.0747743 0.0761736 2024-09-15T12:26:00.494 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:26:00.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:00.651+0000 7f23f0297640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:00.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:00.662+0000 7f23f0297640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:01.384 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 41 16 8596 8580 13.0778 11.625 0.0661741 0.0764099 2024-09-15T12:26:01.941 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:26:01.941 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:26:01.942 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:26:02.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:02.102+0000 7f7bb8cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:02.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:02.118+0000 7f7bb8cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:02.384 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 42 16 8801 8785 13.0714 12.8125 0.0530792 0.0764315 2024-09-15T12:26:02.446 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:26:02.446 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:26:02.470 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":275,"stamp":"2024-09-15T12:26:01.789097+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":290259507,"num_objects":4424,"num_object_clones":0,"num_object_copies":13272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":4501,"num_write_kb":283988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4475,"ondisk_log_size":4475,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":362212,"kb_used_data":53604,"kb_used_omap":0,"kb_used_meta":308544,"kb_avail":377125148,"statfs":{"total":386547056640,"available":386176151552,"internally_reserved":0,"allocated":54890496,"data_stored":844345021,"data_compressed":40060406,"data_compressed_allocated":52736000,"data_compressed_original":843530240,"omap_allocated":0,"internal_metadata":315949056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002347"},"pg_stats":[{"pgid":"5.f","version":"62'270","reported_seq":294,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.679349+0000","last_change":"2024-09-15T12:25:19.440663+0000","last_active":"2024-09-15T12:25:40.679349+0000","last_peered":"2024-09-15T12:25:40.679349+0000","last_clean":"2024-09-15T12:25:40.679349+0000","last_became_active":"2024-09-15T12:25:19.421824+0000","last_became_peered":"2024-09-15T12:25:19.421824+0000","last_unstale":"2024-09-15T12:25:40.679349+0000","last_undegraded":"2024-09-15T12:25:40.679349+0000","last_fullsized":"2024-09-15T12:25:40.679349+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17694720,"num_objects":270,"num_object_clones":0,"num_object_copies":810,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":17280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"62'268","reported_seq":292,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.668579+0000","last_change":"2024-09-15T12:25:19.444566+0000","last_active":"2024-09-15T12:25:40.668579+0000","last_peered":"2024-09-15T12:25:40.668579+0000","last_clean":"2024-09-15T12:25:40.668579+0000","last_became_active":"2024-09-15T12:25:19.436490+0000","last_became_peered":"2024-09-15T12:25:19.436490+0000","last_unstale":"2024-09-15T12:25:40.668579+0000","last_undegraded":"2024-09-15T12:25:40.668579+0000","last_fullsized":"2024-09-15T12:25:40.668579+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17563648,"num_objects":268,"num_object_clones":0,"num_object_copies":804,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":268,"num_write_kb":17152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"62'265","reported_seq":289,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.749331+0000","last_change":"2024-09-15T12:25:19.466585+0000","last_active":"2024-09-15T12:25:40.749331+0000","last_peered":"2024-09-15T12:25:40.749331+0000","last_clean":"2024-09-15T12:25:40.749331+0000","last_became_active":"2024-09-15T12:25:19.449036+0000","last_became_peered":"2024-09-15T12:25:19.449036+0000","last_unstale":"2024-09-15T12:25:40.749331+0000","last_undegraded":"2024-09-15T12:25:40.749331+0000","last_fullsized":"2024-09-15T12:25:40.749331+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":265,"log_dups_size":0,"ondisk_log_size":265,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17367040,"num_objects":265,"num_object_clones":0,"num_object_copies":795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":265,"num_write_kb":16960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"62'327","reported_seq":351,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:41.679122+0000","last_change":"2024-09-15T12:25:19.412052+0000","last_active":"2024-09-15T12:25:41.679122+0000","last_peered":"2024-09-15T12:25:41.679122+0000","last_clean":"2024-09-15T12:25:41.679122+0000","last_became_active":"2024-09-15T12:25:19.396072+0000","last_became_peered":"2024-09-15T12:25:19.396072+0000","last_unstale":"2024-09-15T12:25:41.679122+0000","last_undegraded":"2024-09-15T12:25:41.679122+0000","last_fullsized":"2024-09-15T12:25:41.679122+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21430272,"num_objects":327,"num_object_clones":0,"num_object_copies":981,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":327,"num_write_kb":20928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"62'262","reported_seq":286,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.502078+0000","last_change":"2024-09-15T12:25:19.447319+0000","last_active":"2024-09-15T12:25:40.502078+0000","last_peered":"2024-09-15T12:25:40.502078+0000","last_clean":"2024-09-15T12:25:40.502078+0000","last_became_active":"2024-09-15T12:25:19.436362+0000","last_became_peered":"2024-09-15T12:25:19.436362+0000","last_unstale":"2024-09-15T12:25:40.502078+0000","last_undegraded":"2024-09-15T12:25:40.502078+0000","last_fullsized":"2024-09-15T12:25:40.502078+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17170432,"num_objects":262,"num_object_clones":0,"num_object_copies":786,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":262,"num_write_kb":16768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"62'287","reported_seq":311,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.642733+0000","last_change":"2024-09-15T12:25:19.475504+0000","last_active":"2024-09-15T12:25:40.642733+0000","last_peered":"2024-09-15T12:25:40.642733+0000","last_clean":"2024-09-15T12:25:40.642733+0000","last_became_active":"2024-09-15T12:25:19.467940+0000","last_became_peered":"2024-09-15T12:25:19.467940+0000","last_unstale":"2024-09-15T12:25:40.642733+0000","last_undegraded":"2024-09-15T12:25:40.642733+0000","last_fullsized":"2024-09-15T12:25:40.642733+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18808832,"num_objects":287,"num_object_clones":0,"num_object_copies":861,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":287,"num_write_kb":18368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"62'254","reported_seq":278,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.641918+0000","last_change":"2024-09-15T12:25:19.403222+0000","last_active":"2024-09-15T12:25:40.641918+0000","last_peered":"2024-09-15T12:25:40.641918+0000","last_clean":"2024-09-15T12:25:40.641918+0000","last_became_active":"2024-09-15T12:25:19.396442+0000","last_became_peered":"2024-09-15T12:25:19.396442+0000","last_unstale":"2024-09-15T12:25:40.641918+0000","last_undegraded":"2024-09-15T12:25:40.641918+0000","last_fullsized":"2024-09-15T12:25:40.641918+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16646144,"num_objects":254,"num_object_clones":0,"num_object_copies":762,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":254,"num_write_kb":16256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"62'266","reported_seq":290,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.641971+0000","last_change":"2024-09-15T12:25:19.418093+0000","last_active":"2024-09-15T12:25:40.641971+0000","last_peered":"2024-09-15T12:25:40.641971+0000","last_clean":"2024-09-15T12:25:40.641971+0000","last_became_active":"2024-09-15T12:25:19.412762+0000","last_became_peered":"2024-09-15T12:25:19.412762+0000","last_unstale":"2024-09-15T12:25:40.641971+0000","last_undegraded":"2024-09-15T12:25:40.641971+0000","last_fullsized":"2024-09-15T12:25:40.641971+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17432576,"num_objects":266,"num_object_clones":0,"num_object_copies":798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":17024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"62'266","reported_seq":290,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.402829+0000","last_change":"2024-09-15T12:25:19.514099+0000","last_active":"2024-09-15T12:25:40.402829+0000","last_peered":"2024-09-15T12:25:40.402829+0000","last_clean":"2024-09-15T12:25:40.402829+0000","last_became_active":"2024-09-15T12:25:19.506892+0000","last_became_peered":"2024-09-15T12:25:19.506892+0000","last_unstale":"2024-09-15T12:25:40.402829+0000","last_undegraded":"2024-09-15T12:25:40.402829+0000","last_fullsized":"2024-09-15T12:25:40.402829+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17432576,"num_objects":266,"num_object_clones":0,"num_object_copies":798,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":266,"num_write_kb":17024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":229,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:38.317805+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:25:38.317805+0000","last_peered":"2024-09-15T12:25:38.317805+0000","last_clean":"2024-09-15T12:25:38.317805+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:25:38.317805+0000","last_undegraded":"2024-09-15T12:25:38.317805+0000","last_fullsized":"2024-09-15T12:25:38.317805+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":158,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:38.320028+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:25:38.320028+0000","last_peered":"2024-09-15T12:25:38.320028+0000","last_clean":"2024-09-15T12:25:38.320028+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:25:38.320028+0000","last_undegraded":"2024-09-15T12:25:38.320028+0000","last_fullsized":"2024-09-15T12:25:38.320028+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"62'258","reported_seq":282,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.399547+0000","last_change":"2024-09-15T12:25:19.470256+0000","last_active":"2024-09-15T12:25:40.399547+0000","last_peered":"2024-09-15T12:25:40.399547+0000","last_clean":"2024-09-15T12:25:40.399547+0000","last_became_active":"2024-09-15T12:25:19.458317+0000","last_became_peered":"2024-09-15T12:25:19.458317+0000","last_unstale":"2024-09-15T12:25:40.399547+0000","last_undegraded":"2024-09-15T12:25:40.399547+0000","last_fullsized":"2024-09-15T12:25:40.399547+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16908288,"num_objects":258,"num_object_clones":0,"num_object_copies":774,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":258,"num_write_kb":16512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":157,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:38.380195+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:25:38.380195+0000","last_peered":"2024-09-15T12:25:38.380195+0000","last_clean":"2024-09-15T12:25:38.380195+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:25:38.380195+0000","last_undegraded":"2024-09-15T12:25:38.380195+0000","last_fullsized":"2024-09-15T12:25:38.380195+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"62'249","reported_seq":273,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.496197+0000","last_change":"2024-09-15T12:25:19.478666+0000","last_active":"2024-09-15T12:25:40.496197+0000","last_peered":"2024-09-15T12:25:40.496197+0000","last_clean":"2024-09-15T12:25:40.496197+0000","last_became_active":"2024-09-15T12:25:19.468663+0000","last_became_peered":"2024-09-15T12:25:19.468663+0000","last_unstale":"2024-09-15T12:25:40.496197+0000","last_undegraded":"2024-09-15T12:25:40.496197+0000","last_fullsized":"2024-09-15T12:25:40.496197+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16318464,"num_objects":249,"num_object_clones":0,"num_object_copies":747,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":249,"num_write_kb":15936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":157,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:38.316599+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:25:38.316599+0000","last_peered":"2024-09-15T12:25:38.316599+0000","last_clean":"2024-09-15T12:25:38.316599+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:25:38.316599+0000","last_undegraded":"2024-09-15T12:25:38.316599+0000","last_fullsized":"2024-09-15T12:25:38.316599+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"62'280","reported_seq":304,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.724060+0000","last_change":"2024-09-15T12:25:19.499536+0000","last_active":"2024-09-15T12:25:40.724060+0000","last_peered":"2024-09-15T12:25:40.724060+0000","last_clean":"2024-09-15T12:25:40.724060+0000","last_became_active":"2024-09-15T12:25:19.493017+0000","last_became_peered":"2024-09-15T12:25:19.493017+0000","last_unstale":"2024-09-15T12:25:40.724060+0000","last_undegraded":"2024-09-15T12:25:40.724060+0000","last_fullsized":"2024-09-15T12:25:40.724060+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18350080,"num_objects":280,"num_object_clones":0,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":17920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":159,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:38.379730+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:25:38.379730+0000","last_peered":"2024-09-15T12:25:38.379730+0000","last_clean":"2024-09-15T12:25:38.379730+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:25:38.379730+0000","last_undegraded":"2024-09-15T12:25:38.379730+0000","last_fullsized":"2024-09-15T12:25:38.379730+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"62'296","reported_seq":320,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.681696+0000","last_change":"2024-09-15T12:25:19.413209+0000","last_active":"2024-09-15T12:25:40.681696+0000","last_peered":"2024-09-15T12:25:40.681696+0000","last_clean":"2024-09-15T12:25:40.681696+0000","last_became_active":"2024-09-15T12:25:19.403123+0000","last_became_peered":"2024-09-15T12:25:19.403123+0000","last_unstale":"2024-09-15T12:25:40.681696+0000","last_undegraded":"2024-09-15T12:25:40.681696+0000","last_fullsized":"2024-09-15T12:25:40.681696+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19398656,"num_objects":296,"num_object_clones":0,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":296,"num_write_kb":18944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":157,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:38.320169+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:25:38.320169+0000","last_peered":"2024-09-15T12:25:38.320169+0000","last_clean":"2024-09-15T12:25:38.320169+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:25:38.320169+0000","last_undegraded":"2024-09-15T12:25:38.320169+0000","last_fullsized":"2024-09-15T12:25:38.320169+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"62'304","reported_seq":328,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.674969+0000","last_change":"2024-09-15T12:25:19.429640+0000","last_active":"2024-09-15T12:25:40.674969+0000","last_peered":"2024-09-15T12:25:40.674969+0000","last_clean":"2024-09-15T12:25:40.674969+0000","last_became_active":"2024-09-15T12:25:19.422585+0000","last_became_peered":"2024-09-15T12:25:19.422585+0000","last_unstale":"2024-09-15T12:25:40.674969+0000","last_undegraded":"2024-09-15T12:25:40.674969+0000","last_fullsized":"2024-09-15T12:25:40.674969+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19922944,"num_objects":304,"num_object_clones":0,"num_object_copies":912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":304,"num_write_kb":19456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":157,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:38.322590+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:25:38.322590+0000","last_peered":"2024-09-15T12:25:38.322590+0000","last_clean":"2024-09-15T12:25:38.322590+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:25:38.322590+0000","last_undegraded":"2024-09-15T12:25:38.322590+0000","last_fullsized":"2024-09-15T12:25:38.322590+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"62'292","reported_seq":316,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:41.588687+0000","last_change":"2024-09-15T12:25:19.429532+0000","last_active":"2024-09-15T12:25:41.588687+0000","last_peered":"2024-09-15T12:25:41.588687+0000","last_clean":"2024-09-15T12:25:41.588687+0000","last_became_active":"2024-09-15T12:25:19.424570+0000","last_became_peered":"2024-09-15T12:25:19.424570+0000","last_unstale":"2024-09-15T12:25:41.588687+0000","last_undegraded":"2024-09-15T12:25:41.588687+0000","last_fullsized":"2024-09-15T12:25:41.588687+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19136512,"num_objects":292,"num_object_clones":0,"num_object_copies":876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":292,"num_write_kb":18688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":157,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:38.319527+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:25:38.319527+0000","last_peered":"2024-09-15T12:25:38.319527+0000","last_clean":"2024-09-15T12:25:38.319527+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:25:38.319527+0000","last_undegraded":"2024-09-15T12:25:38.319527+0000","last_fullsized":"2024-09-15T12:25:38.319527+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"62'276","reported_seq":300,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:40.370091+0000","last_change":"2024-09-15T12:25:19.453184+0000","last_active":"2024-09-15T12:25:40.370091+0000","last_peered":"2024-09-15T12:25:40.370091+0000","last_clean":"2024-09-15T12:25:40.370091+0000","last_became_active":"2024-09-15T12:25:19.441520+0000","last_became_peered":"2024-09-15T12:25:19.441520+0000","last_unstale":"2024-09-15T12:25:40.370091+0000","last_undegraded":"2024-09-15T12:25:40.370091+0000","last_fullsized":"2024-09-15T12:25:40.370091+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18087936,"num_objects":276,"num_object_clones":0,"num_object_copies":828,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":17664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":157,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-09-15T12:25:38.319106+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:25:38.319106+0000","last_peered":"2024-09-15T12:25:38.319106+0000","last_clean":"2024-09-15T12:25:38.319106+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:25:38.319106+0000","last_undegraded":"2024-09-15T12:25:38.319106+0000","last_fullsized":"2024-09-15T12:25:38.319106+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":289669120,"num_objects":4420,"num_object_clones":0,"num_object_copies":13260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4420,"num_write_kb":282880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":54464512,"data_stored":871432192,"data_compressed":41376934,"data_compressed_allocated":54464512,"data_compressed_original":871432192,"omap_allocated":0,"internal_metadata":0},"log_size":4420,"ondisk_log_size":4420,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673378,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":102160,"kb_used_data":12864,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94269680,"statfs":{"total":96636764160,"available":96532152320,"internally_reserved":0,"allocated":13172736,"data_stored":202239017,"data_compressed":9595594,"data_compressed_allocated":12632064,"data_compressed_original":202031104,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706083,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86992,"kb_used_data":15744,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94284848,"statfs":{"total":96636764160,"available":96547684352,"internally_reserved":0,"allocated":16121856,"data_stored":249359420,"data_compressed":11832880,"data_compressed_allocated":15577088,"data_compressed_original":249151488,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706082,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":92084,"kb_used_data":11108,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94279756,"statfs":{"total":96636764160,"available":96542470144,"internally_reserved":0,"allocated":11374592,"data_stored":173795868,"data_compressed":8242944,"data_compressed_allocated":10850304,"data_compressed_original":173604864,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706082,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":80976,"kb_used_data":13888,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94290864,"statfs":{"total":96636764160,"available":96553844736,"internally_reserved":0,"allocated":14221312,"data_stored":218950716,"data_compressed":10388988,"data_compressed_allocated":13676544,"data_compressed_original":218742784,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14356480,"data_stored":229703680,"data_compressed":10906668,"data_compressed_allocated":14356480,"data_compressed_original":229703680,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11341824,"data_stored":181469184,"data_compressed":8616384,"data_compressed_allocated":11341824,"data_compressed_original":181469184,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15630336,"data_stored":250085376,"data_compressed":11874424,"data_compressed_allocated":15630336,"data_compressed_original":250085376,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13135872,"data_stored":210173952,"data_compressed":9979458,"data_compressed_allocated":13135872,"data_compressed_original":210173952,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:26:02.975 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:26:03.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:03.130+0000 7fe777f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:03.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:03.139+0000 7fe777f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:03.384 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 43 16 8996 8980 13.0508 12.1875 0.0631601 0.076518 2024-09-15T12:26:04.384 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 44 16 9188 9172 13.0269 12 0.0688602 0.0766925 2024-09-15T12:26:05.384 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 45 16 9369 9353 12.9888 11.3125 0.0864367 0.0769162 2024-09-15T12:26:05.551 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:26:05.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:05.717+0000 7fd8a3b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:05.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:05.727+0000 7fd8a3b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:06.384 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 46 16 9571 9555 12.9809 12.625 0.0833728 0.0768892 2024-09-15T12:26:07.384 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 47 16 9773 9757 12.9733 12.625 0.0397739 0.0770009 2024-09-15T12:26:07.473 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:26:07.473 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-15T12:26:07.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:07.627+0000 7f5152b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:07.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:07.641+0000 7f5152b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:07.990 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:26:08.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:08.165+0000 7ff76b551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:08.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:08.177+0000 7ff76b551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:08.384 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 48 16 9968 9952 12.9569 12.1875 0.0711518 0.0771064 2024-09-15T12:26:08.847 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.0 to 1 (10000) 2024-09-15T12:26:08.867 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-15T12:26:09.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:09.028+0000 7f875af11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:09.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:09.044+0000 7f875af11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:09.384 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 49 16 10157 10141 12.9335 11.8125 0.101642 0.0772617 2024-09-15T12:26:09.848 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.1 to 1 (10000) 2024-09-15T12:26:09.870 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-15T12:26:10.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:10.020+0000 7f16d5391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:10.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:10.034+0000 7f16d5391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:10.384 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 50 16 10339 10323 12.9023 11.375 0.133406 0.0773743 2024-09-15T12:26:10.466 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:26:10.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:10.616+0000 7fe0cf191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:10.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:10.625+0000 7fe0cf191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:10.855 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.2 to 1 (10000) 2024-09-15T12:26:10.876 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-15T12:26:11.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:11.022+0000 7f8619ec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:11.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:11.042+0000 7f8619ec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:11.385 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 51 16 10514 10498 12.8638 10.9375 0.052211 0.0776702 2024-09-15T12:26:11.865 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.3 to 1 (10000) 2024-09-15T12:26:11.889 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-15T12:26:11.889 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:26:12.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:12.039+0000 7f42de711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:12.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:12.051+0000 7f42de711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:12.385 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 52 16 10708 10692 12.8496 12.125 0.100684 0.0777367 2024-09-15T12:26:12.415 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:26:12.415 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:26:12.435 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-09-15T12:26:11.864090+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":683737651,"num_objects":10428,"num_object_clones":0,"num_object_copies":31284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":10505,"num_write_kb":668244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10479,"ondisk_log_size":10479,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":457004,"kb_used_data":126188,"kb_used_omap":0,"kb_used_meta":330752,"kb_avail":377030356,"statfs":{"total":386547056640,"available":386079084544,"internally_reserved":0,"allocated":129216512,"data_stored":2032666684,"data_compressed":96487190,"data_compressed_allocated":127004672,"data_compressed_original":2031828992,"omap_allocated":0,"internal_metadata":338690048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":393478144,"num_objects":6004,"num_object_clones":0,"num_object_copies":18012,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6004,"num_write_kb":384256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.073743"},"pg_stats":[{"pgid":"5.f","version":"64'660","reported_seq":690,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.509944+0000","last_change":"2024-09-15T12:25:19.440663+0000","last_active":"2024-09-15T12:26:10.509944+0000","last_peered":"2024-09-15T12:26:10.509944+0000","last_clean":"2024-09-15T12:26:10.509944+0000","last_became_active":"2024-09-15T12:25:19.421824+0000","last_became_peered":"2024-09-15T12:25:19.421824+0000","last_unstale":"2024-09-15T12:26:10.509944+0000","last_undegraded":"2024-09-15T12:26:10.509944+0000","last_fullsized":"2024-09-15T12:26:10.509944+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43253760,"num_objects":660,"num_object_clones":0,"num_object_copies":1980,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":660,"num_write_kb":42240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"64'646","reported_seq":676,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.697483+0000","last_change":"2024-09-15T12:25:19.444566+0000","last_active":"2024-09-15T12:26:10.697483+0000","last_peered":"2024-09-15T12:26:10.697483+0000","last_clean":"2024-09-15T12:26:10.697483+0000","last_became_active":"2024-09-15T12:25:19.436490+0000","last_became_peered":"2024-09-15T12:25:19.436490+0000","last_unstale":"2024-09-15T12:26:10.697483+0000","last_undegraded":"2024-09-15T12:26:10.697483+0000","last_fullsized":"2024-09-15T12:26:10.697483+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42336256,"num_objects":646,"num_object_clones":0,"num_object_copies":1938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":41344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"64'635","reported_seq":665,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.736938+0000","last_change":"2024-09-15T12:25:19.466585+0000","last_active":"2024-09-15T12:26:10.736938+0000","last_peered":"2024-09-15T12:26:10.736938+0000","last_clean":"2024-09-15T12:26:10.736938+0000","last_became_active":"2024-09-15T12:25:19.449036+0000","last_became_peered":"2024-09-15T12:25:19.449036+0000","last_unstale":"2024-09-15T12:26:10.736938+0000","last_undegraded":"2024-09-15T12:26:10.736938+0000","last_fullsized":"2024-09-15T12:26:10.736938+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41615360,"num_objects":635,"num_object_clones":0,"num_object_copies":1905,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":635,"num_write_kb":40640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"65'708","reported_seq":741,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T12:26:11.770322+0000","last_change":"2024-09-15T12:25:19.412052+0000","last_active":"2024-09-15T12:26:11.770322+0000","last_peered":"2024-09-15T12:26:11.770322+0000","last_clean":"2024-09-15T12:26:11.770322+0000","last_became_active":"2024-09-15T12:25:19.396072+0000","last_became_peered":"2024-09-15T12:25:19.396072+0000","last_unstale":"2024-09-15T12:26:11.770322+0000","last_undegraded":"2024-09-15T12:26:11.770322+0000","last_fullsized":"2024-09-15T12:26:11.770322+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46399488,"num_objects":708,"num_object_clones":0,"num_object_copies":2124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":45312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"64'626","reported_seq":656,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.684970+0000","last_change":"2024-09-15T12:25:19.447319+0000","last_active":"2024-09-15T12:26:10.684970+0000","last_peered":"2024-09-15T12:26:10.684970+0000","last_clean":"2024-09-15T12:26:10.684970+0000","last_became_active":"2024-09-15T12:25:19.436362+0000","last_became_peered":"2024-09-15T12:25:19.436362+0000","last_unstale":"2024-09-15T12:26:10.684970+0000","last_undegraded":"2024-09-15T12:26:10.684970+0000","last_fullsized":"2024-09-15T12:26:10.684970+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41025536,"num_objects":626,"num_object_clones":0,"num_object_copies":1878,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":626,"num_write_kb":40064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"64'651","reported_seq":681,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.752744+0000","last_change":"2024-09-15T12:25:19.475504+0000","last_active":"2024-09-15T12:26:10.752744+0000","last_peered":"2024-09-15T12:26:10.752744+0000","last_clean":"2024-09-15T12:26:10.752744+0000","last_became_active":"2024-09-15T12:25:19.467940+0000","last_became_peered":"2024-09-15T12:25:19.467940+0000","last_unstale":"2024-09-15T12:26:10.752744+0000","last_undegraded":"2024-09-15T12:26:10.752744+0000","last_fullsized":"2024-09-15T12:26:10.752744+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42663936,"num_objects":651,"num_object_clones":0,"num_object_copies":1953,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":651,"num_write_kb":41664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"64'628","reported_seq":658,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.655597+0000","last_change":"2024-09-15T12:25:19.403222+0000","last_active":"2024-09-15T12:26:10.655597+0000","last_peered":"2024-09-15T12:26:10.655597+0000","last_clean":"2024-09-15T12:26:10.655597+0000","last_became_active":"2024-09-15T12:25:19.396442+0000","last_became_peered":"2024-09-15T12:25:19.396442+0000","last_unstale":"2024-09-15T12:26:10.655597+0000","last_undegraded":"2024-09-15T12:26:10.655597+0000","last_fullsized":"2024-09-15T12:26:10.655597+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41156608,"num_objects":628,"num_object_clones":0,"num_object_copies":1884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":40192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"64'669","reported_seq":699,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.481357+0000","last_change":"2024-09-15T12:25:19.418093+0000","last_active":"2024-09-15T12:26:10.481357+0000","last_peered":"2024-09-15T12:26:10.481357+0000","last_clean":"2024-09-15T12:26:10.481357+0000","last_became_active":"2024-09-15T12:25:19.412762+0000","last_became_peered":"2024-09-15T12:25:19.412762+0000","last_unstale":"2024-09-15T12:26:10.481357+0000","last_undegraded":"2024-09-15T12:26:10.481357+0000","last_fullsized":"2024-09-15T12:26:10.481357+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43843584,"num_objects":669,"num_object_clones":0,"num_object_copies":2007,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":669,"num_write_kb":42816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"64'630","reported_seq":660,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.604228+0000","last_change":"2024-09-15T12:25:19.514099+0000","last_active":"2024-09-15T12:26:10.604228+0000","last_peered":"2024-09-15T12:26:10.604228+0000","last_clean":"2024-09-15T12:26:10.604228+0000","last_became_active":"2024-09-15T12:25:19.506892+0000","last_became_peered":"2024-09-15T12:25:19.506892+0000","last_unstale":"2024-09-15T12:26:10.604228+0000","last_undegraded":"2024-09-15T12:26:10.604228+0000","last_fullsized":"2024-09-15T12:26:10.604228+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41287680,"num_objects":630,"num_object_clones":0,"num_object_copies":1890,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":630,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":238,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.895525+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:26:10.895525+0000","last_peered":"2024-09-15T12:26:10.895525+0000","last_clean":"2024-09-15T12:26:10.895525+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:26:10.895525+0000","last_undegraded":"2024-09-15T12:26:10.895525+0000","last_fullsized":"2024-09-15T12:26:10.895525+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":164,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.894505+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:26:09.894505+0000","last_peered":"2024-09-15T12:26:09.894505+0000","last_clean":"2024-09-15T12:26:09.894505+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:26:09.894505+0000","last_undegraded":"2024-09-15T12:26:09.894505+0000","last_fullsized":"2024-09-15T12:26:09.894505+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"64'661","reported_seq":691,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.654211+0000","last_change":"2024-09-15T12:25:19.470256+0000","last_active":"2024-09-15T12:26:10.654211+0000","last_peered":"2024-09-15T12:26:10.654211+0000","last_clean":"2024-09-15T12:26:10.654211+0000","last_became_active":"2024-09-15T12:25:19.458317+0000","last_became_peered":"2024-09-15T12:25:19.458317+0000","last_unstale":"2024-09-15T12:26:10.654211+0000","last_undegraded":"2024-09-15T12:26:10.654211+0000","last_fullsized":"2024-09-15T12:26:10.654211+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43319296,"num_objects":661,"num_object_clones":0,"num_object_copies":1983,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":661,"num_write_kb":42304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.906459+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:26:09.906459+0000","last_peered":"2024-09-15T12:26:09.906459+0000","last_clean":"2024-09-15T12:26:09.906459+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:26:09.906459+0000","last_undegraded":"2024-09-15T12:26:09.906459+0000","last_fullsized":"2024-09-15T12:26:09.906459+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"64'648","reported_seq":678,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.651943+0000","last_change":"2024-09-15T12:25:19.478666+0000","last_active":"2024-09-15T12:26:10.651943+0000","last_peered":"2024-09-15T12:26:10.651943+0000","last_clean":"2024-09-15T12:26:10.651943+0000","last_became_active":"2024-09-15T12:25:19.468663+0000","last_became_peered":"2024-09-15T12:25:19.468663+0000","last_unstale":"2024-09-15T12:26:10.651943+0000","last_undegraded":"2024-09-15T12:26:10.651943+0000","last_fullsized":"2024-09-15T12:26:10.651943+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42467328,"num_objects":648,"num_object_clones":0,"num_object_copies":1944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":41472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.888896+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:26:09.888896+0000","last_peered":"2024-09-15T12:26:09.888896+0000","last_clean":"2024-09-15T12:26:09.888896+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:26:09.888896+0000","last_undegraded":"2024-09-15T12:26:09.888896+0000","last_fullsized":"2024-09-15T12:26:09.888896+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"64'667","reported_seq":697,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.547549+0000","last_change":"2024-09-15T12:25:19.499536+0000","last_active":"2024-09-15T12:26:10.547549+0000","last_peered":"2024-09-15T12:26:10.547549+0000","last_clean":"2024-09-15T12:26:10.547549+0000","last_became_active":"2024-09-15T12:25:19.493017+0000","last_became_peered":"2024-09-15T12:25:19.493017+0000","last_unstale":"2024-09-15T12:26:10.547549+0000","last_undegraded":"2024-09-15T12:26:10.547549+0000","last_fullsized":"2024-09-15T12:26:10.547549+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43712512,"num_objects":667,"num_object_clones":0,"num_object_copies":2001,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":667,"num_write_kb":42688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":165,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.900992+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:26:09.900992+0000","last_peered":"2024-09-15T12:26:09.900992+0000","last_clean":"2024-09-15T12:26:09.900992+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:26:09.900992+0000","last_undegraded":"2024-09-15T12:26:09.900992+0000","last_fullsized":"2024-09-15T12:26:09.900992+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"64'631","reported_seq":661,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.555976+0000","last_change":"2024-09-15T12:25:19.413209+0000","last_active":"2024-09-15T12:26:10.555976+0000","last_peered":"2024-09-15T12:26:10.555976+0000","last_clean":"2024-09-15T12:26:10.555976+0000","last_became_active":"2024-09-15T12:25:19.403123+0000","last_became_peered":"2024-09-15T12:25:19.403123+0000","last_unstale":"2024-09-15T12:26:10.555976+0000","last_undegraded":"2024-09-15T12:26:10.555976+0000","last_fullsized":"2024-09-15T12:26:10.555976+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41353216,"num_objects":631,"num_object_clones":0,"num_object_copies":1893,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":631,"num_write_kb":40384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.896505+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:26:09.896505+0000","last_peered":"2024-09-15T12:26:09.896505+0000","last_clean":"2024-09-15T12:26:09.896505+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:26:09.896505+0000","last_undegraded":"2024-09-15T12:26:09.896505+0000","last_fullsized":"2024-09-15T12:26:09.896505+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"64'689","reported_seq":719,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.537739+0000","last_change":"2024-09-15T12:25:19.429640+0000","last_active":"2024-09-15T12:26:10.537739+0000","last_peered":"2024-09-15T12:26:10.537739+0000","last_clean":"2024-09-15T12:26:10.537739+0000","last_became_active":"2024-09-15T12:25:19.422585+0000","last_became_peered":"2024-09-15T12:25:19.422585+0000","last_unstale":"2024-09-15T12:26:10.537739+0000","last_undegraded":"2024-09-15T12:26:10.537739+0000","last_fullsized":"2024-09-15T12:26:10.537739+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":689,"log_dups_size":0,"ondisk_log_size":689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45154304,"num_objects":689,"num_object_clones":0,"num_object_copies":2067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":689,"num_write_kb":44096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":166,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.899315+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:26:10.899315+0000","last_peered":"2024-09-15T12:26:10.899315+0000","last_clean":"2024-09-15T12:26:10.899315+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:26:10.899315+0000","last_undegraded":"2024-09-15T12:26:10.899315+0000","last_fullsized":"2024-09-15T12:26:10.899315+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"65'659","reported_seq":692,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T12:26:11.767587+0000","last_change":"2024-09-15T12:25:19.429532+0000","last_active":"2024-09-15T12:26:11.767587+0000","last_peered":"2024-09-15T12:26:11.767587+0000","last_clean":"2024-09-15T12:26:11.767587+0000","last_became_active":"2024-09-15T12:25:19.424570+0000","last_became_peered":"2024-09-15T12:25:19.424570+0000","last_unstale":"2024-09-15T12:26:11.767587+0000","last_undegraded":"2024-09-15T12:26:11.767587+0000","last_fullsized":"2024-09-15T12:26:11.767587+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43188224,"num_objects":659,"num_object_clones":0,"num_object_copies":1977,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":659,"num_write_kb":42176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.893033+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:26:09.893033+0000","last_peered":"2024-09-15T12:26:09.893033+0000","last_clean":"2024-09-15T12:26:09.893033+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:26:09.893033+0000","last_undegraded":"2024-09-15T12:26:09.893033+0000","last_fullsized":"2024-09-15T12:26:09.893033+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"64'616","reported_seq":646,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.601230+0000","last_change":"2024-09-15T12:25:19.453184+0000","last_active":"2024-09-15T12:26:10.601230+0000","last_peered":"2024-09-15T12:26:10.601230+0000","last_clean":"2024-09-15T12:26:10.601230+0000","last_became_active":"2024-09-15T12:25:19.441520+0000","last_became_peered":"2024-09-15T12:25:19.441520+0000","last_unstale":"2024-09-15T12:26:10.601230+0000","last_undegraded":"2024-09-15T12:26:10.601230+0000","last_fullsized":"2024-09-15T12:26:10.601230+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40370176,"num_objects":616,"num_object_clones":0,"num_object_copies":1848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.894930+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:26:09.894930+0000","last_peered":"2024-09-15T12:26:09.894930+0000","last_clean":"2024-09-15T12:26:09.894930+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:26:09.894930+0000","last_undegraded":"2024-09-15T12:26:09.894930+0000","last_fullsized":"2024-09-15T12:26:09.894930+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":683147264,"num_objects":10424,"num_object_clones":0,"num_object_copies":31272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10424,"num_write_kb":667136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":128323584,"data_stored":2053177344,"data_compressed":97492518,"data_compressed_allocated":128323584,"data_compressed_original":2053177344,"omap_allocated":0,"internal_metadata":0},"log_size":10424,"ondisk_log_size":10424,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673408,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":114556,"kb_used_data":29420,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94257284,"statfs":{"total":96636764160,"available":96519458816,"internally_reserved":0,"allocated":30126080,"data_stored":473109124,"data_compressed":22457490,"data_compressed_allocated":29560832,"data_compressed_original":472891392,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706113,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":112272,"kb_used_data":36864,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94259568,"statfs":{"total":96636764160,"available":96521797632,"internally_reserved":0,"allocated":37748736,"data_stored":595133902,"data_compressed":28251792,"data_compressed_allocated":37187584,"data_compressed_original":594919424,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706112,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":107168,"kb_used_data":26192,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94264672,"statfs":{"total":96636764160,"available":96527024128,"internally_reserved":0,"allocated":26820608,"data_stored":420804325,"data_compressed":19972072,"data_compressed_allocated":26288128,"data_compressed_original":420610048,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706112,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123008,"kb_used_data":33712,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94248832,"statfs":{"total":96636764160,"available":96510803968,"internally_reserved":0,"allocated":34521088,"data_stored":543619333,"data_compressed":25805836,"data_compressed_allocated":33968128,"data_compressed_original":543408128,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34430976,"data_stored":550895616,"data_compressed":26158580,"data_compressed_allocated":34430976,"data_compressed_original":550895616,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26664960,"data_stored":426639360,"data_compressed":20258376,"data_compressed_allocated":26664960,"data_compressed_original":426639360,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":37191680,"data_stored":595066880,"data_compressed":28255992,"data_compressed_allocated":37191680,"data_compressed_original":595066880,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":30035968,"data_stored":480575488,"data_compressed":22819570,"data_compressed_allocated":30035968,"data_compressed_original":480575488,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:26:12.437 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:26:12.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:12.588+0000 7f0636263640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:12.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:12.600+0000 7f0636263640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:12.930 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:26:12.931 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:26:12.951 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-09-15T12:26:11.864090+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":683737651,"num_objects":10428,"num_object_clones":0,"num_object_copies":31284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":10505,"num_write_kb":668244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10479,"ondisk_log_size":10479,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":457004,"kb_used_data":126188,"kb_used_omap":0,"kb_used_meta":330752,"kb_avail":377030356,"statfs":{"total":386547056640,"available":386079084544,"internally_reserved":0,"allocated":129216512,"data_stored":2032666684,"data_compressed":96487190,"data_compressed_allocated":127004672,"data_compressed_original":2031828992,"omap_allocated":0,"internal_metadata":338690048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":393478144,"num_objects":6004,"num_object_clones":0,"num_object_copies":18012,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6004,"num_write_kb":384256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.073743"},"pg_stats":[{"pgid":"5.f","version":"64'660","reported_seq":690,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.509944+0000","last_change":"2024-09-15T12:25:19.440663+0000","last_active":"2024-09-15T12:26:10.509944+0000","last_peered":"2024-09-15T12:26:10.509944+0000","last_clean":"2024-09-15T12:26:10.509944+0000","last_became_active":"2024-09-15T12:25:19.421824+0000","last_became_peered":"2024-09-15T12:25:19.421824+0000","last_unstale":"2024-09-15T12:26:10.509944+0000","last_undegraded":"2024-09-15T12:26:10.509944+0000","last_fullsized":"2024-09-15T12:26:10.509944+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43253760,"num_objects":660,"num_object_clones":0,"num_object_copies":1980,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":660,"num_write_kb":42240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"64'646","reported_seq":676,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.697483+0000","last_change":"2024-09-15T12:25:19.444566+0000","last_active":"2024-09-15T12:26:10.697483+0000","last_peered":"2024-09-15T12:26:10.697483+0000","last_clean":"2024-09-15T12:26:10.697483+0000","last_became_active":"2024-09-15T12:25:19.436490+0000","last_became_peered":"2024-09-15T12:25:19.436490+0000","last_unstale":"2024-09-15T12:26:10.697483+0000","last_undegraded":"2024-09-15T12:26:10.697483+0000","last_fullsized":"2024-09-15T12:26:10.697483+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42336256,"num_objects":646,"num_object_clones":0,"num_object_copies":1938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":41344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"64'635","reported_seq":665,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.736938+0000","last_change":"2024-09-15T12:25:19.466585+0000","last_active":"2024-09-15T12:26:10.736938+0000","last_peered":"2024-09-15T12:26:10.736938+0000","last_clean":"2024-09-15T12:26:10.736938+0000","last_became_active":"2024-09-15T12:25:19.449036+0000","last_became_peered":"2024-09-15T12:25:19.449036+0000","last_unstale":"2024-09-15T12:26:10.736938+0000","last_undegraded":"2024-09-15T12:26:10.736938+0000","last_fullsized":"2024-09-15T12:26:10.736938+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41615360,"num_objects":635,"num_object_clones":0,"num_object_copies":1905,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":635,"num_write_kb":40640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"65'708","reported_seq":741,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T12:26:11.770322+0000","last_change":"2024-09-15T12:25:19.412052+0000","last_active":"2024-09-15T12:26:11.770322+0000","last_peered":"2024-09-15T12:26:11.770322+0000","last_clean":"2024-09-15T12:26:11.770322+0000","last_became_active":"2024-09-15T12:25:19.396072+0000","last_became_peered":"2024-09-15T12:25:19.396072+0000","last_unstale":"2024-09-15T12:26:11.770322+0000","last_undegraded":"2024-09-15T12:26:11.770322+0000","last_fullsized":"2024-09-15T12:26:11.770322+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46399488,"num_objects":708,"num_object_clones":0,"num_object_copies":2124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":45312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"64'626","reported_seq":656,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.684970+0000","last_change":"2024-09-15T12:25:19.447319+0000","last_active":"2024-09-15T12:26:10.684970+0000","last_peered":"2024-09-15T12:26:10.684970+0000","last_clean":"2024-09-15T12:26:10.684970+0000","last_became_active":"2024-09-15T12:25:19.436362+0000","last_became_peered":"2024-09-15T12:25:19.436362+0000","last_unstale":"2024-09-15T12:26:10.684970+0000","last_undegraded":"2024-09-15T12:26:10.684970+0000","last_fullsized":"2024-09-15T12:26:10.684970+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41025536,"num_objects":626,"num_object_clones":0,"num_object_copies":1878,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":626,"num_write_kb":40064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"64'651","reported_seq":681,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.752744+0000","last_change":"2024-09-15T12:25:19.475504+0000","last_active":"2024-09-15T12:26:10.752744+0000","last_peered":"2024-09-15T12:26:10.752744+0000","last_clean":"2024-09-15T12:26:10.752744+0000","last_became_active":"2024-09-15T12:25:19.467940+0000","last_became_peered":"2024-09-15T12:25:19.467940+0000","last_unstale":"2024-09-15T12:26:10.752744+0000","last_undegraded":"2024-09-15T12:26:10.752744+0000","last_fullsized":"2024-09-15T12:26:10.752744+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42663936,"num_objects":651,"num_object_clones":0,"num_object_copies":1953,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":651,"num_write_kb":41664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"64'628","reported_seq":658,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.655597+0000","last_change":"2024-09-15T12:25:19.403222+0000","last_active":"2024-09-15T12:26:10.655597+0000","last_peered":"2024-09-15T12:26:10.655597+0000","last_clean":"2024-09-15T12:26:10.655597+0000","last_became_active":"2024-09-15T12:25:19.396442+0000","last_became_peered":"2024-09-15T12:25:19.396442+0000","last_unstale":"2024-09-15T12:26:10.655597+0000","last_undegraded":"2024-09-15T12:26:10.655597+0000","last_fullsized":"2024-09-15T12:26:10.655597+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41156608,"num_objects":628,"num_object_clones":0,"num_object_copies":1884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":40192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"64'669","reported_seq":699,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.481357+0000","last_change":"2024-09-15T12:25:19.418093+0000","last_active":"2024-09-15T12:26:10.481357+0000","last_peered":"2024-09-15T12:26:10.481357+0000","last_clean":"2024-09-15T12:26:10.481357+0000","last_became_active":"2024-09-15T12:25:19.412762+0000","last_became_peered":"2024-09-15T12:25:19.412762+0000","last_unstale":"2024-09-15T12:26:10.481357+0000","last_undegraded":"2024-09-15T12:26:10.481357+0000","last_fullsized":"2024-09-15T12:26:10.481357+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43843584,"num_objects":669,"num_object_clones":0,"num_object_copies":2007,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":669,"num_write_kb":42816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"64'630","reported_seq":660,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.604228+0000","last_change":"2024-09-15T12:25:19.514099+0000","last_active":"2024-09-15T12:26:10.604228+0000","last_peered":"2024-09-15T12:26:10.604228+0000","last_clean":"2024-09-15T12:26:10.604228+0000","last_became_active":"2024-09-15T12:25:19.506892+0000","last_became_peered":"2024-09-15T12:25:19.506892+0000","last_unstale":"2024-09-15T12:26:10.604228+0000","last_undegraded":"2024-09-15T12:26:10.604228+0000","last_fullsized":"2024-09-15T12:26:10.604228+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41287680,"num_objects":630,"num_object_clones":0,"num_object_copies":1890,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":630,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":238,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.895525+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:26:10.895525+0000","last_peered":"2024-09-15T12:26:10.895525+0000","last_clean":"2024-09-15T12:26:10.895525+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:26:10.895525+0000","last_undegraded":"2024-09-15T12:26:10.895525+0000","last_fullsized":"2024-09-15T12:26:10.895525+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":164,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.894505+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:26:09.894505+0000","last_peered":"2024-09-15T12:26:09.894505+0000","last_clean":"2024-09-15T12:26:09.894505+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:26:09.894505+0000","last_undegraded":"2024-09-15T12:26:09.894505+0000","last_fullsized":"2024-09-15T12:26:09.894505+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"64'661","reported_seq":691,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.654211+0000","last_change":"2024-09-15T12:25:19.470256+0000","last_active":"2024-09-15T12:26:10.654211+0000","last_peered":"2024-09-15T12:26:10.654211+0000","last_clean":"2024-09-15T12:26:10.654211+0000","last_became_active":"2024-09-15T12:25:19.458317+0000","last_became_peered":"2024-09-15T12:25:19.458317+0000","last_unstale":"2024-09-15T12:26:10.654211+0000","last_undegraded":"2024-09-15T12:26:10.654211+0000","last_fullsized":"2024-09-15T12:26:10.654211+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43319296,"num_objects":661,"num_object_clones":0,"num_object_copies":1983,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":661,"num_write_kb":42304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.906459+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:26:09.906459+0000","last_peered":"2024-09-15T12:26:09.906459+0000","last_clean":"2024-09-15T12:26:09.906459+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:26:09.906459+0000","last_undegraded":"2024-09-15T12:26:09.906459+0000","last_fullsized":"2024-09-15T12:26:09.906459+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"64'648","reported_seq":678,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.651943+0000","last_change":"2024-09-15T12:25:19.478666+0000","last_active":"2024-09-15T12:26:10.651943+0000","last_peered":"2024-09-15T12:26:10.651943+0000","last_clean":"2024-09-15T12:26:10.651943+0000","last_became_active":"2024-09-15T12:25:19.468663+0000","last_became_peered":"2024-09-15T12:25:19.468663+0000","last_unstale":"2024-09-15T12:26:10.651943+0000","last_undegraded":"2024-09-15T12:26:10.651943+0000","last_fullsized":"2024-09-15T12:26:10.651943+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42467328,"num_objects":648,"num_object_clones":0,"num_object_copies":1944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":41472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.888896+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:26:09.888896+0000","last_peered":"2024-09-15T12:26:09.888896+0000","last_clean":"2024-09-15T12:26:09.888896+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:26:09.888896+0000","last_undegraded":"2024-09-15T12:26:09.888896+0000","last_fullsized":"2024-09-15T12:26:09.888896+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"64'667","reported_seq":697,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.547549+0000","last_change":"2024-09-15T12:25:19.499536+0000","last_active":"2024-09-15T12:26:10.547549+0000","last_peered":"2024-09-15T12:26:10.547549+0000","last_clean":"2024-09-15T12:26:10.547549+0000","last_became_active":"2024-09-15T12:25:19.493017+0000","last_became_peered":"2024-09-15T12:25:19.493017+0000","last_unstale":"2024-09-15T12:26:10.547549+0000","last_undegraded":"2024-09-15T12:26:10.547549+0000","last_fullsized":"2024-09-15T12:26:10.547549+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43712512,"num_objects":667,"num_object_clones":0,"num_object_copies":2001,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":667,"num_write_kb":42688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":165,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.900992+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:26:09.900992+0000","last_peered":"2024-09-15T12:26:09.900992+0000","last_clean":"2024-09-15T12:26:09.900992+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:26:09.900992+0000","last_undegraded":"2024-09-15T12:26:09.900992+0000","last_fullsized":"2024-09-15T12:26:09.900992+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"64'631","reported_seq":661,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.555976+0000","last_change":"2024-09-15T12:25:19.413209+0000","last_active":"2024-09-15T12:26:10.555976+0000","last_peered":"2024-09-15T12:26:10.555976+0000","last_clean":"2024-09-15T12:26:10.555976+0000","last_became_active":"2024-09-15T12:25:19.403123+0000","last_became_peered":"2024-09-15T12:25:19.403123+0000","last_unstale":"2024-09-15T12:26:10.555976+0000","last_undegraded":"2024-09-15T12:26:10.555976+0000","last_fullsized":"2024-09-15T12:26:10.555976+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41353216,"num_objects":631,"num_object_clones":0,"num_object_copies":1893,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":631,"num_write_kb":40384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.896505+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:26:09.896505+0000","last_peered":"2024-09-15T12:26:09.896505+0000","last_clean":"2024-09-15T12:26:09.896505+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:26:09.896505+0000","last_undegraded":"2024-09-15T12:26:09.896505+0000","last_fullsized":"2024-09-15T12:26:09.896505+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"64'689","reported_seq":719,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.537739+0000","last_change":"2024-09-15T12:25:19.429640+0000","last_active":"2024-09-15T12:26:10.537739+0000","last_peered":"2024-09-15T12:26:10.537739+0000","last_clean":"2024-09-15T12:26:10.537739+0000","last_became_active":"2024-09-15T12:25:19.422585+0000","last_became_peered":"2024-09-15T12:25:19.422585+0000","last_unstale":"2024-09-15T12:26:10.537739+0000","last_undegraded":"2024-09-15T12:26:10.537739+0000","last_fullsized":"2024-09-15T12:26:10.537739+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":689,"log_dups_size":0,"ondisk_log_size":689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45154304,"num_objects":689,"num_object_clones":0,"num_object_copies":2067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":689,"num_write_kb":44096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":166,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.899315+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:26:10.899315+0000","last_peered":"2024-09-15T12:26:10.899315+0000","last_clean":"2024-09-15T12:26:10.899315+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:26:10.899315+0000","last_undegraded":"2024-09-15T12:26:10.899315+0000","last_fullsized":"2024-09-15T12:26:10.899315+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"65'659","reported_seq":692,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T12:26:11.767587+0000","last_change":"2024-09-15T12:25:19.429532+0000","last_active":"2024-09-15T12:26:11.767587+0000","last_peered":"2024-09-15T12:26:11.767587+0000","last_clean":"2024-09-15T12:26:11.767587+0000","last_became_active":"2024-09-15T12:25:19.424570+0000","last_became_peered":"2024-09-15T12:25:19.424570+0000","last_unstale":"2024-09-15T12:26:11.767587+0000","last_undegraded":"2024-09-15T12:26:11.767587+0000","last_fullsized":"2024-09-15T12:26:11.767587+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43188224,"num_objects":659,"num_object_clones":0,"num_object_copies":1977,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":659,"num_write_kb":42176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.893033+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:26:09.893033+0000","last_peered":"2024-09-15T12:26:09.893033+0000","last_clean":"2024-09-15T12:26:09.893033+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:26:09.893033+0000","last_undegraded":"2024-09-15T12:26:09.893033+0000","last_fullsized":"2024-09-15T12:26:09.893033+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"64'616","reported_seq":646,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.601230+0000","last_change":"2024-09-15T12:25:19.453184+0000","last_active":"2024-09-15T12:26:10.601230+0000","last_peered":"2024-09-15T12:26:10.601230+0000","last_clean":"2024-09-15T12:26:10.601230+0000","last_became_active":"2024-09-15T12:25:19.441520+0000","last_became_peered":"2024-09-15T12:25:19.441520+0000","last_unstale":"2024-09-15T12:26:10.601230+0000","last_undegraded":"2024-09-15T12:26:10.601230+0000","last_fullsized":"2024-09-15T12:26:10.601230+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40370176,"num_objects":616,"num_object_clones":0,"num_object_copies":1848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.894930+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:26:09.894930+0000","last_peered":"2024-09-15T12:26:09.894930+0000","last_clean":"2024-09-15T12:26:09.894930+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:26:09.894930+0000","last_undegraded":"2024-09-15T12:26:09.894930+0000","last_fullsized":"2024-09-15T12:26:09.894930+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":683147264,"num_objects":10424,"num_object_clones":0,"num_object_copies":31272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10424,"num_write_kb":667136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":128323584,"data_stored":2053177344,"data_compressed":97492518,"data_compressed_allocated":128323584,"data_compressed_original":2053177344,"omap_allocated":0,"internal_metadata":0},"log_size":10424,"ondisk_log_size":10424,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673408,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":114556,"kb_used_data":29420,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94257284,"statfs":{"total":96636764160,"available":96519458816,"internally_reserved":0,"allocated":30126080,"data_stored":473109124,"data_compressed":22457490,"data_compressed_allocated":29560832,"data_compressed_original":472891392,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706113,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":112272,"kb_used_data":36864,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94259568,"statfs":{"total":96636764160,"available":96521797632,"internally_reserved":0,"allocated":37748736,"data_stored":595133902,"data_compressed":28251792,"data_compressed_allocated":37187584,"data_compressed_original":594919424,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706112,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":107168,"kb_used_data":26192,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94264672,"statfs":{"total":96636764160,"available":96527024128,"internally_reserved":0,"allocated":26820608,"data_stored":420804325,"data_compressed":19972072,"data_compressed_allocated":26288128,"data_compressed_original":420610048,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706112,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123008,"kb_used_data":33712,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94248832,"statfs":{"total":96636764160,"available":96510803968,"internally_reserved":0,"allocated":34521088,"data_stored":543619333,"data_compressed":25805836,"data_compressed_allocated":33968128,"data_compressed_original":543408128,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34430976,"data_stored":550895616,"data_compressed":26158580,"data_compressed_allocated":34430976,"data_compressed_original":550895616,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26664960,"data_stored":426639360,"data_compressed":20258376,"data_compressed_allocated":26664960,"data_compressed_original":426639360,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":37191680,"data_stored":595066880,"data_compressed":28255992,"data_compressed_allocated":37191680,"data_compressed_original":595066880,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":30035968,"data_stored":480575488,"data_compressed":22819570,"data_compressed_allocated":30035968,"data_compressed_original":480575488,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:26:12.952 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-15T12:26:12.952 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:26:12.952 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:26:12.955 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:26:13.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:13.115+0000 7f9397f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:13.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:13.132+0000 7f9397f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:13.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:13.167+0000 7f35992fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:13.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:13.181+0000 7f35992fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:13.385 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 53 16 10892 10876 12.8241 11.5 0.107944 0.0778942 2024-09-15T12:26:13.515 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:26:13.516 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:26:13.533 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":285,"stamp":"2024-09-15T12:26:13.249907+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":683737651,"num_objects":10428,"num_object_clones":0,"num_object_copies":31284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":10505,"num_write_kb":668244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10479,"ondisk_log_size":10479,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":457004,"kb_used_data":126188,"kb_used_omap":0,"kb_used_meta":330752,"kb_avail":377030356,"statfs":{"total":386547056640,"available":386079084544,"internally_reserved":0,"allocated":129216512,"data_stored":2032666684,"data_compressed":96487190,"data_compressed_allocated":127004672,"data_compressed_original":2031828992,"omap_allocated":0,"internal_metadata":338690048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":393478144,"num_objects":6004,"num_object_clones":0,"num_object_copies":18012,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6004,"num_write_kb":384256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.402208"},"pg_stats":[{"pgid":"5.f","version":"64'660","reported_seq":690,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.509944+0000","last_change":"2024-09-15T12:25:19.440663+0000","last_active":"2024-09-15T12:26:10.509944+0000","last_peered":"2024-09-15T12:26:10.509944+0000","last_clean":"2024-09-15T12:26:10.509944+0000","last_became_active":"2024-09-15T12:25:19.421824+0000","last_became_peered":"2024-09-15T12:25:19.421824+0000","last_unstale":"2024-09-15T12:26:10.509944+0000","last_undegraded":"2024-09-15T12:26:10.509944+0000","last_fullsized":"2024-09-15T12:26:10.509944+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43253760,"num_objects":660,"num_object_clones":0,"num_object_copies":1980,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":660,"num_write_kb":42240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"64'646","reported_seq":676,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.697483+0000","last_change":"2024-09-15T12:25:19.444566+0000","last_active":"2024-09-15T12:26:10.697483+0000","last_peered":"2024-09-15T12:26:10.697483+0000","last_clean":"2024-09-15T12:26:10.697483+0000","last_became_active":"2024-09-15T12:25:19.436490+0000","last_became_peered":"2024-09-15T12:25:19.436490+0000","last_unstale":"2024-09-15T12:26:10.697483+0000","last_undegraded":"2024-09-15T12:26:10.697483+0000","last_fullsized":"2024-09-15T12:26:10.697483+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42336256,"num_objects":646,"num_object_clones":0,"num_object_copies":1938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":41344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"64'635","reported_seq":665,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.736938+0000","last_change":"2024-09-15T12:25:19.466585+0000","last_active":"2024-09-15T12:26:10.736938+0000","last_peered":"2024-09-15T12:26:10.736938+0000","last_clean":"2024-09-15T12:26:10.736938+0000","last_became_active":"2024-09-15T12:25:19.449036+0000","last_became_peered":"2024-09-15T12:25:19.449036+0000","last_unstale":"2024-09-15T12:26:10.736938+0000","last_undegraded":"2024-09-15T12:26:10.736938+0000","last_fullsized":"2024-09-15T12:26:10.736938+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41615360,"num_objects":635,"num_object_clones":0,"num_object_copies":1905,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":635,"num_write_kb":40640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"65'708","reported_seq":741,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T12:26:11.770322+0000","last_change":"2024-09-15T12:25:19.412052+0000","last_active":"2024-09-15T12:26:11.770322+0000","last_peered":"2024-09-15T12:26:11.770322+0000","last_clean":"2024-09-15T12:26:11.770322+0000","last_became_active":"2024-09-15T12:25:19.396072+0000","last_became_peered":"2024-09-15T12:25:19.396072+0000","last_unstale":"2024-09-15T12:26:11.770322+0000","last_undegraded":"2024-09-15T12:26:11.770322+0000","last_fullsized":"2024-09-15T12:26:11.770322+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46399488,"num_objects":708,"num_object_clones":0,"num_object_copies":2124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":45312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"64'626","reported_seq":656,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.684970+0000","last_change":"2024-09-15T12:25:19.447319+0000","last_active":"2024-09-15T12:26:10.684970+0000","last_peered":"2024-09-15T12:26:10.684970+0000","last_clean":"2024-09-15T12:26:10.684970+0000","last_became_active":"2024-09-15T12:25:19.436362+0000","last_became_peered":"2024-09-15T12:25:19.436362+0000","last_unstale":"2024-09-15T12:26:10.684970+0000","last_undegraded":"2024-09-15T12:26:10.684970+0000","last_fullsized":"2024-09-15T12:26:10.684970+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41025536,"num_objects":626,"num_object_clones":0,"num_object_copies":1878,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":626,"num_write_kb":40064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"64'651","reported_seq":681,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.752744+0000","last_change":"2024-09-15T12:25:19.475504+0000","last_active":"2024-09-15T12:26:10.752744+0000","last_peered":"2024-09-15T12:26:10.752744+0000","last_clean":"2024-09-15T12:26:10.752744+0000","last_became_active":"2024-09-15T12:25:19.467940+0000","last_became_peered":"2024-09-15T12:25:19.467940+0000","last_unstale":"2024-09-15T12:26:10.752744+0000","last_undegraded":"2024-09-15T12:26:10.752744+0000","last_fullsized":"2024-09-15T12:26:10.752744+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42663936,"num_objects":651,"num_object_clones":0,"num_object_copies":1953,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":651,"num_write_kb":41664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"64'628","reported_seq":658,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.655597+0000","last_change":"2024-09-15T12:25:19.403222+0000","last_active":"2024-09-15T12:26:10.655597+0000","last_peered":"2024-09-15T12:26:10.655597+0000","last_clean":"2024-09-15T12:26:10.655597+0000","last_became_active":"2024-09-15T12:25:19.396442+0000","last_became_peered":"2024-09-15T12:25:19.396442+0000","last_unstale":"2024-09-15T12:26:10.655597+0000","last_undegraded":"2024-09-15T12:26:10.655597+0000","last_fullsized":"2024-09-15T12:26:10.655597+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41156608,"num_objects":628,"num_object_clones":0,"num_object_copies":1884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":40192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"64'669","reported_seq":699,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.481357+0000","last_change":"2024-09-15T12:25:19.418093+0000","last_active":"2024-09-15T12:26:10.481357+0000","last_peered":"2024-09-15T12:26:10.481357+0000","last_clean":"2024-09-15T12:26:10.481357+0000","last_became_active":"2024-09-15T12:25:19.412762+0000","last_became_peered":"2024-09-15T12:25:19.412762+0000","last_unstale":"2024-09-15T12:26:10.481357+0000","last_undegraded":"2024-09-15T12:26:10.481357+0000","last_fullsized":"2024-09-15T12:26:10.481357+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43843584,"num_objects":669,"num_object_clones":0,"num_object_copies":2007,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":669,"num_write_kb":42816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"64'630","reported_seq":660,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.604228+0000","last_change":"2024-09-15T12:25:19.514099+0000","last_active":"2024-09-15T12:26:10.604228+0000","last_peered":"2024-09-15T12:26:10.604228+0000","last_clean":"2024-09-15T12:26:10.604228+0000","last_became_active":"2024-09-15T12:25:19.506892+0000","last_became_peered":"2024-09-15T12:25:19.506892+0000","last_unstale":"2024-09-15T12:26:10.604228+0000","last_undegraded":"2024-09-15T12:26:10.604228+0000","last_fullsized":"2024-09-15T12:26:10.604228+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41287680,"num_objects":630,"num_object_clones":0,"num_object_copies":1890,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":630,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":238,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.895525+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:26:10.895525+0000","last_peered":"2024-09-15T12:26:10.895525+0000","last_clean":"2024-09-15T12:26:10.895525+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:26:10.895525+0000","last_undegraded":"2024-09-15T12:26:10.895525+0000","last_fullsized":"2024-09-15T12:26:10.895525+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":164,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.894505+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:26:09.894505+0000","last_peered":"2024-09-15T12:26:09.894505+0000","last_clean":"2024-09-15T12:26:09.894505+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:26:09.894505+0000","last_undegraded":"2024-09-15T12:26:09.894505+0000","last_fullsized":"2024-09-15T12:26:09.894505+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"64'661","reported_seq":691,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.654211+0000","last_change":"2024-09-15T12:25:19.470256+0000","last_active":"2024-09-15T12:26:10.654211+0000","last_peered":"2024-09-15T12:26:10.654211+0000","last_clean":"2024-09-15T12:26:10.654211+0000","last_became_active":"2024-09-15T12:25:19.458317+0000","last_became_peered":"2024-09-15T12:25:19.458317+0000","last_unstale":"2024-09-15T12:26:10.654211+0000","last_undegraded":"2024-09-15T12:26:10.654211+0000","last_fullsized":"2024-09-15T12:26:10.654211+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43319296,"num_objects":661,"num_object_clones":0,"num_object_copies":1983,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":661,"num_write_kb":42304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.906459+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:26:09.906459+0000","last_peered":"2024-09-15T12:26:09.906459+0000","last_clean":"2024-09-15T12:26:09.906459+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:26:09.906459+0000","last_undegraded":"2024-09-15T12:26:09.906459+0000","last_fullsized":"2024-09-15T12:26:09.906459+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"64'648","reported_seq":678,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.651943+0000","last_change":"2024-09-15T12:25:19.478666+0000","last_active":"2024-09-15T12:26:10.651943+0000","last_peered":"2024-09-15T12:26:10.651943+0000","last_clean":"2024-09-15T12:26:10.651943+0000","last_became_active":"2024-09-15T12:25:19.468663+0000","last_became_peered":"2024-09-15T12:25:19.468663+0000","last_unstale":"2024-09-15T12:26:10.651943+0000","last_undegraded":"2024-09-15T12:26:10.651943+0000","last_fullsized":"2024-09-15T12:26:10.651943+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42467328,"num_objects":648,"num_object_clones":0,"num_object_copies":1944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":41472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.888896+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:26:09.888896+0000","last_peered":"2024-09-15T12:26:09.888896+0000","last_clean":"2024-09-15T12:26:09.888896+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:26:09.888896+0000","last_undegraded":"2024-09-15T12:26:09.888896+0000","last_fullsized":"2024-09-15T12:26:09.888896+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"64'667","reported_seq":697,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.547549+0000","last_change":"2024-09-15T12:25:19.499536+0000","last_active":"2024-09-15T12:26:10.547549+0000","last_peered":"2024-09-15T12:26:10.547549+0000","last_clean":"2024-09-15T12:26:10.547549+0000","last_became_active":"2024-09-15T12:25:19.493017+0000","last_became_peered":"2024-09-15T12:25:19.493017+0000","last_unstale":"2024-09-15T12:26:10.547549+0000","last_undegraded":"2024-09-15T12:26:10.547549+0000","last_fullsized":"2024-09-15T12:26:10.547549+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43712512,"num_objects":667,"num_object_clones":0,"num_object_copies":2001,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":667,"num_write_kb":42688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":165,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.900992+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:26:09.900992+0000","last_peered":"2024-09-15T12:26:09.900992+0000","last_clean":"2024-09-15T12:26:09.900992+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:26:09.900992+0000","last_undegraded":"2024-09-15T12:26:09.900992+0000","last_fullsized":"2024-09-15T12:26:09.900992+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"64'631","reported_seq":661,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.555976+0000","last_change":"2024-09-15T12:25:19.413209+0000","last_active":"2024-09-15T12:26:10.555976+0000","last_peered":"2024-09-15T12:26:10.555976+0000","last_clean":"2024-09-15T12:26:10.555976+0000","last_became_active":"2024-09-15T12:25:19.403123+0000","last_became_peered":"2024-09-15T12:25:19.403123+0000","last_unstale":"2024-09-15T12:26:10.555976+0000","last_undegraded":"2024-09-15T12:26:10.555976+0000","last_fullsized":"2024-09-15T12:26:10.555976+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41353216,"num_objects":631,"num_object_clones":0,"num_object_copies":1893,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":631,"num_write_kb":40384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.896505+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:26:09.896505+0000","last_peered":"2024-09-15T12:26:09.896505+0000","last_clean":"2024-09-15T12:26:09.896505+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:26:09.896505+0000","last_undegraded":"2024-09-15T12:26:09.896505+0000","last_fullsized":"2024-09-15T12:26:09.896505+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"64'689","reported_seq":719,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.537739+0000","last_change":"2024-09-15T12:25:19.429640+0000","last_active":"2024-09-15T12:26:10.537739+0000","last_peered":"2024-09-15T12:26:10.537739+0000","last_clean":"2024-09-15T12:26:10.537739+0000","last_became_active":"2024-09-15T12:25:19.422585+0000","last_became_peered":"2024-09-15T12:25:19.422585+0000","last_unstale":"2024-09-15T12:26:10.537739+0000","last_undegraded":"2024-09-15T12:26:10.537739+0000","last_fullsized":"2024-09-15T12:26:10.537739+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":689,"log_dups_size":0,"ondisk_log_size":689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45154304,"num_objects":689,"num_object_clones":0,"num_object_copies":2067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":689,"num_write_kb":44096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":166,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.899315+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:26:10.899315+0000","last_peered":"2024-09-15T12:26:10.899315+0000","last_clean":"2024-09-15T12:26:10.899315+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:26:10.899315+0000","last_undegraded":"2024-09-15T12:26:10.899315+0000","last_fullsized":"2024-09-15T12:26:10.899315+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"65'659","reported_seq":692,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T12:26:11.767587+0000","last_change":"2024-09-15T12:25:19.429532+0000","last_active":"2024-09-15T12:26:11.767587+0000","last_peered":"2024-09-15T12:26:11.767587+0000","last_clean":"2024-09-15T12:26:11.767587+0000","last_became_active":"2024-09-15T12:25:19.424570+0000","last_became_peered":"2024-09-15T12:25:19.424570+0000","last_unstale":"2024-09-15T12:26:11.767587+0000","last_undegraded":"2024-09-15T12:26:11.767587+0000","last_fullsized":"2024-09-15T12:26:11.767587+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43188224,"num_objects":659,"num_object_clones":0,"num_object_copies":1977,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":659,"num_write_kb":42176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.893033+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:26:09.893033+0000","last_peered":"2024-09-15T12:26:09.893033+0000","last_clean":"2024-09-15T12:26:09.893033+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:26:09.893033+0000","last_undegraded":"2024-09-15T12:26:09.893033+0000","last_fullsized":"2024-09-15T12:26:09.893033+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"64'616","reported_seq":646,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.601230+0000","last_change":"2024-09-15T12:25:19.453184+0000","last_active":"2024-09-15T12:26:10.601230+0000","last_peered":"2024-09-15T12:26:10.601230+0000","last_clean":"2024-09-15T12:26:10.601230+0000","last_became_active":"2024-09-15T12:25:19.441520+0000","last_became_peered":"2024-09-15T12:25:19.441520+0000","last_unstale":"2024-09-15T12:26:10.601230+0000","last_undegraded":"2024-09-15T12:26:10.601230+0000","last_fullsized":"2024-09-15T12:26:10.601230+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40370176,"num_objects":616,"num_object_clones":0,"num_object_copies":1848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.894930+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:26:09.894930+0000","last_peered":"2024-09-15T12:26:09.894930+0000","last_clean":"2024-09-15T12:26:09.894930+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:26:09.894930+0000","last_undegraded":"2024-09-15T12:26:09.894930+0000","last_fullsized":"2024-09-15T12:26:09.894930+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":683147264,"num_objects":10424,"num_object_clones":0,"num_object_copies":31272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10424,"num_write_kb":667136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":128323584,"data_stored":2053177344,"data_compressed":97492518,"data_compressed_allocated":128323584,"data_compressed_original":2053177344,"omap_allocated":0,"internal_metadata":0},"log_size":10424,"ondisk_log_size":10424,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673408,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":114556,"kb_used_data":29420,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94257284,"statfs":{"total":96636764160,"available":96519458816,"internally_reserved":0,"allocated":30126080,"data_stored":473109124,"data_compressed":22457490,"data_compressed_allocated":29560832,"data_compressed_original":472891392,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706113,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":112272,"kb_used_data":36864,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94259568,"statfs":{"total":96636764160,"available":96521797632,"internally_reserved":0,"allocated":37748736,"data_stored":595133902,"data_compressed":28251792,"data_compressed_allocated":37187584,"data_compressed_original":594919424,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706112,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":107168,"kb_used_data":26192,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94264672,"statfs":{"total":96636764160,"available":96527024128,"internally_reserved":0,"allocated":26820608,"data_stored":420804325,"data_compressed":19972072,"data_compressed_allocated":26288128,"data_compressed_original":420610048,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706112,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123008,"kb_used_data":33712,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94248832,"statfs":{"total":96636764160,"available":96510803968,"internally_reserved":0,"allocated":34521088,"data_stored":543619333,"data_compressed":25805836,"data_compressed_allocated":33968128,"data_compressed_original":543408128,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34430976,"data_stored":550895616,"data_compressed":26158580,"data_compressed_allocated":34430976,"data_compressed_original":550895616,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26664960,"data_stored":426639360,"data_compressed":20258376,"data_compressed_allocated":26664960,"data_compressed_original":426639360,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":37191680,"data_stored":595066880,"data_compressed":28255992,"data_compressed_allocated":37191680,"data_compressed_original":595066880,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":30035968,"data_stored":480575488,"data_compressed":22819570,"data_compressed_allocated":30035968,"data_compressed_original":480575488,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:26:14.385 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 54 16 11074 11058 12.7972 11.375 0.114374 0.0780193 2024-09-15T12:26:15.385 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 55 16 11275 11259 12.7929 12.5625 0.0813182 0.0780994 2024-09-15T12:26:15.707 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:26:15.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:15.854+0000 7fe535b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:15.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:15.860+0000 7fe535b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:16.385 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 56 16 11444 11428 12.7531 10.5625 0.0831558 0.0783668 2024-09-15T12:26:17.385 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 57 16 11638 11622 12.7421 12.125 0.059391 0.0784241 2024-09-15T12:26:18.084 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:26:18.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:18.260+0000 7ff6a02b4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:18.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:18.268+0000 7ff6a02b4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:18.385 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 58 16 11819 11803 12.7174 11.3125 0.127762 0.0785652 2024-09-15T12:26:18.535 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:26:18.535 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-15T12:26:18.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:18.693+0000 7f07c9b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:18.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:18.711+0000 7f07c9b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:19.263 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.0 to 1 (10000) 2024-09-15T12:26:19.289 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-15T12:26:19.385 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 59 16 12008 11992 12.702 11.8125 0.117716 0.0786577 2024-09-15T12:26:19.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:19.447+0000 7fc092f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:19.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:19.464+0000 7fc092f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:20.264 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.1 to 1 (10000) 2024-09-15T12:26:20.283 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-15T12:26:20.385 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:2024-09-15T12:26:20.385110+0000 min lat: 0.0157862 max lat: 0.236634 avg lat: 0.0787327 2024-09-15T12:26:20.385 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-15T12:26:20.386 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 60 16 12197 12181 12.6872 11.8125 0.121486 0.0787327 2024-09-15T12:26:20.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:20.433+0000 7f0d72d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:20.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:20.450+0000 7f0d72d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:20.626 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:26:20.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:20.808+0000 7fdce6311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:20.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:20.818+0000 7fdce6311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:21.271 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.2 to 1 (10000) 2024-09-15T12:26:21.294 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-15T12:26:21.385 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 61 16 12373 12357 12.6595 11 0.108794 0.0789027 2024-09-15T12:26:21.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:21.447+0000 7f54a0d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:21.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:21.463+0000 7f54a0d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:22.280 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.3 to 1 (10000) 2024-09-15T12:26:22.303 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-15T12:26:22.303 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:26:22.385 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 62 16 12547 12531 12.6307 10.875 0.133055 0.0790669 2024-09-15T12:26:22.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:22.444+0000 7f1a6ea7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:22.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:22.455+0000 7f1a6ea7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:22.743 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:26:22.743 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:26:22.766 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":295,"stamp":"2024-09-15T12:26:22.282188+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":683737651,"num_objects":10428,"num_object_clones":0,"num_object_copies":31284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":10505,"num_write_kb":668244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10479,"ondisk_log_size":10479,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":457004,"kb_used_data":126188,"kb_used_omap":0,"kb_used_meta":330752,"kb_avail":377030356,"statfs":{"total":386547056640,"available":386079084544,"internally_reserved":0,"allocated":129216512,"data_stored":2032666684,"data_compressed":96487190,"data_compressed_allocated":127004672,"data_compressed_original":2031828992,"omap_allocated":0,"internal_metadata":338690048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.031027"},"pg_stats":[{"pgid":"5.f","version":"64'660","reported_seq":690,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.509944+0000","last_change":"2024-09-15T12:25:19.440663+0000","last_active":"2024-09-15T12:26:10.509944+0000","last_peered":"2024-09-15T12:26:10.509944+0000","last_clean":"2024-09-15T12:26:10.509944+0000","last_became_active":"2024-09-15T12:25:19.421824+0000","last_became_peered":"2024-09-15T12:25:19.421824+0000","last_unstale":"2024-09-15T12:26:10.509944+0000","last_undegraded":"2024-09-15T12:26:10.509944+0000","last_fullsized":"2024-09-15T12:26:10.509944+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43253760,"num_objects":660,"num_object_clones":0,"num_object_copies":1980,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":660,"num_write_kb":42240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"64'646","reported_seq":676,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.697483+0000","last_change":"2024-09-15T12:25:19.444566+0000","last_active":"2024-09-15T12:26:10.697483+0000","last_peered":"2024-09-15T12:26:10.697483+0000","last_clean":"2024-09-15T12:26:10.697483+0000","last_became_active":"2024-09-15T12:25:19.436490+0000","last_became_peered":"2024-09-15T12:25:19.436490+0000","last_unstale":"2024-09-15T12:26:10.697483+0000","last_undegraded":"2024-09-15T12:26:10.697483+0000","last_fullsized":"2024-09-15T12:26:10.697483+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42336256,"num_objects":646,"num_object_clones":0,"num_object_copies":1938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":41344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"64'635","reported_seq":665,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.736938+0000","last_change":"2024-09-15T12:25:19.466585+0000","last_active":"2024-09-15T12:26:10.736938+0000","last_peered":"2024-09-15T12:26:10.736938+0000","last_clean":"2024-09-15T12:26:10.736938+0000","last_became_active":"2024-09-15T12:25:19.449036+0000","last_became_peered":"2024-09-15T12:25:19.449036+0000","last_unstale":"2024-09-15T12:26:10.736938+0000","last_undegraded":"2024-09-15T12:26:10.736938+0000","last_fullsized":"2024-09-15T12:26:10.736938+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41615360,"num_objects":635,"num_object_clones":0,"num_object_copies":1905,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":635,"num_write_kb":40640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"65'708","reported_seq":741,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T12:26:11.770322+0000","last_change":"2024-09-15T12:25:19.412052+0000","last_active":"2024-09-15T12:26:11.770322+0000","last_peered":"2024-09-15T12:26:11.770322+0000","last_clean":"2024-09-15T12:26:11.770322+0000","last_became_active":"2024-09-15T12:25:19.396072+0000","last_became_peered":"2024-09-15T12:25:19.396072+0000","last_unstale":"2024-09-15T12:26:11.770322+0000","last_undegraded":"2024-09-15T12:26:11.770322+0000","last_fullsized":"2024-09-15T12:26:11.770322+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46399488,"num_objects":708,"num_object_clones":0,"num_object_copies":2124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":45312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"64'626","reported_seq":656,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.684970+0000","last_change":"2024-09-15T12:25:19.447319+0000","last_active":"2024-09-15T12:26:10.684970+0000","last_peered":"2024-09-15T12:26:10.684970+0000","last_clean":"2024-09-15T12:26:10.684970+0000","last_became_active":"2024-09-15T12:25:19.436362+0000","last_became_peered":"2024-09-15T12:25:19.436362+0000","last_unstale":"2024-09-15T12:26:10.684970+0000","last_undegraded":"2024-09-15T12:26:10.684970+0000","last_fullsized":"2024-09-15T12:26:10.684970+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41025536,"num_objects":626,"num_object_clones":0,"num_object_copies":1878,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":626,"num_write_kb":40064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"64'651","reported_seq":681,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.752744+0000","last_change":"2024-09-15T12:25:19.475504+0000","last_active":"2024-09-15T12:26:10.752744+0000","last_peered":"2024-09-15T12:26:10.752744+0000","last_clean":"2024-09-15T12:26:10.752744+0000","last_became_active":"2024-09-15T12:25:19.467940+0000","last_became_peered":"2024-09-15T12:25:19.467940+0000","last_unstale":"2024-09-15T12:26:10.752744+0000","last_undegraded":"2024-09-15T12:26:10.752744+0000","last_fullsized":"2024-09-15T12:26:10.752744+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42663936,"num_objects":651,"num_object_clones":0,"num_object_copies":1953,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":651,"num_write_kb":41664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"64'628","reported_seq":658,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.655597+0000","last_change":"2024-09-15T12:25:19.403222+0000","last_active":"2024-09-15T12:26:10.655597+0000","last_peered":"2024-09-15T12:26:10.655597+0000","last_clean":"2024-09-15T12:26:10.655597+0000","last_became_active":"2024-09-15T12:25:19.396442+0000","last_became_peered":"2024-09-15T12:25:19.396442+0000","last_unstale":"2024-09-15T12:26:10.655597+0000","last_undegraded":"2024-09-15T12:26:10.655597+0000","last_fullsized":"2024-09-15T12:26:10.655597+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41156608,"num_objects":628,"num_object_clones":0,"num_object_copies":1884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":40192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"64'669","reported_seq":699,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.481357+0000","last_change":"2024-09-15T12:25:19.418093+0000","last_active":"2024-09-15T12:26:10.481357+0000","last_peered":"2024-09-15T12:26:10.481357+0000","last_clean":"2024-09-15T12:26:10.481357+0000","last_became_active":"2024-09-15T12:25:19.412762+0000","last_became_peered":"2024-09-15T12:25:19.412762+0000","last_unstale":"2024-09-15T12:26:10.481357+0000","last_undegraded":"2024-09-15T12:26:10.481357+0000","last_fullsized":"2024-09-15T12:26:10.481357+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43843584,"num_objects":669,"num_object_clones":0,"num_object_copies":2007,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":669,"num_write_kb":42816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"64'630","reported_seq":660,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.604228+0000","last_change":"2024-09-15T12:25:19.514099+0000","last_active":"2024-09-15T12:26:10.604228+0000","last_peered":"2024-09-15T12:26:10.604228+0000","last_clean":"2024-09-15T12:26:10.604228+0000","last_became_active":"2024-09-15T12:25:19.506892+0000","last_became_peered":"2024-09-15T12:25:19.506892+0000","last_unstale":"2024-09-15T12:26:10.604228+0000","last_undegraded":"2024-09-15T12:26:10.604228+0000","last_fullsized":"2024-09-15T12:26:10.604228+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41287680,"num_objects":630,"num_object_clones":0,"num_object_copies":1890,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":630,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":238,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.895525+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:26:10.895525+0000","last_peered":"2024-09-15T12:26:10.895525+0000","last_clean":"2024-09-15T12:26:10.895525+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:26:10.895525+0000","last_undegraded":"2024-09-15T12:26:10.895525+0000","last_fullsized":"2024-09-15T12:26:10.895525+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":164,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.894505+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:26:09.894505+0000","last_peered":"2024-09-15T12:26:09.894505+0000","last_clean":"2024-09-15T12:26:09.894505+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:26:09.894505+0000","last_undegraded":"2024-09-15T12:26:09.894505+0000","last_fullsized":"2024-09-15T12:26:09.894505+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"64'661","reported_seq":691,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.654211+0000","last_change":"2024-09-15T12:25:19.470256+0000","last_active":"2024-09-15T12:26:10.654211+0000","last_peered":"2024-09-15T12:26:10.654211+0000","last_clean":"2024-09-15T12:26:10.654211+0000","last_became_active":"2024-09-15T12:25:19.458317+0000","last_became_peered":"2024-09-15T12:25:19.458317+0000","last_unstale":"2024-09-15T12:26:10.654211+0000","last_undegraded":"2024-09-15T12:26:10.654211+0000","last_fullsized":"2024-09-15T12:26:10.654211+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43319296,"num_objects":661,"num_object_clones":0,"num_object_copies":1983,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":661,"num_write_kb":42304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.906459+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:26:09.906459+0000","last_peered":"2024-09-15T12:26:09.906459+0000","last_clean":"2024-09-15T12:26:09.906459+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:26:09.906459+0000","last_undegraded":"2024-09-15T12:26:09.906459+0000","last_fullsized":"2024-09-15T12:26:09.906459+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"64'648","reported_seq":678,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.651943+0000","last_change":"2024-09-15T12:25:19.478666+0000","last_active":"2024-09-15T12:26:10.651943+0000","last_peered":"2024-09-15T12:26:10.651943+0000","last_clean":"2024-09-15T12:26:10.651943+0000","last_became_active":"2024-09-15T12:25:19.468663+0000","last_became_peered":"2024-09-15T12:25:19.468663+0000","last_unstale":"2024-09-15T12:26:10.651943+0000","last_undegraded":"2024-09-15T12:26:10.651943+0000","last_fullsized":"2024-09-15T12:26:10.651943+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42467328,"num_objects":648,"num_object_clones":0,"num_object_copies":1944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":41472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.888896+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:26:09.888896+0000","last_peered":"2024-09-15T12:26:09.888896+0000","last_clean":"2024-09-15T12:26:09.888896+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:26:09.888896+0000","last_undegraded":"2024-09-15T12:26:09.888896+0000","last_fullsized":"2024-09-15T12:26:09.888896+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"64'667","reported_seq":697,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.547549+0000","last_change":"2024-09-15T12:25:19.499536+0000","last_active":"2024-09-15T12:26:10.547549+0000","last_peered":"2024-09-15T12:26:10.547549+0000","last_clean":"2024-09-15T12:26:10.547549+0000","last_became_active":"2024-09-15T12:25:19.493017+0000","last_became_peered":"2024-09-15T12:25:19.493017+0000","last_unstale":"2024-09-15T12:26:10.547549+0000","last_undegraded":"2024-09-15T12:26:10.547549+0000","last_fullsized":"2024-09-15T12:26:10.547549+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43712512,"num_objects":667,"num_object_clones":0,"num_object_copies":2001,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":667,"num_write_kb":42688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":165,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.900992+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:26:09.900992+0000","last_peered":"2024-09-15T12:26:09.900992+0000","last_clean":"2024-09-15T12:26:09.900992+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:26:09.900992+0000","last_undegraded":"2024-09-15T12:26:09.900992+0000","last_fullsized":"2024-09-15T12:26:09.900992+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"64'631","reported_seq":661,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.555976+0000","last_change":"2024-09-15T12:25:19.413209+0000","last_active":"2024-09-15T12:26:10.555976+0000","last_peered":"2024-09-15T12:26:10.555976+0000","last_clean":"2024-09-15T12:26:10.555976+0000","last_became_active":"2024-09-15T12:25:19.403123+0000","last_became_peered":"2024-09-15T12:25:19.403123+0000","last_unstale":"2024-09-15T12:26:10.555976+0000","last_undegraded":"2024-09-15T12:26:10.555976+0000","last_fullsized":"2024-09-15T12:26:10.555976+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41353216,"num_objects":631,"num_object_clones":0,"num_object_copies":1893,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":631,"num_write_kb":40384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.896505+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:26:09.896505+0000","last_peered":"2024-09-15T12:26:09.896505+0000","last_clean":"2024-09-15T12:26:09.896505+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:26:09.896505+0000","last_undegraded":"2024-09-15T12:26:09.896505+0000","last_fullsized":"2024-09-15T12:26:09.896505+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"64'689","reported_seq":719,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.537739+0000","last_change":"2024-09-15T12:25:19.429640+0000","last_active":"2024-09-15T12:26:10.537739+0000","last_peered":"2024-09-15T12:26:10.537739+0000","last_clean":"2024-09-15T12:26:10.537739+0000","last_became_active":"2024-09-15T12:25:19.422585+0000","last_became_peered":"2024-09-15T12:25:19.422585+0000","last_unstale":"2024-09-15T12:26:10.537739+0000","last_undegraded":"2024-09-15T12:26:10.537739+0000","last_fullsized":"2024-09-15T12:26:10.537739+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":689,"log_dups_size":0,"ondisk_log_size":689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45154304,"num_objects":689,"num_object_clones":0,"num_object_copies":2067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":689,"num_write_kb":44096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":166,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.899315+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:26:10.899315+0000","last_peered":"2024-09-15T12:26:10.899315+0000","last_clean":"2024-09-15T12:26:10.899315+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:26:10.899315+0000","last_undegraded":"2024-09-15T12:26:10.899315+0000","last_fullsized":"2024-09-15T12:26:10.899315+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"65'659","reported_seq":692,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T12:26:11.767587+0000","last_change":"2024-09-15T12:25:19.429532+0000","last_active":"2024-09-15T12:26:11.767587+0000","last_peered":"2024-09-15T12:26:11.767587+0000","last_clean":"2024-09-15T12:26:11.767587+0000","last_became_active":"2024-09-15T12:25:19.424570+0000","last_became_peered":"2024-09-15T12:25:19.424570+0000","last_unstale":"2024-09-15T12:26:11.767587+0000","last_undegraded":"2024-09-15T12:26:11.767587+0000","last_fullsized":"2024-09-15T12:26:11.767587+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43188224,"num_objects":659,"num_object_clones":0,"num_object_copies":1977,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":659,"num_write_kb":42176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.893033+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:26:09.893033+0000","last_peered":"2024-09-15T12:26:09.893033+0000","last_clean":"2024-09-15T12:26:09.893033+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:26:09.893033+0000","last_undegraded":"2024-09-15T12:26:09.893033+0000","last_fullsized":"2024-09-15T12:26:09.893033+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"64'616","reported_seq":646,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.601230+0000","last_change":"2024-09-15T12:25:19.453184+0000","last_active":"2024-09-15T12:26:10.601230+0000","last_peered":"2024-09-15T12:26:10.601230+0000","last_clean":"2024-09-15T12:26:10.601230+0000","last_became_active":"2024-09-15T12:25:19.441520+0000","last_became_peered":"2024-09-15T12:25:19.441520+0000","last_unstale":"2024-09-15T12:26:10.601230+0000","last_undegraded":"2024-09-15T12:26:10.601230+0000","last_fullsized":"2024-09-15T12:26:10.601230+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40370176,"num_objects":616,"num_object_clones":0,"num_object_copies":1848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.894930+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:26:09.894930+0000","last_peered":"2024-09-15T12:26:09.894930+0000","last_clean":"2024-09-15T12:26:09.894930+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:26:09.894930+0000","last_undegraded":"2024-09-15T12:26:09.894930+0000","last_fullsized":"2024-09-15T12:26:09.894930+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":683147264,"num_objects":10424,"num_object_clones":0,"num_object_copies":31272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10424,"num_write_kb":667136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":128323584,"data_stored":2053177344,"data_compressed":97492518,"data_compressed_allocated":128323584,"data_compressed_original":2053177344,"omap_allocated":0,"internal_metadata":0},"log_size":10424,"ondisk_log_size":10424,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673408,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":114556,"kb_used_data":29420,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94257284,"statfs":{"total":96636764160,"available":96519458816,"internally_reserved":0,"allocated":30126080,"data_stored":473109124,"data_compressed":22457490,"data_compressed_allocated":29560832,"data_compressed_original":472891392,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706113,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":112272,"kb_used_data":36864,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94259568,"statfs":{"total":96636764160,"available":96521797632,"internally_reserved":0,"allocated":37748736,"data_stored":595133902,"data_compressed":28251792,"data_compressed_allocated":37187584,"data_compressed_original":594919424,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706112,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":107168,"kb_used_data":26192,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94264672,"statfs":{"total":96636764160,"available":96527024128,"internally_reserved":0,"allocated":26820608,"data_stored":420804325,"data_compressed":19972072,"data_compressed_allocated":26288128,"data_compressed_original":420610048,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706112,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123008,"kb_used_data":33712,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94248832,"statfs":{"total":96636764160,"available":96510803968,"internally_reserved":0,"allocated":34521088,"data_stored":543619333,"data_compressed":25805836,"data_compressed_allocated":33968128,"data_compressed_original":543408128,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34430976,"data_stored":550895616,"data_compressed":26158580,"data_compressed_allocated":34430976,"data_compressed_original":550895616,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26664960,"data_stored":426639360,"data_compressed":20258376,"data_compressed_allocated":26664960,"data_compressed_original":426639360,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":37191680,"data_stored":595066880,"data_compressed":28255992,"data_compressed_allocated":37191680,"data_compressed_original":595066880,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":30035968,"data_stored":480575488,"data_compressed":22819570,"data_compressed_allocated":30035968,"data_compressed_original":480575488,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:26:22.768 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:26:22.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:22.910+0000 7ff23e111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:22.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:22.924+0000 7ff23e111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:23.089 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:26:23.227 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:26:23.227 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:26:23.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:23.232+0000 7fa189311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:23.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:23.241+0000 7fa189311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:23.255 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":295,"stamp":"2024-09-15T12:26:22.282188+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":683737651,"num_objects":10428,"num_object_clones":0,"num_object_copies":31284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":10505,"num_write_kb":668244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10479,"ondisk_log_size":10479,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":457004,"kb_used_data":126188,"kb_used_omap":0,"kb_used_meta":330752,"kb_avail":377030356,"statfs":{"total":386547056640,"available":386079084544,"internally_reserved":0,"allocated":129216512,"data_stored":2032666684,"data_compressed":96487190,"data_compressed_allocated":127004672,"data_compressed_original":2031828992,"omap_allocated":0,"internal_metadata":338690048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.031027"},"pg_stats":[{"pgid":"5.f","version":"64'660","reported_seq":690,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.509944+0000","last_change":"2024-09-15T12:25:19.440663+0000","last_active":"2024-09-15T12:26:10.509944+0000","last_peered":"2024-09-15T12:26:10.509944+0000","last_clean":"2024-09-15T12:26:10.509944+0000","last_became_active":"2024-09-15T12:25:19.421824+0000","last_became_peered":"2024-09-15T12:25:19.421824+0000","last_unstale":"2024-09-15T12:26:10.509944+0000","last_undegraded":"2024-09-15T12:26:10.509944+0000","last_fullsized":"2024-09-15T12:26:10.509944+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43253760,"num_objects":660,"num_object_clones":0,"num_object_copies":1980,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":660,"num_write_kb":42240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"64'646","reported_seq":676,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.697483+0000","last_change":"2024-09-15T12:25:19.444566+0000","last_active":"2024-09-15T12:26:10.697483+0000","last_peered":"2024-09-15T12:26:10.697483+0000","last_clean":"2024-09-15T12:26:10.697483+0000","last_became_active":"2024-09-15T12:25:19.436490+0000","last_became_peered":"2024-09-15T12:25:19.436490+0000","last_unstale":"2024-09-15T12:26:10.697483+0000","last_undegraded":"2024-09-15T12:26:10.697483+0000","last_fullsized":"2024-09-15T12:26:10.697483+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42336256,"num_objects":646,"num_object_clones":0,"num_object_copies":1938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":41344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"64'635","reported_seq":665,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.736938+0000","last_change":"2024-09-15T12:25:19.466585+0000","last_active":"2024-09-15T12:26:10.736938+0000","last_peered":"2024-09-15T12:26:10.736938+0000","last_clean":"2024-09-15T12:26:10.736938+0000","last_became_active":"2024-09-15T12:25:19.449036+0000","last_became_peered":"2024-09-15T12:25:19.449036+0000","last_unstale":"2024-09-15T12:26:10.736938+0000","last_undegraded":"2024-09-15T12:26:10.736938+0000","last_fullsized":"2024-09-15T12:26:10.736938+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41615360,"num_objects":635,"num_object_clones":0,"num_object_copies":1905,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":635,"num_write_kb":40640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"65'708","reported_seq":741,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T12:26:11.770322+0000","last_change":"2024-09-15T12:25:19.412052+0000","last_active":"2024-09-15T12:26:11.770322+0000","last_peered":"2024-09-15T12:26:11.770322+0000","last_clean":"2024-09-15T12:26:11.770322+0000","last_became_active":"2024-09-15T12:25:19.396072+0000","last_became_peered":"2024-09-15T12:25:19.396072+0000","last_unstale":"2024-09-15T12:26:11.770322+0000","last_undegraded":"2024-09-15T12:26:11.770322+0000","last_fullsized":"2024-09-15T12:26:11.770322+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46399488,"num_objects":708,"num_object_clones":0,"num_object_copies":2124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":45312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"64'626","reported_seq":656,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.684970+0000","last_change":"2024-09-15T12:25:19.447319+0000","last_active":"2024-09-15T12:26:10.684970+0000","last_peered":"2024-09-15T12:26:10.684970+0000","last_clean":"2024-09-15T12:26:10.684970+0000","last_became_active":"2024-09-15T12:25:19.436362+0000","last_became_peered":"2024-09-15T12:25:19.436362+0000","last_unstale":"2024-09-15T12:26:10.684970+0000","last_undegraded":"2024-09-15T12:26:10.684970+0000","last_fullsized":"2024-09-15T12:26:10.684970+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41025536,"num_objects":626,"num_object_clones":0,"num_object_copies":1878,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":626,"num_write_kb":40064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"64'651","reported_seq":681,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.752744+0000","last_change":"2024-09-15T12:25:19.475504+0000","last_active":"2024-09-15T12:26:10.752744+0000","last_peered":"2024-09-15T12:26:10.752744+0000","last_clean":"2024-09-15T12:26:10.752744+0000","last_became_active":"2024-09-15T12:25:19.467940+0000","last_became_peered":"2024-09-15T12:25:19.467940+0000","last_unstale":"2024-09-15T12:26:10.752744+0000","last_undegraded":"2024-09-15T12:26:10.752744+0000","last_fullsized":"2024-09-15T12:26:10.752744+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42663936,"num_objects":651,"num_object_clones":0,"num_object_copies":1953,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":651,"num_write_kb":41664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"64'628","reported_seq":658,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.655597+0000","last_change":"2024-09-15T12:25:19.403222+0000","last_active":"2024-09-15T12:26:10.655597+0000","last_peered":"2024-09-15T12:26:10.655597+0000","last_clean":"2024-09-15T12:26:10.655597+0000","last_became_active":"2024-09-15T12:25:19.396442+0000","last_became_peered":"2024-09-15T12:25:19.396442+0000","last_unstale":"2024-09-15T12:26:10.655597+0000","last_undegraded":"2024-09-15T12:26:10.655597+0000","last_fullsized":"2024-09-15T12:26:10.655597+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41156608,"num_objects":628,"num_object_clones":0,"num_object_copies":1884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":40192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"64'669","reported_seq":699,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.481357+0000","last_change":"2024-09-15T12:25:19.418093+0000","last_active":"2024-09-15T12:26:10.481357+0000","last_peered":"2024-09-15T12:26:10.481357+0000","last_clean":"2024-09-15T12:26:10.481357+0000","last_became_active":"2024-09-15T12:25:19.412762+0000","last_became_peered":"2024-09-15T12:25:19.412762+0000","last_unstale":"2024-09-15T12:26:10.481357+0000","last_undegraded":"2024-09-15T12:26:10.481357+0000","last_fullsized":"2024-09-15T12:26:10.481357+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43843584,"num_objects":669,"num_object_clones":0,"num_object_copies":2007,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":669,"num_write_kb":42816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"64'630","reported_seq":660,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.604228+0000","last_change":"2024-09-15T12:25:19.514099+0000","last_active":"2024-09-15T12:26:10.604228+0000","last_peered":"2024-09-15T12:26:10.604228+0000","last_clean":"2024-09-15T12:26:10.604228+0000","last_became_active":"2024-09-15T12:25:19.506892+0000","last_became_peered":"2024-09-15T12:25:19.506892+0000","last_unstale":"2024-09-15T12:26:10.604228+0000","last_undegraded":"2024-09-15T12:26:10.604228+0000","last_fullsized":"2024-09-15T12:26:10.604228+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41287680,"num_objects":630,"num_object_clones":0,"num_object_copies":1890,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":630,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":238,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.895525+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:26:10.895525+0000","last_peered":"2024-09-15T12:26:10.895525+0000","last_clean":"2024-09-15T12:26:10.895525+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:26:10.895525+0000","last_undegraded":"2024-09-15T12:26:10.895525+0000","last_fullsized":"2024-09-15T12:26:10.895525+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":164,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.894505+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:26:09.894505+0000","last_peered":"2024-09-15T12:26:09.894505+0000","last_clean":"2024-09-15T12:26:09.894505+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:26:09.894505+0000","last_undegraded":"2024-09-15T12:26:09.894505+0000","last_fullsized":"2024-09-15T12:26:09.894505+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"64'661","reported_seq":691,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.654211+0000","last_change":"2024-09-15T12:25:19.470256+0000","last_active":"2024-09-15T12:26:10.654211+0000","last_peered":"2024-09-15T12:26:10.654211+0000","last_clean":"2024-09-15T12:26:10.654211+0000","last_became_active":"2024-09-15T12:25:19.458317+0000","last_became_peered":"2024-09-15T12:25:19.458317+0000","last_unstale":"2024-09-15T12:26:10.654211+0000","last_undegraded":"2024-09-15T12:26:10.654211+0000","last_fullsized":"2024-09-15T12:26:10.654211+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43319296,"num_objects":661,"num_object_clones":0,"num_object_copies":1983,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":661,"num_write_kb":42304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.906459+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:26:09.906459+0000","last_peered":"2024-09-15T12:26:09.906459+0000","last_clean":"2024-09-15T12:26:09.906459+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:26:09.906459+0000","last_undegraded":"2024-09-15T12:26:09.906459+0000","last_fullsized":"2024-09-15T12:26:09.906459+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"64'648","reported_seq":678,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.651943+0000","last_change":"2024-09-15T12:25:19.478666+0000","last_active":"2024-09-15T12:26:10.651943+0000","last_peered":"2024-09-15T12:26:10.651943+0000","last_clean":"2024-09-15T12:26:10.651943+0000","last_became_active":"2024-09-15T12:25:19.468663+0000","last_became_peered":"2024-09-15T12:25:19.468663+0000","last_unstale":"2024-09-15T12:26:10.651943+0000","last_undegraded":"2024-09-15T12:26:10.651943+0000","last_fullsized":"2024-09-15T12:26:10.651943+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42467328,"num_objects":648,"num_object_clones":0,"num_object_copies":1944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":41472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.888896+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:26:09.888896+0000","last_peered":"2024-09-15T12:26:09.888896+0000","last_clean":"2024-09-15T12:26:09.888896+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:26:09.888896+0000","last_undegraded":"2024-09-15T12:26:09.888896+0000","last_fullsized":"2024-09-15T12:26:09.888896+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"64'667","reported_seq":697,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.547549+0000","last_change":"2024-09-15T12:25:19.499536+0000","last_active":"2024-09-15T12:26:10.547549+0000","last_peered":"2024-09-15T12:26:10.547549+0000","last_clean":"2024-09-15T12:26:10.547549+0000","last_became_active":"2024-09-15T12:25:19.493017+0000","last_became_peered":"2024-09-15T12:25:19.493017+0000","last_unstale":"2024-09-15T12:26:10.547549+0000","last_undegraded":"2024-09-15T12:26:10.547549+0000","last_fullsized":"2024-09-15T12:26:10.547549+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43712512,"num_objects":667,"num_object_clones":0,"num_object_copies":2001,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":667,"num_write_kb":42688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":165,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.900992+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:26:09.900992+0000","last_peered":"2024-09-15T12:26:09.900992+0000","last_clean":"2024-09-15T12:26:09.900992+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:26:09.900992+0000","last_undegraded":"2024-09-15T12:26:09.900992+0000","last_fullsized":"2024-09-15T12:26:09.900992+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"64'631","reported_seq":661,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.555976+0000","last_change":"2024-09-15T12:25:19.413209+0000","last_active":"2024-09-15T12:26:10.555976+0000","last_peered":"2024-09-15T12:26:10.555976+0000","last_clean":"2024-09-15T12:26:10.555976+0000","last_became_active":"2024-09-15T12:25:19.403123+0000","last_became_peered":"2024-09-15T12:25:19.403123+0000","last_unstale":"2024-09-15T12:26:10.555976+0000","last_undegraded":"2024-09-15T12:26:10.555976+0000","last_fullsized":"2024-09-15T12:26:10.555976+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41353216,"num_objects":631,"num_object_clones":0,"num_object_copies":1893,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":631,"num_write_kb":40384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.896505+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:26:09.896505+0000","last_peered":"2024-09-15T12:26:09.896505+0000","last_clean":"2024-09-15T12:26:09.896505+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:26:09.896505+0000","last_undegraded":"2024-09-15T12:26:09.896505+0000","last_fullsized":"2024-09-15T12:26:09.896505+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"64'689","reported_seq":719,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.537739+0000","last_change":"2024-09-15T12:25:19.429640+0000","last_active":"2024-09-15T12:26:10.537739+0000","last_peered":"2024-09-15T12:26:10.537739+0000","last_clean":"2024-09-15T12:26:10.537739+0000","last_became_active":"2024-09-15T12:25:19.422585+0000","last_became_peered":"2024-09-15T12:25:19.422585+0000","last_unstale":"2024-09-15T12:26:10.537739+0000","last_undegraded":"2024-09-15T12:26:10.537739+0000","last_fullsized":"2024-09-15T12:26:10.537739+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":689,"log_dups_size":0,"ondisk_log_size":689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45154304,"num_objects":689,"num_object_clones":0,"num_object_copies":2067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":689,"num_write_kb":44096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":166,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.899315+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:26:10.899315+0000","last_peered":"2024-09-15T12:26:10.899315+0000","last_clean":"2024-09-15T12:26:10.899315+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:26:10.899315+0000","last_undegraded":"2024-09-15T12:26:10.899315+0000","last_fullsized":"2024-09-15T12:26:10.899315+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"65'659","reported_seq":692,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T12:26:11.767587+0000","last_change":"2024-09-15T12:25:19.429532+0000","last_active":"2024-09-15T12:26:11.767587+0000","last_peered":"2024-09-15T12:26:11.767587+0000","last_clean":"2024-09-15T12:26:11.767587+0000","last_became_active":"2024-09-15T12:25:19.424570+0000","last_became_peered":"2024-09-15T12:25:19.424570+0000","last_unstale":"2024-09-15T12:26:11.767587+0000","last_undegraded":"2024-09-15T12:26:11.767587+0000","last_fullsized":"2024-09-15T12:26:11.767587+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43188224,"num_objects":659,"num_object_clones":0,"num_object_copies":1977,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":659,"num_write_kb":42176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.893033+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:26:09.893033+0000","last_peered":"2024-09-15T12:26:09.893033+0000","last_clean":"2024-09-15T12:26:09.893033+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:26:09.893033+0000","last_undegraded":"2024-09-15T12:26:09.893033+0000","last_fullsized":"2024-09-15T12:26:09.893033+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"64'616","reported_seq":646,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.601230+0000","last_change":"2024-09-15T12:25:19.453184+0000","last_active":"2024-09-15T12:26:10.601230+0000","last_peered":"2024-09-15T12:26:10.601230+0000","last_clean":"2024-09-15T12:26:10.601230+0000","last_became_active":"2024-09-15T12:25:19.441520+0000","last_became_peered":"2024-09-15T12:25:19.441520+0000","last_unstale":"2024-09-15T12:26:10.601230+0000","last_undegraded":"2024-09-15T12:26:10.601230+0000","last_fullsized":"2024-09-15T12:26:10.601230+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40370176,"num_objects":616,"num_object_clones":0,"num_object_copies":1848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.894930+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:26:09.894930+0000","last_peered":"2024-09-15T12:26:09.894930+0000","last_clean":"2024-09-15T12:26:09.894930+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:26:09.894930+0000","last_undegraded":"2024-09-15T12:26:09.894930+0000","last_fullsized":"2024-09-15T12:26:09.894930+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":683147264,"num_objects":10424,"num_object_clones":0,"num_object_copies":31272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10424,"num_write_kb":667136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":128323584,"data_stored":2053177344,"data_compressed":97492518,"data_compressed_allocated":128323584,"data_compressed_original":2053177344,"omap_allocated":0,"internal_metadata":0},"log_size":10424,"ondisk_log_size":10424,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673408,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":114556,"kb_used_data":29420,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94257284,"statfs":{"total":96636764160,"available":96519458816,"internally_reserved":0,"allocated":30126080,"data_stored":473109124,"data_compressed":22457490,"data_compressed_allocated":29560832,"data_compressed_original":472891392,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706113,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":112272,"kb_used_data":36864,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94259568,"statfs":{"total":96636764160,"available":96521797632,"internally_reserved":0,"allocated":37748736,"data_stored":595133902,"data_compressed":28251792,"data_compressed_allocated":37187584,"data_compressed_original":594919424,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706112,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":107168,"kb_used_data":26192,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94264672,"statfs":{"total":96636764160,"available":96527024128,"internally_reserved":0,"allocated":26820608,"data_stored":420804325,"data_compressed":19972072,"data_compressed_allocated":26288128,"data_compressed_original":420610048,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706112,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123008,"kb_used_data":33712,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94248832,"statfs":{"total":96636764160,"available":96510803968,"internally_reserved":0,"allocated":34521088,"data_stored":543619333,"data_compressed":25805836,"data_compressed_allocated":33968128,"data_compressed_original":543408128,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34430976,"data_stored":550895616,"data_compressed":26158580,"data_compressed_allocated":34430976,"data_compressed_original":550895616,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26664960,"data_stored":426639360,"data_compressed":20258376,"data_compressed_allocated":26664960,"data_compressed_original":426639360,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":37191680,"data_stored":595066880,"data_compressed":28255992,"data_compressed_allocated":37191680,"data_compressed_original":595066880,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":30035968,"data_stored":480575488,"data_compressed":22819570,"data_compressed_allocated":30035968,"data_compressed_original":480575488,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:26:23.257 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-15T12:26:23.257 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:26:23.257 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:26:23.257 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:26:23.386 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 63 16 12718 12702 12.5999 10.6875 0.117242 0.0792832 2024-09-15T12:26:23.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:23.428+0000 7f4c67e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:23.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:23.445+0000 7f4c67e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:23.615 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:26:23.615 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:26:23.615 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:26:23.615 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:26:23.615 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:26:23.615 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:26:23.615 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:26:23.616 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:26:23.616 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:26:23.616 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:26:23.616 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:26:23.616 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:26:23.620 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:26:23.620 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:26:23.621 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:26:23.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:23.811+0000 7fb45f2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:23.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:23.823+0000 7fb45f2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:23.894 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:26:23.895 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:26:23.895 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:26:23.895 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:26:23.895 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:26:23.895 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:26:23.895 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:26:23.895 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:26:23.895 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:26:23.895 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:26:23.895 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:26:23.895 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:26:23.900 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:26:23.900 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:26:23.900 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:26:24.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:24.061+0000 7f1c16f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:24.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:24.075+0000 7f1c16f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:24.187 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:26:24.187 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:26:24.187 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:26:24.187 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:26:24.187 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:26:24.187 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:26:24.188 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:26:24.188 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:26:24.188 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:26:24.188 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:26:24.188 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:26:24.188 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:26:24.191 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:26:24.192 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:26:24.192 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:26:24.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:24.338+0000 7fd50287f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:24.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:24.351+0000 7fd50287f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:24.386 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 64 16 12895 12879 12.5758 11.0625 0.13241 0.0794648 2024-09-15T12:26:24.405 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:26:24.405 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:26:24.405 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:26:24.405 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:26:24.405 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:26:24.405 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:26:24.405 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:26:24.405 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:26:24.405 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:26:24.406 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:26:24.406 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:26:24.406 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:26:24.410 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:26:24.411 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:26:25.386 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 65 16 13083 13067 12.5631 11.75 0.0666376 0.0795397 2024-09-15T12:26:25.597 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:26:25.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:25.762+0000 7f758d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:25.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:25.771+0000 7f758d391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:26.386 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 66 16 13259 13243 12.5394 11 0.10182 0.079666 2024-09-15T12:26:27.386 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 67 16 13443 13427 12.5239 11.5 0.0640179 0.0797798 2024-09-15T12:26:28.075 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:26:28.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:28.234+0000 7f77d4591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:28.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:28.244+0000 7f77d4591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:28.386 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 68 16 13634 13618 12.5152 11.9375 0.0730609 0.0798386 2024-09-15T12:26:29.386 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 69 16 13805 13789 12.4887 10.6875 0.115209 0.0799922 2024-09-15T12:26:29.412 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:26:29.412 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-15T12:26:29.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:29.565+0000 7ff480257640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:29.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:29.584+0000 7ff480257640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:30.386 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 70 16 13979 13963 12.4657 10.875 0.123779 0.0801216 2024-09-15T12:26:30.597 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:26:30.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:30.758+0000 7f002165c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:30.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:30.767+0000 7f002165c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:30.857 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.0 to 1 (10000) 2024-09-15T12:26:30.883 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-15T12:26:31.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:31.050+0000 7f50b28d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:31.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:31.068+0000 7f50b28d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:31.386 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 71 16 14152 14136 12.4424 10.8125 0.139304 0.0802803 2024-09-15T12:26:31.858 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.1 to 1 (10000) 2024-09-15T12:26:31.882 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-15T12:26:32.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:32.050+0000 7f4a31751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:32.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:32.067+0000 7f4a31751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:32.386 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 72 16 14315 14299 12.411 10.1875 0.0996364 0.0805249 2024-09-15T12:26:32.868 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.2 to 1 (10000) 2024-09-15T12:26:32.888 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-15T12:26:33.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:33.051+0000 7f643eebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:33.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:33.066+0000 7f643eebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:33.126 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:26:33.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:33.291+0000 7f0a0ea5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:33.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:33.306+0000 7f0a0ea5c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:33.386 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 73 16 14488 14472 12.3891 10.8125 0.0601594 0.0806361 2024-09-15T12:26:34.266 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.3 to 1 (10000) 2024-09-15T12:26:34.290 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-15T12:26:34.290 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:26:34.386 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 74 16 14676 14660 12.3805 11.75 0.0488573 0.0807421 2024-09-15T12:26:34.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:34.450+0000 7fd904591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:34.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:34.465+0000 7fd904591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:34.802 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:26:34.803 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:26:34.823 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":306,"stamp":"2024-09-15T12:26:34.266295+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":683737651,"num_objects":10428,"num_object_clones":0,"num_object_copies":31284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":10505,"num_write_kb":668244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10479,"ondisk_log_size":10479,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":457004,"kb_used_data":126188,"kb_used_omap":0,"kb_used_meta":330752,"kb_avail":377030356,"statfs":{"total":386547056640,"available":386079084544,"internally_reserved":0,"allocated":129216512,"data_stored":2032666684,"data_compressed":96487190,"data_compressed_allocated":127004672,"data_compressed_original":2031828992,"omap_allocated":0,"internal_metadata":338690048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.407240"},"pg_stats":[{"pgid":"5.f","version":"64'660","reported_seq":690,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.509944+0000","last_change":"2024-09-15T12:25:19.440663+0000","last_active":"2024-09-15T12:26:10.509944+0000","last_peered":"2024-09-15T12:26:10.509944+0000","last_clean":"2024-09-15T12:26:10.509944+0000","last_became_active":"2024-09-15T12:25:19.421824+0000","last_became_peered":"2024-09-15T12:25:19.421824+0000","last_unstale":"2024-09-15T12:26:10.509944+0000","last_undegraded":"2024-09-15T12:26:10.509944+0000","last_fullsized":"2024-09-15T12:26:10.509944+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43253760,"num_objects":660,"num_object_clones":0,"num_object_copies":1980,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":660,"num_write_kb":42240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"64'646","reported_seq":676,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.697483+0000","last_change":"2024-09-15T12:25:19.444566+0000","last_active":"2024-09-15T12:26:10.697483+0000","last_peered":"2024-09-15T12:26:10.697483+0000","last_clean":"2024-09-15T12:26:10.697483+0000","last_became_active":"2024-09-15T12:25:19.436490+0000","last_became_peered":"2024-09-15T12:25:19.436490+0000","last_unstale":"2024-09-15T12:26:10.697483+0000","last_undegraded":"2024-09-15T12:26:10.697483+0000","last_fullsized":"2024-09-15T12:26:10.697483+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42336256,"num_objects":646,"num_object_clones":0,"num_object_copies":1938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":41344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"64'635","reported_seq":665,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.736938+0000","last_change":"2024-09-15T12:25:19.466585+0000","last_active":"2024-09-15T12:26:10.736938+0000","last_peered":"2024-09-15T12:26:10.736938+0000","last_clean":"2024-09-15T12:26:10.736938+0000","last_became_active":"2024-09-15T12:25:19.449036+0000","last_became_peered":"2024-09-15T12:25:19.449036+0000","last_unstale":"2024-09-15T12:26:10.736938+0000","last_undegraded":"2024-09-15T12:26:10.736938+0000","last_fullsized":"2024-09-15T12:26:10.736938+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41615360,"num_objects":635,"num_object_clones":0,"num_object_copies":1905,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":635,"num_write_kb":40640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"65'708","reported_seq":741,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T12:26:11.770322+0000","last_change":"2024-09-15T12:25:19.412052+0000","last_active":"2024-09-15T12:26:11.770322+0000","last_peered":"2024-09-15T12:26:11.770322+0000","last_clean":"2024-09-15T12:26:11.770322+0000","last_became_active":"2024-09-15T12:25:19.396072+0000","last_became_peered":"2024-09-15T12:25:19.396072+0000","last_unstale":"2024-09-15T12:26:11.770322+0000","last_undegraded":"2024-09-15T12:26:11.770322+0000","last_fullsized":"2024-09-15T12:26:11.770322+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46399488,"num_objects":708,"num_object_clones":0,"num_object_copies":2124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":45312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"64'626","reported_seq":656,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.684970+0000","last_change":"2024-09-15T12:25:19.447319+0000","last_active":"2024-09-15T12:26:10.684970+0000","last_peered":"2024-09-15T12:26:10.684970+0000","last_clean":"2024-09-15T12:26:10.684970+0000","last_became_active":"2024-09-15T12:25:19.436362+0000","last_became_peered":"2024-09-15T12:25:19.436362+0000","last_unstale":"2024-09-15T12:26:10.684970+0000","last_undegraded":"2024-09-15T12:26:10.684970+0000","last_fullsized":"2024-09-15T12:26:10.684970+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41025536,"num_objects":626,"num_object_clones":0,"num_object_copies":1878,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":626,"num_write_kb":40064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"64'651","reported_seq":681,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.752744+0000","last_change":"2024-09-15T12:25:19.475504+0000","last_active":"2024-09-15T12:26:10.752744+0000","last_peered":"2024-09-15T12:26:10.752744+0000","last_clean":"2024-09-15T12:26:10.752744+0000","last_became_active":"2024-09-15T12:25:19.467940+0000","last_became_peered":"2024-09-15T12:25:19.467940+0000","last_unstale":"2024-09-15T12:26:10.752744+0000","last_undegraded":"2024-09-15T12:26:10.752744+0000","last_fullsized":"2024-09-15T12:26:10.752744+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42663936,"num_objects":651,"num_object_clones":0,"num_object_copies":1953,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":651,"num_write_kb":41664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"64'628","reported_seq":658,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.655597+0000","last_change":"2024-09-15T12:25:19.403222+0000","last_active":"2024-09-15T12:26:10.655597+0000","last_peered":"2024-09-15T12:26:10.655597+0000","last_clean":"2024-09-15T12:26:10.655597+0000","last_became_active":"2024-09-15T12:25:19.396442+0000","last_became_peered":"2024-09-15T12:25:19.396442+0000","last_unstale":"2024-09-15T12:26:10.655597+0000","last_undegraded":"2024-09-15T12:26:10.655597+0000","last_fullsized":"2024-09-15T12:26:10.655597+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41156608,"num_objects":628,"num_object_clones":0,"num_object_copies":1884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":40192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"64'669","reported_seq":699,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.481357+0000","last_change":"2024-09-15T12:25:19.418093+0000","last_active":"2024-09-15T12:26:10.481357+0000","last_peered":"2024-09-15T12:26:10.481357+0000","last_clean":"2024-09-15T12:26:10.481357+0000","last_became_active":"2024-09-15T12:25:19.412762+0000","last_became_peered":"2024-09-15T12:25:19.412762+0000","last_unstale":"2024-09-15T12:26:10.481357+0000","last_undegraded":"2024-09-15T12:26:10.481357+0000","last_fullsized":"2024-09-15T12:26:10.481357+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43843584,"num_objects":669,"num_object_clones":0,"num_object_copies":2007,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":669,"num_write_kb":42816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"64'630","reported_seq":660,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.604228+0000","last_change":"2024-09-15T12:25:19.514099+0000","last_active":"2024-09-15T12:26:10.604228+0000","last_peered":"2024-09-15T12:26:10.604228+0000","last_clean":"2024-09-15T12:26:10.604228+0000","last_became_active":"2024-09-15T12:25:19.506892+0000","last_became_peered":"2024-09-15T12:25:19.506892+0000","last_unstale":"2024-09-15T12:26:10.604228+0000","last_undegraded":"2024-09-15T12:26:10.604228+0000","last_fullsized":"2024-09-15T12:26:10.604228+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41287680,"num_objects":630,"num_object_clones":0,"num_object_copies":1890,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":630,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":238,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.895525+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:26:10.895525+0000","last_peered":"2024-09-15T12:26:10.895525+0000","last_clean":"2024-09-15T12:26:10.895525+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:26:10.895525+0000","last_undegraded":"2024-09-15T12:26:10.895525+0000","last_fullsized":"2024-09-15T12:26:10.895525+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":164,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.894505+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:26:09.894505+0000","last_peered":"2024-09-15T12:26:09.894505+0000","last_clean":"2024-09-15T12:26:09.894505+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:26:09.894505+0000","last_undegraded":"2024-09-15T12:26:09.894505+0000","last_fullsized":"2024-09-15T12:26:09.894505+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"64'661","reported_seq":691,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.654211+0000","last_change":"2024-09-15T12:25:19.470256+0000","last_active":"2024-09-15T12:26:10.654211+0000","last_peered":"2024-09-15T12:26:10.654211+0000","last_clean":"2024-09-15T12:26:10.654211+0000","last_became_active":"2024-09-15T12:25:19.458317+0000","last_became_peered":"2024-09-15T12:25:19.458317+0000","last_unstale":"2024-09-15T12:26:10.654211+0000","last_undegraded":"2024-09-15T12:26:10.654211+0000","last_fullsized":"2024-09-15T12:26:10.654211+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43319296,"num_objects":661,"num_object_clones":0,"num_object_copies":1983,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":661,"num_write_kb":42304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.906459+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:26:09.906459+0000","last_peered":"2024-09-15T12:26:09.906459+0000","last_clean":"2024-09-15T12:26:09.906459+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:26:09.906459+0000","last_undegraded":"2024-09-15T12:26:09.906459+0000","last_fullsized":"2024-09-15T12:26:09.906459+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"64'648","reported_seq":678,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.651943+0000","last_change":"2024-09-15T12:25:19.478666+0000","last_active":"2024-09-15T12:26:10.651943+0000","last_peered":"2024-09-15T12:26:10.651943+0000","last_clean":"2024-09-15T12:26:10.651943+0000","last_became_active":"2024-09-15T12:25:19.468663+0000","last_became_peered":"2024-09-15T12:25:19.468663+0000","last_unstale":"2024-09-15T12:26:10.651943+0000","last_undegraded":"2024-09-15T12:26:10.651943+0000","last_fullsized":"2024-09-15T12:26:10.651943+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42467328,"num_objects":648,"num_object_clones":0,"num_object_copies":1944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":41472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.888896+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:26:09.888896+0000","last_peered":"2024-09-15T12:26:09.888896+0000","last_clean":"2024-09-15T12:26:09.888896+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:26:09.888896+0000","last_undegraded":"2024-09-15T12:26:09.888896+0000","last_fullsized":"2024-09-15T12:26:09.888896+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"64'667","reported_seq":697,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.547549+0000","last_change":"2024-09-15T12:25:19.499536+0000","last_active":"2024-09-15T12:26:10.547549+0000","last_peered":"2024-09-15T12:26:10.547549+0000","last_clean":"2024-09-15T12:26:10.547549+0000","last_became_active":"2024-09-15T12:25:19.493017+0000","last_became_peered":"2024-09-15T12:25:19.493017+0000","last_unstale":"2024-09-15T12:26:10.547549+0000","last_undegraded":"2024-09-15T12:26:10.547549+0000","last_fullsized":"2024-09-15T12:26:10.547549+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43712512,"num_objects":667,"num_object_clones":0,"num_object_copies":2001,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":667,"num_write_kb":42688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":165,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.900992+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:26:09.900992+0000","last_peered":"2024-09-15T12:26:09.900992+0000","last_clean":"2024-09-15T12:26:09.900992+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:26:09.900992+0000","last_undegraded":"2024-09-15T12:26:09.900992+0000","last_fullsized":"2024-09-15T12:26:09.900992+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"64'631","reported_seq":661,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.555976+0000","last_change":"2024-09-15T12:25:19.413209+0000","last_active":"2024-09-15T12:26:10.555976+0000","last_peered":"2024-09-15T12:26:10.555976+0000","last_clean":"2024-09-15T12:26:10.555976+0000","last_became_active":"2024-09-15T12:25:19.403123+0000","last_became_peered":"2024-09-15T12:25:19.403123+0000","last_unstale":"2024-09-15T12:26:10.555976+0000","last_undegraded":"2024-09-15T12:26:10.555976+0000","last_fullsized":"2024-09-15T12:26:10.555976+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41353216,"num_objects":631,"num_object_clones":0,"num_object_copies":1893,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":631,"num_write_kb":40384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.896505+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:26:09.896505+0000","last_peered":"2024-09-15T12:26:09.896505+0000","last_clean":"2024-09-15T12:26:09.896505+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:26:09.896505+0000","last_undegraded":"2024-09-15T12:26:09.896505+0000","last_fullsized":"2024-09-15T12:26:09.896505+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"64'689","reported_seq":719,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.537739+0000","last_change":"2024-09-15T12:25:19.429640+0000","last_active":"2024-09-15T12:26:10.537739+0000","last_peered":"2024-09-15T12:26:10.537739+0000","last_clean":"2024-09-15T12:26:10.537739+0000","last_became_active":"2024-09-15T12:25:19.422585+0000","last_became_peered":"2024-09-15T12:25:19.422585+0000","last_unstale":"2024-09-15T12:26:10.537739+0000","last_undegraded":"2024-09-15T12:26:10.537739+0000","last_fullsized":"2024-09-15T12:26:10.537739+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":689,"log_dups_size":0,"ondisk_log_size":689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45154304,"num_objects":689,"num_object_clones":0,"num_object_copies":2067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":689,"num_write_kb":44096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":166,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.899315+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:26:10.899315+0000","last_peered":"2024-09-15T12:26:10.899315+0000","last_clean":"2024-09-15T12:26:10.899315+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:26:10.899315+0000","last_undegraded":"2024-09-15T12:26:10.899315+0000","last_fullsized":"2024-09-15T12:26:10.899315+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"65'659","reported_seq":692,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T12:26:11.767587+0000","last_change":"2024-09-15T12:25:19.429532+0000","last_active":"2024-09-15T12:26:11.767587+0000","last_peered":"2024-09-15T12:26:11.767587+0000","last_clean":"2024-09-15T12:26:11.767587+0000","last_became_active":"2024-09-15T12:25:19.424570+0000","last_became_peered":"2024-09-15T12:25:19.424570+0000","last_unstale":"2024-09-15T12:26:11.767587+0000","last_undegraded":"2024-09-15T12:26:11.767587+0000","last_fullsized":"2024-09-15T12:26:11.767587+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43188224,"num_objects":659,"num_object_clones":0,"num_object_copies":1977,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":659,"num_write_kb":42176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.893033+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:26:09.893033+0000","last_peered":"2024-09-15T12:26:09.893033+0000","last_clean":"2024-09-15T12:26:09.893033+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:26:09.893033+0000","last_undegraded":"2024-09-15T12:26:09.893033+0000","last_fullsized":"2024-09-15T12:26:09.893033+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"64'616","reported_seq":646,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.601230+0000","last_change":"2024-09-15T12:25:19.453184+0000","last_active":"2024-09-15T12:26:10.601230+0000","last_peered":"2024-09-15T12:26:10.601230+0000","last_clean":"2024-09-15T12:26:10.601230+0000","last_became_active":"2024-09-15T12:25:19.441520+0000","last_became_peered":"2024-09-15T12:25:19.441520+0000","last_unstale":"2024-09-15T12:26:10.601230+0000","last_undegraded":"2024-09-15T12:26:10.601230+0000","last_fullsized":"2024-09-15T12:26:10.601230+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40370176,"num_objects":616,"num_object_clones":0,"num_object_copies":1848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.894930+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:26:09.894930+0000","last_peered":"2024-09-15T12:26:09.894930+0000","last_clean":"2024-09-15T12:26:09.894930+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:26:09.894930+0000","last_undegraded":"2024-09-15T12:26:09.894930+0000","last_fullsized":"2024-09-15T12:26:09.894930+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":683147264,"num_objects":10424,"num_object_clones":0,"num_object_copies":31272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10424,"num_write_kb":667136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":128323584,"data_stored":2053177344,"data_compressed":97492518,"data_compressed_allocated":128323584,"data_compressed_original":2053177344,"omap_allocated":0,"internal_metadata":0},"log_size":10424,"ondisk_log_size":10424,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673408,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":114556,"kb_used_data":29420,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94257284,"statfs":{"total":96636764160,"available":96519458816,"internally_reserved":0,"allocated":30126080,"data_stored":473109124,"data_compressed":22457490,"data_compressed_allocated":29560832,"data_compressed_original":472891392,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706113,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":112272,"kb_used_data":36864,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94259568,"statfs":{"total":96636764160,"available":96521797632,"internally_reserved":0,"allocated":37748736,"data_stored":595133902,"data_compressed":28251792,"data_compressed_allocated":37187584,"data_compressed_original":594919424,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706112,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":107168,"kb_used_data":26192,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94264672,"statfs":{"total":96636764160,"available":96527024128,"internally_reserved":0,"allocated":26820608,"data_stored":420804325,"data_compressed":19972072,"data_compressed_allocated":26288128,"data_compressed_original":420610048,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706112,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123008,"kb_used_data":33712,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94248832,"statfs":{"total":96636764160,"available":96510803968,"internally_reserved":0,"allocated":34521088,"data_stored":543619333,"data_compressed":25805836,"data_compressed_allocated":33968128,"data_compressed_original":543408128,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34430976,"data_stored":550895616,"data_compressed":26158580,"data_compressed_allocated":34430976,"data_compressed_original":550895616,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26664960,"data_stored":426639360,"data_compressed":20258376,"data_compressed_allocated":26664960,"data_compressed_original":426639360,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":37191680,"data_stored":595066880,"data_compressed":28255992,"data_compressed_allocated":37191680,"data_compressed_original":595066880,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":30035968,"data_stored":480575488,"data_compressed":22819570,"data_compressed_allocated":30035968,"data_compressed_original":480575488,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:26:34.824 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:26:34.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:34.975+0000 7f1441151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:34.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:34.988+0000 7f1441151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:35.317 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:26:35.318 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:26:35.343 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":306,"stamp":"2024-09-15T12:26:34.266295+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":683737651,"num_objects":10428,"num_object_clones":0,"num_object_copies":31284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":10505,"num_write_kb":668244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10479,"ondisk_log_size":10479,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":457004,"kb_used_data":126188,"kb_used_omap":0,"kb_used_meta":330752,"kb_avail":377030356,"statfs":{"total":386547056640,"available":386079084544,"internally_reserved":0,"allocated":129216512,"data_stored":2032666684,"data_compressed":96487190,"data_compressed_allocated":127004672,"data_compressed_original":2031828992,"omap_allocated":0,"internal_metadata":338690048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.407240"},"pg_stats":[{"pgid":"5.f","version":"64'660","reported_seq":690,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.509944+0000","last_change":"2024-09-15T12:25:19.440663+0000","last_active":"2024-09-15T12:26:10.509944+0000","last_peered":"2024-09-15T12:26:10.509944+0000","last_clean":"2024-09-15T12:26:10.509944+0000","last_became_active":"2024-09-15T12:25:19.421824+0000","last_became_peered":"2024-09-15T12:25:19.421824+0000","last_unstale":"2024-09-15T12:26:10.509944+0000","last_undegraded":"2024-09-15T12:26:10.509944+0000","last_fullsized":"2024-09-15T12:26:10.509944+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43253760,"num_objects":660,"num_object_clones":0,"num_object_copies":1980,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":660,"num_write_kb":42240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"64'646","reported_seq":676,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.697483+0000","last_change":"2024-09-15T12:25:19.444566+0000","last_active":"2024-09-15T12:26:10.697483+0000","last_peered":"2024-09-15T12:26:10.697483+0000","last_clean":"2024-09-15T12:26:10.697483+0000","last_became_active":"2024-09-15T12:25:19.436490+0000","last_became_peered":"2024-09-15T12:25:19.436490+0000","last_unstale":"2024-09-15T12:26:10.697483+0000","last_undegraded":"2024-09-15T12:26:10.697483+0000","last_fullsized":"2024-09-15T12:26:10.697483+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42336256,"num_objects":646,"num_object_clones":0,"num_object_copies":1938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":41344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"64'635","reported_seq":665,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.736938+0000","last_change":"2024-09-15T12:25:19.466585+0000","last_active":"2024-09-15T12:26:10.736938+0000","last_peered":"2024-09-15T12:26:10.736938+0000","last_clean":"2024-09-15T12:26:10.736938+0000","last_became_active":"2024-09-15T12:25:19.449036+0000","last_became_peered":"2024-09-15T12:25:19.449036+0000","last_unstale":"2024-09-15T12:26:10.736938+0000","last_undegraded":"2024-09-15T12:26:10.736938+0000","last_fullsized":"2024-09-15T12:26:10.736938+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41615360,"num_objects":635,"num_object_clones":0,"num_object_copies":1905,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":635,"num_write_kb":40640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"65'708","reported_seq":741,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T12:26:11.770322+0000","last_change":"2024-09-15T12:25:19.412052+0000","last_active":"2024-09-15T12:26:11.770322+0000","last_peered":"2024-09-15T12:26:11.770322+0000","last_clean":"2024-09-15T12:26:11.770322+0000","last_became_active":"2024-09-15T12:25:19.396072+0000","last_became_peered":"2024-09-15T12:25:19.396072+0000","last_unstale":"2024-09-15T12:26:11.770322+0000","last_undegraded":"2024-09-15T12:26:11.770322+0000","last_fullsized":"2024-09-15T12:26:11.770322+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":708,"log_dups_size":0,"ondisk_log_size":708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46399488,"num_objects":708,"num_object_clones":0,"num_object_copies":2124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":45312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"64'626","reported_seq":656,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.684970+0000","last_change":"2024-09-15T12:25:19.447319+0000","last_active":"2024-09-15T12:26:10.684970+0000","last_peered":"2024-09-15T12:26:10.684970+0000","last_clean":"2024-09-15T12:26:10.684970+0000","last_became_active":"2024-09-15T12:25:19.436362+0000","last_became_peered":"2024-09-15T12:25:19.436362+0000","last_unstale":"2024-09-15T12:26:10.684970+0000","last_undegraded":"2024-09-15T12:26:10.684970+0000","last_fullsized":"2024-09-15T12:26:10.684970+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41025536,"num_objects":626,"num_object_clones":0,"num_object_copies":1878,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":626,"num_write_kb":40064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"64'651","reported_seq":681,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.752744+0000","last_change":"2024-09-15T12:25:19.475504+0000","last_active":"2024-09-15T12:26:10.752744+0000","last_peered":"2024-09-15T12:26:10.752744+0000","last_clean":"2024-09-15T12:26:10.752744+0000","last_became_active":"2024-09-15T12:25:19.467940+0000","last_became_peered":"2024-09-15T12:25:19.467940+0000","last_unstale":"2024-09-15T12:26:10.752744+0000","last_undegraded":"2024-09-15T12:26:10.752744+0000","last_fullsized":"2024-09-15T12:26:10.752744+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42663936,"num_objects":651,"num_object_clones":0,"num_object_copies":1953,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":651,"num_write_kb":41664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"64'628","reported_seq":658,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.655597+0000","last_change":"2024-09-15T12:25:19.403222+0000","last_active":"2024-09-15T12:26:10.655597+0000","last_peered":"2024-09-15T12:26:10.655597+0000","last_clean":"2024-09-15T12:26:10.655597+0000","last_became_active":"2024-09-15T12:25:19.396442+0000","last_became_peered":"2024-09-15T12:25:19.396442+0000","last_unstale":"2024-09-15T12:26:10.655597+0000","last_undegraded":"2024-09-15T12:26:10.655597+0000","last_fullsized":"2024-09-15T12:26:10.655597+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41156608,"num_objects":628,"num_object_clones":0,"num_object_copies":1884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":628,"num_write_kb":40192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"64'669","reported_seq":699,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.481357+0000","last_change":"2024-09-15T12:25:19.418093+0000","last_active":"2024-09-15T12:26:10.481357+0000","last_peered":"2024-09-15T12:26:10.481357+0000","last_clean":"2024-09-15T12:26:10.481357+0000","last_became_active":"2024-09-15T12:25:19.412762+0000","last_became_peered":"2024-09-15T12:25:19.412762+0000","last_unstale":"2024-09-15T12:26:10.481357+0000","last_undegraded":"2024-09-15T12:26:10.481357+0000","last_fullsized":"2024-09-15T12:26:10.481357+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43843584,"num_objects":669,"num_object_clones":0,"num_object_copies":2007,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":669,"num_write_kb":42816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"64'630","reported_seq":660,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.604228+0000","last_change":"2024-09-15T12:25:19.514099+0000","last_active":"2024-09-15T12:26:10.604228+0000","last_peered":"2024-09-15T12:26:10.604228+0000","last_clean":"2024-09-15T12:26:10.604228+0000","last_became_active":"2024-09-15T12:25:19.506892+0000","last_became_peered":"2024-09-15T12:25:19.506892+0000","last_unstale":"2024-09-15T12:26:10.604228+0000","last_undegraded":"2024-09-15T12:26:10.604228+0000","last_fullsized":"2024-09-15T12:26:10.604228+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41287680,"num_objects":630,"num_object_clones":0,"num_object_copies":1890,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":630,"num_write_kb":40320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":238,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.895525+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:26:10.895525+0000","last_peered":"2024-09-15T12:26:10.895525+0000","last_clean":"2024-09-15T12:26:10.895525+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:26:10.895525+0000","last_undegraded":"2024-09-15T12:26:10.895525+0000","last_fullsized":"2024-09-15T12:26:10.895525+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":164,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.894505+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:26:09.894505+0000","last_peered":"2024-09-15T12:26:09.894505+0000","last_clean":"2024-09-15T12:26:09.894505+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:26:09.894505+0000","last_undegraded":"2024-09-15T12:26:09.894505+0000","last_fullsized":"2024-09-15T12:26:09.894505+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"64'661","reported_seq":691,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.654211+0000","last_change":"2024-09-15T12:25:19.470256+0000","last_active":"2024-09-15T12:26:10.654211+0000","last_peered":"2024-09-15T12:26:10.654211+0000","last_clean":"2024-09-15T12:26:10.654211+0000","last_became_active":"2024-09-15T12:25:19.458317+0000","last_became_peered":"2024-09-15T12:25:19.458317+0000","last_unstale":"2024-09-15T12:26:10.654211+0000","last_undegraded":"2024-09-15T12:26:10.654211+0000","last_fullsized":"2024-09-15T12:26:10.654211+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43319296,"num_objects":661,"num_object_clones":0,"num_object_copies":1983,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":661,"num_write_kb":42304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.906459+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:26:09.906459+0000","last_peered":"2024-09-15T12:26:09.906459+0000","last_clean":"2024-09-15T12:26:09.906459+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:26:09.906459+0000","last_undegraded":"2024-09-15T12:26:09.906459+0000","last_fullsized":"2024-09-15T12:26:09.906459+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"64'648","reported_seq":678,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.651943+0000","last_change":"2024-09-15T12:25:19.478666+0000","last_active":"2024-09-15T12:26:10.651943+0000","last_peered":"2024-09-15T12:26:10.651943+0000","last_clean":"2024-09-15T12:26:10.651943+0000","last_became_active":"2024-09-15T12:25:19.468663+0000","last_became_peered":"2024-09-15T12:25:19.468663+0000","last_unstale":"2024-09-15T12:26:10.651943+0000","last_undegraded":"2024-09-15T12:26:10.651943+0000","last_fullsized":"2024-09-15T12:26:10.651943+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42467328,"num_objects":648,"num_object_clones":0,"num_object_copies":1944,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":648,"num_write_kb":41472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.888896+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:26:09.888896+0000","last_peered":"2024-09-15T12:26:09.888896+0000","last_clean":"2024-09-15T12:26:09.888896+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:26:09.888896+0000","last_undegraded":"2024-09-15T12:26:09.888896+0000","last_fullsized":"2024-09-15T12:26:09.888896+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"64'667","reported_seq":697,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.547549+0000","last_change":"2024-09-15T12:25:19.499536+0000","last_active":"2024-09-15T12:26:10.547549+0000","last_peered":"2024-09-15T12:26:10.547549+0000","last_clean":"2024-09-15T12:26:10.547549+0000","last_became_active":"2024-09-15T12:25:19.493017+0000","last_became_peered":"2024-09-15T12:25:19.493017+0000","last_unstale":"2024-09-15T12:26:10.547549+0000","last_undegraded":"2024-09-15T12:26:10.547549+0000","last_fullsized":"2024-09-15T12:26:10.547549+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43712512,"num_objects":667,"num_object_clones":0,"num_object_copies":2001,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":667,"num_write_kb":42688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":165,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.900992+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:26:09.900992+0000","last_peered":"2024-09-15T12:26:09.900992+0000","last_clean":"2024-09-15T12:26:09.900992+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:26:09.900992+0000","last_undegraded":"2024-09-15T12:26:09.900992+0000","last_fullsized":"2024-09-15T12:26:09.900992+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"64'631","reported_seq":661,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.555976+0000","last_change":"2024-09-15T12:25:19.413209+0000","last_active":"2024-09-15T12:26:10.555976+0000","last_peered":"2024-09-15T12:26:10.555976+0000","last_clean":"2024-09-15T12:26:10.555976+0000","last_became_active":"2024-09-15T12:25:19.403123+0000","last_became_peered":"2024-09-15T12:25:19.403123+0000","last_unstale":"2024-09-15T12:26:10.555976+0000","last_undegraded":"2024-09-15T12:26:10.555976+0000","last_fullsized":"2024-09-15T12:26:10.555976+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":631,"log_dups_size":0,"ondisk_log_size":631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41353216,"num_objects":631,"num_object_clones":0,"num_object_copies":1893,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":631,"num_write_kb":40384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.896505+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:26:09.896505+0000","last_peered":"2024-09-15T12:26:09.896505+0000","last_clean":"2024-09-15T12:26:09.896505+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:26:09.896505+0000","last_undegraded":"2024-09-15T12:26:09.896505+0000","last_fullsized":"2024-09-15T12:26:09.896505+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"64'689","reported_seq":719,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.537739+0000","last_change":"2024-09-15T12:25:19.429640+0000","last_active":"2024-09-15T12:26:10.537739+0000","last_peered":"2024-09-15T12:26:10.537739+0000","last_clean":"2024-09-15T12:26:10.537739+0000","last_became_active":"2024-09-15T12:25:19.422585+0000","last_became_peered":"2024-09-15T12:25:19.422585+0000","last_unstale":"2024-09-15T12:26:10.537739+0000","last_undegraded":"2024-09-15T12:26:10.537739+0000","last_fullsized":"2024-09-15T12:26:10.537739+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":689,"log_dups_size":0,"ondisk_log_size":689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45154304,"num_objects":689,"num_object_clones":0,"num_object_copies":2067,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":689,"num_write_kb":44096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":166,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.899315+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:26:10.899315+0000","last_peered":"2024-09-15T12:26:10.899315+0000","last_clean":"2024-09-15T12:26:10.899315+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:26:10.899315+0000","last_undegraded":"2024-09-15T12:26:10.899315+0000","last_fullsized":"2024-09-15T12:26:10.899315+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"65'659","reported_seq":692,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-09-15T12:26:11.767587+0000","last_change":"2024-09-15T12:25:19.429532+0000","last_active":"2024-09-15T12:26:11.767587+0000","last_peered":"2024-09-15T12:26:11.767587+0000","last_clean":"2024-09-15T12:26:11.767587+0000","last_became_active":"2024-09-15T12:25:19.424570+0000","last_became_peered":"2024-09-15T12:25:19.424570+0000","last_unstale":"2024-09-15T12:26:11.767587+0000","last_undegraded":"2024-09-15T12:26:11.767587+0000","last_fullsized":"2024-09-15T12:26:11.767587+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43188224,"num_objects":659,"num_object_clones":0,"num_object_copies":1977,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":659,"num_write_kb":42176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.893033+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:26:09.893033+0000","last_peered":"2024-09-15T12:26:09.893033+0000","last_clean":"2024-09-15T12:26:09.893033+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:26:09.893033+0000","last_undegraded":"2024-09-15T12:26:09.893033+0000","last_fullsized":"2024-09-15T12:26:09.893033+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"64'616","reported_seq":646,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:10.601230+0000","last_change":"2024-09-15T12:25:19.453184+0000","last_active":"2024-09-15T12:26:10.601230+0000","last_peered":"2024-09-15T12:26:10.601230+0000","last_clean":"2024-09-15T12:26:10.601230+0000","last_became_active":"2024-09-15T12:25:19.441520+0000","last_became_peered":"2024-09-15T12:25:19.441520+0000","last_unstale":"2024-09-15T12:26:10.601230+0000","last_undegraded":"2024-09-15T12:26:10.601230+0000","last_fullsized":"2024-09-15T12:26:10.601230+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40370176,"num_objects":616,"num_object_clones":0,"num_object_copies":1848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":616,"num_write_kb":39424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":163,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T12:26:09.894930+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:26:09.894930+0000","last_peered":"2024-09-15T12:26:09.894930+0000","last_clean":"2024-09-15T12:26:09.894930+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:26:09.894930+0000","last_undegraded":"2024-09-15T12:26:09.894930+0000","last_fullsized":"2024-09-15T12:26:09.894930+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":683147264,"num_objects":10424,"num_object_clones":0,"num_object_copies":31272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10424,"num_write_kb":667136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":128323584,"data_stored":2053177344,"data_compressed":97492518,"data_compressed_allocated":128323584,"data_compressed_original":2053177344,"omap_allocated":0,"internal_metadata":0},"log_size":10424,"ondisk_log_size":10424,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673408,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":114556,"kb_used_data":29420,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94257284,"statfs":{"total":96636764160,"available":96519458816,"internally_reserved":0,"allocated":30126080,"data_stored":473109124,"data_compressed":22457490,"data_compressed_allocated":29560832,"data_compressed_original":472891392,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706113,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":112272,"kb_used_data":36864,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94259568,"statfs":{"total":96636764160,"available":96521797632,"internally_reserved":0,"allocated":37748736,"data_stored":595133902,"data_compressed":28251792,"data_compressed_allocated":37187584,"data_compressed_original":594919424,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706112,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":107168,"kb_used_data":26192,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94264672,"statfs":{"total":96636764160,"available":96527024128,"internally_reserved":0,"allocated":26820608,"data_stored":420804325,"data_compressed":19972072,"data_compressed_allocated":26288128,"data_compressed_original":420610048,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706112,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123008,"kb_used_data":33712,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94248832,"statfs":{"total":96636764160,"available":96510803968,"internally_reserved":0,"allocated":34521088,"data_stored":543619333,"data_compressed":25805836,"data_compressed_allocated":33968128,"data_compressed_original":543408128,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":34430976,"data_stored":550895616,"data_compressed":26158580,"data_compressed_allocated":34430976,"data_compressed_original":550895616,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":26664960,"data_stored":426639360,"data_compressed":20258376,"data_compressed_allocated":26664960,"data_compressed_original":426639360,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":37191680,"data_stored":595066880,"data_compressed":28255992,"data_compressed_allocated":37191680,"data_compressed_original":595066880,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":30035968,"data_stored":480575488,"data_compressed":22819570,"data_compressed_allocated":30035968,"data_compressed_original":480575488,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:26:35.344 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-15T12:26:35.344 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:26:35.344 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:26:35.344 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:26:35.387 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 75 16 14854 14838 12.3637 11.125 0.122957 0.0808104 2024-09-15T12:26:35.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:35.508+0000 7f85ca391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:35.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:35.527+0000 7f85ca391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:35.592 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:26:35.593 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:26:35.593 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:26:35.593 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:26:35.593 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:26:35.593 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:26:35.593 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:26:35.593 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:26:35.593 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:26:35.593 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:26:35.593 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:26:35.594 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:26:35.598 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:26:35.598 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:26:35.598 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:26:35.691 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:26:35.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:35.795+0000 7f9bc6991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:35.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:35.822+0000 7f9bc6991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:35.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:35.850+0000 7f416c0bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:35.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:35.859+0000 7f416c0bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:36.012 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:26:36.032 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:26:36.032 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:26:36.032 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:26:36.033 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:26:36.033 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:26:36.033 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:26:36.033 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:26:36.033 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:26:36.033 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:26:36.033 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:26:36.033 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:26:36.034 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:26:36.034 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:26:36.034 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:26:36.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:36.201+0000 7fbe80b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:36.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:36.219+0000 7fbe80b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:36.387 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 76 16 15038 15022 12.3523 11.5 0.128967 0.0808971 2024-09-15T12:26:36.456 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:26:36.456 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:26:36.456 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:26:36.456 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:26:36.457 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:26:36.457 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:26:36.457 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:26:36.457 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:26:36.457 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:26:36.457 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:26:36.457 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:26:36.458 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:26:36.459 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:26:36.460 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:26:36.460 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:26:36.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:36.622+0000 7fab21e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:36.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:36.634+0000 7fab21e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:36.664 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:26:36.665 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:26:36.665 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:26:36.665 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:26:36.665 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:26:36.665 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:26:36.665 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:26:36.665 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:26:36.665 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:26:36.665 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:26:36.665 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:26:36.665 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:26:36.668 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:26:36.669 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:26:37.387 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 77 16 15219 15203 12.3388 11.3125 0.108392 0.0809784 2024-09-15T12:26:38.262 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:26:38.387 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 78 16 15387 15371 12.3152 10.5 0.130062 0.0810871 2024-09-15T12:26:38.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:38.398+0000 7f504f991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:38.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:38.406+0000 7f504f991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:39.387 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 79 16 15574 15558 12.3073 11.6875 0.152968 0.0811856 2024-09-15T12:26:40.387 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:2024-09-15T12:26:40.386893+0000 min lat: 0.0157862 max lat: 0.236634 avg lat: 0.0813143 2024-09-15T12:26:40.387 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-15T12:26:40.387 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 80 16 15746 15730 12.2878 10.75 0.127945 0.0813143 2024-09-15T12:26:40.692 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:26:40.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:40.842+0000 7f8e7a591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:40.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:40.852+0000 7f8e7a591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:41.387 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 81 16 15931 15915 12.2788 11.5625 0.0713495 0.0814011 2024-09-15T12:26:41.670 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:26:41.670 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:26:41.670 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:26:41.671 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:26:41.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:41.818+0000 7f3ed687d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:41.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:41.835+0000 7f3ed687d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:41.867 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:26:41.867 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:26:41.867 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:26:41.867 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:26:41.867 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:26:41.867 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:26:41.867 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:26:41.867 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:26:41.868 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:26:41.868 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:26:41.868 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:26:41.868 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:26:41.872 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:26:41.873 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:26:41.873 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:26:42.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:42.023+0000 7f91b4b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:42.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:42.034+0000 7f91b4b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:42.054 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:26:42.054 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:26:42.054 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:26:42.054 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:26:42.054 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:26:42.055 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:26:42.055 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:26:42.055 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:26:42.055 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:26:42.055 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:26:42.055 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:26:42.055 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:26:42.058 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:26:42.058 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:26:42.059 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:26:42.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:42.202+0000 7f206b191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:42.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:42.219+0000 7f206b191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:42.265 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:26:42.265 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:26:42.265 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:26:42.265 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:26:42.265 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:26:42.265 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:26:42.265 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:26:42.265 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:26:42.265 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:26:42.265 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:26:42.265 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:26:42.266 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:26:42.268 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:26:42.268 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:26:42.269 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:26:42.387 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 82 16 16103 16087 12.2602 10.75 0.0759636 0.0815053 2024-09-15T12:26:42.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:42.413+0000 7f501f791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:42.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:42.427+0000 7f501f791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:42.453 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:26:42.453 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:26:42.453 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:26:42.453 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:26:42.453 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:26:42.453 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:26:42.453 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:26:42.453 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:26:42.453 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:26:42.453 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:26:42.454 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:26:42.454 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:26:42.457 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:26:42.457 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:26:43.186 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:26:43.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:43.358+0000 7fd465991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:43.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:43.365+0000 7fd465991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:43.387 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 83 16 16265 16249 12.2344 10.125 0.087286 0.0816861 2024-09-15T12:26:44.387 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 84 16 16439 16423 12.2182 10.875 0.0544078 0.0817821 2024-09-15T12:26:45.388 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 85 16 16613 16597 12.2024 10.875 0.129578 0.081878 2024-09-15T12:26:45.684 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:26:45.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:45.835+0000 7fa740751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:45.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:45.846+0000 7fa740751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:46.388 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 86 16 16789 16773 12.1884 11 0.0562134 0.082009 2024-09-15T12:26:47.388 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 87 16 16973 16957 12.1805 11.5 0.0647629 0.0820413 2024-09-15T12:26:47.457 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:26:47.458 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:26:47.458 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:26:47.458 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:26:47.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:47.608+0000 7f6b05991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:47.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:47.623+0000 7f6b05991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:47.649 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:26:47.650 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:26:47.650 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:26:47.650 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:26:47.650 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:26:47.650 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:26:47.650 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:26:47.650 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:26:47.650 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:26:47.650 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:26:47.650 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:26:47.650 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:26:47.655 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:26:47.656 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:26:47.656 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:26:47.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:47.799+0000 7fddbe151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:47.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:47.813+0000 7fddbe151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:47.971 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:26:47.971 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:26:47.971 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:26:47.971 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:26:47.971 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:26:47.971 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:26:47.971 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:26:47.972 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:26:47.972 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:26:47.972 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:26:47.972 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:26:47.972 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:26:47.975 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:26:47.975 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:26:47.975 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:26:48.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:48.140+0000 7f7e8cad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:48.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:48.153+0000 7f7e8cad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:48.202 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:26:48.223 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:26:48.224 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:26:48.224 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:26:48.224 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:26:48.224 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:26:48.224 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:26:48.224 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:26:48.224 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:26:48.224 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:26:48.224 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:26:48.224 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:26:48.224 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:26:48.229 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:26:48.229 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:26:48.229 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:26:48.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:48.351+0000 7f1ce0551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:48.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:48.363+0000 7f1cdf2ef640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:48.388 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 88 16 17150 17134 12.1678 11.0625 0.0534767 0.0821101 2024-09-15T12:26:48.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:48.432+0000 7f46ee8ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:48.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:48.449+0000 7f46ee8ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:48.492 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:26:48.492 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:26:48.492 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:26:48.492 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:26:48.492 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:26:48.493 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:26:48.493 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:26:48.493 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:26:48.493 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:26:48.493 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:26:48.493 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:26:48.493 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:26:48.497 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:26:48.497 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:26:49.388 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 89 16 17331 17315 12.1582 11.3125 0.0732576 0.0822076 2024-09-15T12:26:50.388 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 90 14 17516 17502 12.1529 11.6875 0.105549 0.0822438 2024-09-15T12:26:50.787 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:26:50.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:50.890+0000 7f52220ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:50.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:50.896+0000 7f52220ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:51.388 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Total time run: 90.059 2024-09-15T12:26:51.388 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Total writes made: 17516 2024-09-15T12:26:51.388 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Write size: 65536 2024-09-15T12:26:51.389 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Object size: 65536 2024-09-15T12:26:51.389 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Bandwidth (MB/sec): 12.1559 2024-09-15T12:26:51.389 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Stddev Bandwidth: 1.11596 2024-09-15T12:26:51.389 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Max bandwidth (MB/sec): 14.8125 2024-09-15T12:26:51.389 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Min bandwidth (MB/sec): 10.125 2024-09-15T12:26:51.389 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Average IOPS: 194 2024-09-15T12:26:51.389 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Stddev IOPS: 17.8553 2024-09-15T12:26:51.389 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Max IOPS: 237 2024-09-15T12:26:51.389 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Min IOPS: 162 2024-09-15T12:26:51.389 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Average Latency(s): 0.0822383 2024-09-15T12:26:51.389 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Stddev Latency(s): 0.0275113 2024-09-15T12:26:51.389 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Max latency(s): 0.236634 2024-09-15T12:26:51.389 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Min latency(s): 0.0157862 2024-09-15T12:26:51.416 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Cleaning up (deleting benchmark objects) 2024-09-15T12:26:52.998 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:26:53.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:53.153+0000 7f254e311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:53.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:53.160+0000 7f254e311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:53.499 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:26:53.499 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:26:53.499 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:26:53.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:53.657+0000 7f1cb3d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:53.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:53.670+0000 7f1cb3d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:54.033 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:26:54.033 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:26:54.053 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":317,"stamp":"2024-09-15T12:26:53.799946+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1038680627,"num_objects":15844,"num_object_clones":0,"num_object_copies":47532,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":15921,"num_write_kb":1014868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15895,"ondisk_log_size":15895,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":556536,"kb_used_data":191032,"kb_used_omap":0,"kb_used_meta":365440,"kb_avail":376930824,"statfs":{"total":386547056640,"available":385977163776,"internally_reserved":0,"allocated":195616768,"data_stored":3087786109,"data_compressed":146581051,"data_compressed_allocated":192937984,"data_compressed_original":3086761984,"omap_allocated":0,"internal_metadata":374210560},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":44433408,"num_objects":678,"num_object_clones":0,"num_object_copies":2034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":678,"num_write_kb":43392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002733"},"pg_stats":[{"pgid":"5.f","version":"78'1018","reported_seq":1090,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.453663+0000","last_change":"2024-09-15T12:25:19.440663+0000","last_active":"2024-09-15T12:26:40.453663+0000","last_peered":"2024-09-15T12:26:40.453663+0000","last_clean":"2024-09-15T12:26:40.453663+0000","last_became_active":"2024-09-15T12:25:19.421824+0000","last_became_peered":"2024-09-15T12:25:19.421824+0000","last_unstale":"2024-09-15T12:26:40.453663+0000","last_undegraded":"2024-09-15T12:26:40.453663+0000","last_fullsized":"2024-09-15T12:26:40.453663+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1018,"log_dups_size":0,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66715648,"num_objects":1018,"num_object_clones":0,"num_object_copies":3054,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1018,"num_write_kb":65152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"78'959","reported_seq":1031,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.568522+0000","last_change":"2024-09-15T12:25:19.444566+0000","last_active":"2024-09-15T12:26:40.568522+0000","last_peered":"2024-09-15T12:26:40.568522+0000","last_clean":"2024-09-15T12:26:40.568522+0000","last_became_active":"2024-09-15T12:25:19.436490+0000","last_became_peered":"2024-09-15T12:25:19.436490+0000","last_unstale":"2024-09-15T12:26:40.568522+0000","last_undegraded":"2024-09-15T12:26:40.568522+0000","last_fullsized":"2024-09-15T12:26:40.568522+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":959,"log_dups_size":0,"ondisk_log_size":959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62849024,"num_objects":959,"num_object_clones":0,"num_object_copies":2877,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":959,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"78'974","reported_seq":1046,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.624618+0000","last_change":"2024-09-15T12:25:19.466585+0000","last_active":"2024-09-15T12:26:40.624618+0000","last_peered":"2024-09-15T12:26:40.624618+0000","last_clean":"2024-09-15T12:26:40.624618+0000","last_became_active":"2024-09-15T12:25:19.449036+0000","last_became_peered":"2024-09-15T12:25:19.449036+0000","last_unstale":"2024-09-15T12:26:40.624618+0000","last_undegraded":"2024-09-15T12:26:40.624618+0000","last_fullsized":"2024-09-15T12:26:40.624618+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":974,"log_dups_size":0,"ondisk_log_size":974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63832064,"num_objects":974,"num_object_clones":0,"num_object_copies":2922,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":974,"num_write_kb":62336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"78'1021","reported_seq":1093,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:41.584960+0000","last_change":"2024-09-15T12:25:19.412052+0000","last_active":"2024-09-15T12:26:41.584960+0000","last_peered":"2024-09-15T12:26:41.584960+0000","last_clean":"2024-09-15T12:26:41.584960+0000","last_became_active":"2024-09-15T12:25:19.396072+0000","last_became_peered":"2024-09-15T12:25:19.396072+0000","last_unstale":"2024-09-15T12:26:41.584960+0000","last_undegraded":"2024-09-15T12:26:41.584960+0000","last_fullsized":"2024-09-15T12:26:41.584960+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1021,"log_dups_size":0,"ondisk_log_size":1021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66912256,"num_objects":1021,"num_object_clones":0,"num_object_copies":3063,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1021,"num_write_kb":65344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"78'951","reported_seq":1023,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.700661+0000","last_change":"2024-09-15T12:25:19.447319+0000","last_active":"2024-09-15T12:26:40.700661+0000","last_peered":"2024-09-15T12:26:40.700661+0000","last_clean":"2024-09-15T12:26:40.700661+0000","last_became_active":"2024-09-15T12:25:19.436362+0000","last_became_peered":"2024-09-15T12:25:19.436362+0000","last_unstale":"2024-09-15T12:26:40.700661+0000","last_undegraded":"2024-09-15T12:26:40.700661+0000","last_fullsized":"2024-09-15T12:26:40.700661+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":951,"log_dups_size":0,"ondisk_log_size":951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62324736,"num_objects":951,"num_object_clones":0,"num_object_copies":2853,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":951,"num_write_kb":60864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"78'982","reported_seq":1054,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.590368+0000","last_change":"2024-09-15T12:25:19.475504+0000","last_active":"2024-09-15T12:26:40.590368+0000","last_peered":"2024-09-15T12:26:40.590368+0000","last_clean":"2024-09-15T12:26:40.590368+0000","last_became_active":"2024-09-15T12:25:19.467940+0000","last_became_peered":"2024-09-15T12:25:19.467940+0000","last_unstale":"2024-09-15T12:26:40.590368+0000","last_undegraded":"2024-09-15T12:26:40.590368+0000","last_fullsized":"2024-09-15T12:26:40.590368+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":982,"log_dups_size":0,"ondisk_log_size":982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64356352,"num_objects":982,"num_object_clones":0,"num_object_copies":2946,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":982,"num_write_kb":62848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"78'972","reported_seq":1044,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.595751+0000","last_change":"2024-09-15T12:25:19.403222+0000","last_active":"2024-09-15T12:26:40.595751+0000","last_peered":"2024-09-15T12:26:40.595751+0000","last_clean":"2024-09-15T12:26:40.595751+0000","last_became_active":"2024-09-15T12:25:19.396442+0000","last_became_peered":"2024-09-15T12:25:19.396442+0000","last_unstale":"2024-09-15T12:26:40.595751+0000","last_undegraded":"2024-09-15T12:26:40.595751+0000","last_fullsized":"2024-09-15T12:26:40.595751+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":972,"log_dups_size":0,"ondisk_log_size":972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63700992,"num_objects":972,"num_object_clones":0,"num_object_copies":2916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":972,"num_write_kb":62208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"78'1007","reported_seq":1079,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.722153+0000","last_change":"2024-09-15T12:25:19.418093+0000","last_active":"2024-09-15T12:26:40.722153+0000","last_peered":"2024-09-15T12:26:40.722153+0000","last_clean":"2024-09-15T12:26:40.722153+0000","last_became_active":"2024-09-15T12:25:19.412762+0000","last_became_peered":"2024-09-15T12:25:19.412762+0000","last_unstale":"2024-09-15T12:26:40.722153+0000","last_undegraded":"2024-09-15T12:26:40.722153+0000","last_fullsized":"2024-09-15T12:26:40.722153+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1007,"log_dups_size":0,"ondisk_log_size":1007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65994752,"num_objects":1007,"num_object_clones":0,"num_object_copies":3021,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1007,"num_write_kb":64448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"78'964","reported_seq":1036,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.660244+0000","last_change":"2024-09-15T12:25:19.514099+0000","last_active":"2024-09-15T12:26:40.660244+0000","last_peered":"2024-09-15T12:26:40.660244+0000","last_clean":"2024-09-15T12:26:40.660244+0000","last_became_active":"2024-09-15T12:25:19.506892+0000","last_became_peered":"2024-09-15T12:25:19.506892+0000","last_unstale":"2024-09-15T12:26:40.660244+0000","last_undegraded":"2024-09-15T12:26:40.660244+0000","last_fullsized":"2024-09-15T12:26:40.660244+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":964,"log_dups_size":0,"ondisk_log_size":964,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63176704,"num_objects":964,"num_object_clones":0,"num_object_copies":2892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":964,"num_write_kb":61696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":277,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.283839+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:26:38.283839+0000","last_peered":"2024-09-15T12:26:38.283839+0000","last_clean":"2024-09-15T12:26:38.283839+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:26:38.283839+0000","last_undegraded":"2024-09-15T12:26:38.283839+0000","last_fullsized":"2024-09-15T12:26:38.283839+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":206,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.307035+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:26:38.307035+0000","last_peered":"2024-09-15T12:26:38.307035+0000","last_clean":"2024-09-15T12:26:38.307035+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:26:38.307035+0000","last_undegraded":"2024-09-15T12:26:38.307035+0000","last_fullsized":"2024-09-15T12:26:38.307035+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"78'1028","reported_seq":1100,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.755192+0000","last_change":"2024-09-15T12:25:19.470256+0000","last_active":"2024-09-15T12:26:40.755192+0000","last_peered":"2024-09-15T12:26:40.755192+0000","last_clean":"2024-09-15T12:26:40.755192+0000","last_became_active":"2024-09-15T12:25:19.458317+0000","last_became_peered":"2024-09-15T12:25:19.458317+0000","last_unstale":"2024-09-15T12:26:40.755192+0000","last_undegraded":"2024-09-15T12:26:40.755192+0000","last_fullsized":"2024-09-15T12:26:40.755192+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1028,"log_dups_size":0,"ondisk_log_size":1028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67371008,"num_objects":1028,"num_object_clones":0,"num_object_copies":3084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1028,"num_write_kb":65792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.297600+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:26:38.297600+0000","last_peered":"2024-09-15T12:26:38.297600+0000","last_clean":"2024-09-15T12:26:38.297600+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:26:38.297600+0000","last_undegraded":"2024-09-15T12:26:38.297600+0000","last_fullsized":"2024-09-15T12:26:38.297600+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"78'1008","reported_seq":1080,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.381678+0000","last_change":"2024-09-15T12:25:19.478666+0000","last_active":"2024-09-15T12:26:40.381678+0000","last_peered":"2024-09-15T12:26:40.381678+0000","last_clean":"2024-09-15T12:26:40.381678+0000","last_became_active":"2024-09-15T12:25:19.468663+0000","last_became_peered":"2024-09-15T12:25:19.468663+0000","last_unstale":"2024-09-15T12:26:40.381678+0000","last_undegraded":"2024-09-15T12:26:40.381678+0000","last_fullsized":"2024-09-15T12:26:40.381678+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1008,"log_dups_size":0,"ondisk_log_size":1008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66060288,"num_objects":1008,"num_object_clones":0,"num_object_copies":3024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1008,"num_write_kb":64512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.300626+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:26:38.300626+0000","last_peered":"2024-09-15T12:26:38.300626+0000","last_clean":"2024-09-15T12:26:38.300626+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:26:38.300626+0000","last_undegraded":"2024-09-15T12:26:38.300626+0000","last_fullsized":"2024-09-15T12:26:38.300626+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"78'1013","reported_seq":1085,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.543210+0000","last_change":"2024-09-15T12:25:19.499536+0000","last_active":"2024-09-15T12:26:40.543210+0000","last_peered":"2024-09-15T12:26:40.543210+0000","last_clean":"2024-09-15T12:26:40.543210+0000","last_became_active":"2024-09-15T12:25:19.493017+0000","last_became_peered":"2024-09-15T12:25:19.493017+0000","last_unstale":"2024-09-15T12:26:40.543210+0000","last_undegraded":"2024-09-15T12:26:40.543210+0000","last_fullsized":"2024-09-15T12:26:40.543210+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66387968,"num_objects":1013,"num_object_clones":0,"num_object_copies":3039,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1013,"num_write_kb":64832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":207,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.292803+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:26:38.292803+0000","last_peered":"2024-09-15T12:26:38.292803+0000","last_clean":"2024-09-15T12:26:38.292803+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:26:38.292803+0000","last_undegraded":"2024-09-15T12:26:38.292803+0000","last_fullsized":"2024-09-15T12:26:38.292803+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"78'953","reported_seq":1025,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.726306+0000","last_change":"2024-09-15T12:25:19.413209+0000","last_active":"2024-09-15T12:26:40.726306+0000","last_peered":"2024-09-15T12:26:40.726306+0000","last_clean":"2024-09-15T12:26:40.726306+0000","last_became_active":"2024-09-15T12:25:19.403123+0000","last_became_peered":"2024-09-15T12:25:19.403123+0000","last_unstale":"2024-09-15T12:26:40.726306+0000","last_undegraded":"2024-09-15T12:26:40.726306+0000","last_fullsized":"2024-09-15T12:26:40.726306+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":953,"log_dups_size":0,"ondisk_log_size":953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62455808,"num_objects":953,"num_object_clones":0,"num_object_copies":2859,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":953,"num_write_kb":60992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.343877+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:26:38.343877+0000","last_peered":"2024-09-15T12:26:38.343877+0000","last_clean":"2024-09-15T12:26:38.343877+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:26:38.343877+0000","last_undegraded":"2024-09-15T12:26:38.343877+0000","last_fullsized":"2024-09-15T12:26:38.343877+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"78'1007","reported_seq":1079,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.748934+0000","last_change":"2024-09-15T12:25:19.429640+0000","last_active":"2024-09-15T12:26:40.748934+0000","last_peered":"2024-09-15T12:26:40.748934+0000","last_clean":"2024-09-15T12:26:40.748934+0000","last_became_active":"2024-09-15T12:25:19.422585+0000","last_became_peered":"2024-09-15T12:25:19.422585+0000","last_unstale":"2024-09-15T12:26:40.748934+0000","last_undegraded":"2024-09-15T12:26:40.748934+0000","last_fullsized":"2024-09-15T12:26:40.748934+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1007,"log_dups_size":0,"ondisk_log_size":1007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65994752,"num_objects":1007,"num_object_clones":0,"num_object_copies":3021,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1007,"num_write_kb":64448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.285548+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:26:38.285548+0000","last_peered":"2024-09-15T12:26:38.285548+0000","last_clean":"2024-09-15T12:26:38.285548+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:26:38.285548+0000","last_undegraded":"2024-09-15T12:26:38.285548+0000","last_fullsized":"2024-09-15T12:26:38.285548+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"78'1024","reported_seq":1096,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:41.749788+0000","last_change":"2024-09-15T12:25:19.429532+0000","last_active":"2024-09-15T12:26:41.749788+0000","last_peered":"2024-09-15T12:26:41.749788+0000","last_clean":"2024-09-15T12:26:41.749788+0000","last_became_active":"2024-09-15T12:25:19.424570+0000","last_became_peered":"2024-09-15T12:25:19.424570+0000","last_unstale":"2024-09-15T12:26:41.749788+0000","last_undegraded":"2024-09-15T12:26:41.749788+0000","last_fullsized":"2024-09-15T12:26:41.749788+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1024,"log_dups_size":0,"ondisk_log_size":1024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":1024,"num_object_clones":0,"num_object_copies":3072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1024,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.331592+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:26:38.331592+0000","last_peered":"2024-09-15T12:26:38.331592+0000","last_clean":"2024-09-15T12:26:38.331592+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:26:38.331592+0000","last_undegraded":"2024-09-15T12:26:38.331592+0000","last_fullsized":"2024-09-15T12:26:38.331592+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"78'959","reported_seq":1031,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.643126+0000","last_change":"2024-09-15T12:25:19.453184+0000","last_active":"2024-09-15T12:26:40.643126+0000","last_peered":"2024-09-15T12:26:40.643126+0000","last_clean":"2024-09-15T12:26:40.643126+0000","last_became_active":"2024-09-15T12:25:19.441520+0000","last_became_peered":"2024-09-15T12:25:19.441520+0000","last_unstale":"2024-09-15T12:26:40.643126+0000","last_undegraded":"2024-09-15T12:26:40.643126+0000","last_fullsized":"2024-09-15T12:26:40.643126+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":959,"log_dups_size":0,"ondisk_log_size":959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62849024,"num_objects":959,"num_object_clones":0,"num_object_copies":2877,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":959,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.305972+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:26:38.305972+0000","last_peered":"2024-09-15T12:26:38.305972+0000","last_clean":"2024-09-15T12:26:38.305972+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:26:38.305972+0000","last_undegraded":"2024-09-15T12:26:38.305972+0000","last_fullsized":"2024-09-15T12:26:38.305972+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1038090240,"num_objects":15840,"num_object_clones":0,"num_object_copies":47520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15840,"num_write_kb":1013760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":194895872,"data_stored":3118333952,"data_compressed":148071851,"data_compressed_allocated":194895872,"data_compressed_original":3118333952,"omap_allocated":0,"internal_metadata":0},"log_size":15840,"ondisk_log_size":15840,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673438,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":129468,"kb_used_data":44332,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94242372,"statfs":{"total":96636764160,"available":96504188928,"internally_reserved":0,"allocated":45395968,"data_stored":715765913,"data_compressed":33978113,"data_compressed_allocated":44724224,"data_compressed_original":715505664,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706142,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":153136,"kb_used_data":55520,"kb_used_omap":0,"kb_used_meta":97600,"kb_avail":94218704,"statfs":{"total":96636764160,"available":96479952896,"internally_reserved":0,"allocated":56852480,"data_stored":899004588,"data_compressed":42679023,"data_compressed_allocated":56176640,"data_compressed_original":898744320,"omap_allocated":0,"internal_metadata":99942400},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706142,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":133076,"kb_used_data":39620,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94238764,"statfs":{"total":96636764160,"available":96500494336,"internally_reserved":0,"allocated":40570880,"data_stored":638891660,"data_compressed":30325696,"data_compressed_allocated":39915520,"data_compressed_original":638648320,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706142,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":140856,"kb_used_data":51560,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94230984,"statfs":{"total":96636764160,"available":96492527616,"internally_reserved":0,"allocated":52797440,"data_stored":834123948,"data_compressed":39598219,"data_compressed_allocated":52121600,"data_compressed_original":833863680,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":52596736,"data_stored":841547776,"data_compressed":39960299,"data_compressed_allocated":52596736,"data_compressed_original":841547776,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40402944,"data_stored":646447104,"data_compressed":30696024,"data_compressed_allocated":40402944,"data_compressed_original":646447104,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":56754176,"data_stored":908066816,"data_compressed":43118903,"data_compressed_allocated":56754176,"data_compressed_original":908066816,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45142016,"data_stored":722272256,"data_compressed":34296625,"data_compressed_allocated":45142016,"data_compressed_original":722272256,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:26:55.491 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:26:55.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:55.665+0000 7f42c3cec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:55.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:55.673+0000 7f42c3cec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:57.975 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:26:58.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:58.104+0000 7efe83191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:58.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:58.115+0000 7efe83191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:59.055 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:26:59.055 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:26:59.055 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:26:59.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:59.191+0000 7f1e68b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:59.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:26:59.203+0000 7f1e68b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:26:59.555 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:26:59.555 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:26:59.575 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":319,"stamp":"2024-09-15T12:26:57.800790+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1038680627,"num_objects":15844,"num_object_clones":0,"num_object_copies":47532,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":15921,"num_write_kb":1014868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15895,"ondisk_log_size":15895,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":556536,"kb_used_data":191032,"kb_used_omap":0,"kb_used_meta":365440,"kb_avail":376930824,"statfs":{"total":386547056640,"available":385977163776,"internally_reserved":0,"allocated":195616768,"data_stored":3087786109,"data_compressed":146581051,"data_compressed_allocated":192937984,"data_compressed_original":3086761984,"omap_allocated":0,"internal_metadata":374210560},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002621"},"pg_stats":[{"pgid":"5.f","version":"78'1018","reported_seq":1090,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.453663+0000","last_change":"2024-09-15T12:25:19.440663+0000","last_active":"2024-09-15T12:26:40.453663+0000","last_peered":"2024-09-15T12:26:40.453663+0000","last_clean":"2024-09-15T12:26:40.453663+0000","last_became_active":"2024-09-15T12:25:19.421824+0000","last_became_peered":"2024-09-15T12:25:19.421824+0000","last_unstale":"2024-09-15T12:26:40.453663+0000","last_undegraded":"2024-09-15T12:26:40.453663+0000","last_fullsized":"2024-09-15T12:26:40.453663+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1018,"log_dups_size":0,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66715648,"num_objects":1018,"num_object_clones":0,"num_object_copies":3054,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1018,"num_write_kb":65152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"78'959","reported_seq":1031,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.568522+0000","last_change":"2024-09-15T12:25:19.444566+0000","last_active":"2024-09-15T12:26:40.568522+0000","last_peered":"2024-09-15T12:26:40.568522+0000","last_clean":"2024-09-15T12:26:40.568522+0000","last_became_active":"2024-09-15T12:25:19.436490+0000","last_became_peered":"2024-09-15T12:25:19.436490+0000","last_unstale":"2024-09-15T12:26:40.568522+0000","last_undegraded":"2024-09-15T12:26:40.568522+0000","last_fullsized":"2024-09-15T12:26:40.568522+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":959,"log_dups_size":0,"ondisk_log_size":959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62849024,"num_objects":959,"num_object_clones":0,"num_object_copies":2877,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":959,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"78'974","reported_seq":1046,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.624618+0000","last_change":"2024-09-15T12:25:19.466585+0000","last_active":"2024-09-15T12:26:40.624618+0000","last_peered":"2024-09-15T12:26:40.624618+0000","last_clean":"2024-09-15T12:26:40.624618+0000","last_became_active":"2024-09-15T12:25:19.449036+0000","last_became_peered":"2024-09-15T12:25:19.449036+0000","last_unstale":"2024-09-15T12:26:40.624618+0000","last_undegraded":"2024-09-15T12:26:40.624618+0000","last_fullsized":"2024-09-15T12:26:40.624618+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":974,"log_dups_size":0,"ondisk_log_size":974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63832064,"num_objects":974,"num_object_clones":0,"num_object_copies":2922,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":974,"num_write_kb":62336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"78'1021","reported_seq":1093,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:41.584960+0000","last_change":"2024-09-15T12:25:19.412052+0000","last_active":"2024-09-15T12:26:41.584960+0000","last_peered":"2024-09-15T12:26:41.584960+0000","last_clean":"2024-09-15T12:26:41.584960+0000","last_became_active":"2024-09-15T12:25:19.396072+0000","last_became_peered":"2024-09-15T12:25:19.396072+0000","last_unstale":"2024-09-15T12:26:41.584960+0000","last_undegraded":"2024-09-15T12:26:41.584960+0000","last_fullsized":"2024-09-15T12:26:41.584960+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1021,"log_dups_size":0,"ondisk_log_size":1021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66912256,"num_objects":1021,"num_object_clones":0,"num_object_copies":3063,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1021,"num_write_kb":65344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"78'951","reported_seq":1023,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.700661+0000","last_change":"2024-09-15T12:25:19.447319+0000","last_active":"2024-09-15T12:26:40.700661+0000","last_peered":"2024-09-15T12:26:40.700661+0000","last_clean":"2024-09-15T12:26:40.700661+0000","last_became_active":"2024-09-15T12:25:19.436362+0000","last_became_peered":"2024-09-15T12:25:19.436362+0000","last_unstale":"2024-09-15T12:26:40.700661+0000","last_undegraded":"2024-09-15T12:26:40.700661+0000","last_fullsized":"2024-09-15T12:26:40.700661+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":951,"log_dups_size":0,"ondisk_log_size":951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62324736,"num_objects":951,"num_object_clones":0,"num_object_copies":2853,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":951,"num_write_kb":60864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"78'982","reported_seq":1054,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.590368+0000","last_change":"2024-09-15T12:25:19.475504+0000","last_active":"2024-09-15T12:26:40.590368+0000","last_peered":"2024-09-15T12:26:40.590368+0000","last_clean":"2024-09-15T12:26:40.590368+0000","last_became_active":"2024-09-15T12:25:19.467940+0000","last_became_peered":"2024-09-15T12:25:19.467940+0000","last_unstale":"2024-09-15T12:26:40.590368+0000","last_undegraded":"2024-09-15T12:26:40.590368+0000","last_fullsized":"2024-09-15T12:26:40.590368+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":982,"log_dups_size":0,"ondisk_log_size":982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64356352,"num_objects":982,"num_object_clones":0,"num_object_copies":2946,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":982,"num_write_kb":62848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"78'972","reported_seq":1044,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.595751+0000","last_change":"2024-09-15T12:25:19.403222+0000","last_active":"2024-09-15T12:26:40.595751+0000","last_peered":"2024-09-15T12:26:40.595751+0000","last_clean":"2024-09-15T12:26:40.595751+0000","last_became_active":"2024-09-15T12:25:19.396442+0000","last_became_peered":"2024-09-15T12:25:19.396442+0000","last_unstale":"2024-09-15T12:26:40.595751+0000","last_undegraded":"2024-09-15T12:26:40.595751+0000","last_fullsized":"2024-09-15T12:26:40.595751+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":972,"log_dups_size":0,"ondisk_log_size":972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63700992,"num_objects":972,"num_object_clones":0,"num_object_copies":2916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":972,"num_write_kb":62208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"78'1007","reported_seq":1079,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.722153+0000","last_change":"2024-09-15T12:25:19.418093+0000","last_active":"2024-09-15T12:26:40.722153+0000","last_peered":"2024-09-15T12:26:40.722153+0000","last_clean":"2024-09-15T12:26:40.722153+0000","last_became_active":"2024-09-15T12:25:19.412762+0000","last_became_peered":"2024-09-15T12:25:19.412762+0000","last_unstale":"2024-09-15T12:26:40.722153+0000","last_undegraded":"2024-09-15T12:26:40.722153+0000","last_fullsized":"2024-09-15T12:26:40.722153+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1007,"log_dups_size":0,"ondisk_log_size":1007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65994752,"num_objects":1007,"num_object_clones":0,"num_object_copies":3021,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1007,"num_write_kb":64448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"78'964","reported_seq":1036,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.660244+0000","last_change":"2024-09-15T12:25:19.514099+0000","last_active":"2024-09-15T12:26:40.660244+0000","last_peered":"2024-09-15T12:26:40.660244+0000","last_clean":"2024-09-15T12:26:40.660244+0000","last_became_active":"2024-09-15T12:25:19.506892+0000","last_became_peered":"2024-09-15T12:25:19.506892+0000","last_unstale":"2024-09-15T12:26:40.660244+0000","last_undegraded":"2024-09-15T12:26:40.660244+0000","last_fullsized":"2024-09-15T12:26:40.660244+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":964,"log_dups_size":0,"ondisk_log_size":964,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63176704,"num_objects":964,"num_object_clones":0,"num_object_copies":2892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":964,"num_write_kb":61696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":277,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.283839+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:26:38.283839+0000","last_peered":"2024-09-15T12:26:38.283839+0000","last_clean":"2024-09-15T12:26:38.283839+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:26:38.283839+0000","last_undegraded":"2024-09-15T12:26:38.283839+0000","last_fullsized":"2024-09-15T12:26:38.283839+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":206,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.307035+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:26:38.307035+0000","last_peered":"2024-09-15T12:26:38.307035+0000","last_clean":"2024-09-15T12:26:38.307035+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:26:38.307035+0000","last_undegraded":"2024-09-15T12:26:38.307035+0000","last_fullsized":"2024-09-15T12:26:38.307035+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"78'1028","reported_seq":1100,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.755192+0000","last_change":"2024-09-15T12:25:19.470256+0000","last_active":"2024-09-15T12:26:40.755192+0000","last_peered":"2024-09-15T12:26:40.755192+0000","last_clean":"2024-09-15T12:26:40.755192+0000","last_became_active":"2024-09-15T12:25:19.458317+0000","last_became_peered":"2024-09-15T12:25:19.458317+0000","last_unstale":"2024-09-15T12:26:40.755192+0000","last_undegraded":"2024-09-15T12:26:40.755192+0000","last_fullsized":"2024-09-15T12:26:40.755192+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1028,"log_dups_size":0,"ondisk_log_size":1028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67371008,"num_objects":1028,"num_object_clones":0,"num_object_copies":3084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1028,"num_write_kb":65792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.297600+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:26:38.297600+0000","last_peered":"2024-09-15T12:26:38.297600+0000","last_clean":"2024-09-15T12:26:38.297600+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:26:38.297600+0000","last_undegraded":"2024-09-15T12:26:38.297600+0000","last_fullsized":"2024-09-15T12:26:38.297600+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"78'1008","reported_seq":1080,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.381678+0000","last_change":"2024-09-15T12:25:19.478666+0000","last_active":"2024-09-15T12:26:40.381678+0000","last_peered":"2024-09-15T12:26:40.381678+0000","last_clean":"2024-09-15T12:26:40.381678+0000","last_became_active":"2024-09-15T12:25:19.468663+0000","last_became_peered":"2024-09-15T12:25:19.468663+0000","last_unstale":"2024-09-15T12:26:40.381678+0000","last_undegraded":"2024-09-15T12:26:40.381678+0000","last_fullsized":"2024-09-15T12:26:40.381678+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1008,"log_dups_size":0,"ondisk_log_size":1008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66060288,"num_objects":1008,"num_object_clones":0,"num_object_copies":3024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1008,"num_write_kb":64512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.300626+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:26:38.300626+0000","last_peered":"2024-09-15T12:26:38.300626+0000","last_clean":"2024-09-15T12:26:38.300626+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:26:38.300626+0000","last_undegraded":"2024-09-15T12:26:38.300626+0000","last_fullsized":"2024-09-15T12:26:38.300626+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"78'1013","reported_seq":1085,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.543210+0000","last_change":"2024-09-15T12:25:19.499536+0000","last_active":"2024-09-15T12:26:40.543210+0000","last_peered":"2024-09-15T12:26:40.543210+0000","last_clean":"2024-09-15T12:26:40.543210+0000","last_became_active":"2024-09-15T12:25:19.493017+0000","last_became_peered":"2024-09-15T12:25:19.493017+0000","last_unstale":"2024-09-15T12:26:40.543210+0000","last_undegraded":"2024-09-15T12:26:40.543210+0000","last_fullsized":"2024-09-15T12:26:40.543210+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66387968,"num_objects":1013,"num_object_clones":0,"num_object_copies":3039,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1013,"num_write_kb":64832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":207,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.292803+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:26:38.292803+0000","last_peered":"2024-09-15T12:26:38.292803+0000","last_clean":"2024-09-15T12:26:38.292803+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:26:38.292803+0000","last_undegraded":"2024-09-15T12:26:38.292803+0000","last_fullsized":"2024-09-15T12:26:38.292803+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"78'953","reported_seq":1025,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.726306+0000","last_change":"2024-09-15T12:25:19.413209+0000","last_active":"2024-09-15T12:26:40.726306+0000","last_peered":"2024-09-15T12:26:40.726306+0000","last_clean":"2024-09-15T12:26:40.726306+0000","last_became_active":"2024-09-15T12:25:19.403123+0000","last_became_peered":"2024-09-15T12:25:19.403123+0000","last_unstale":"2024-09-15T12:26:40.726306+0000","last_undegraded":"2024-09-15T12:26:40.726306+0000","last_fullsized":"2024-09-15T12:26:40.726306+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":953,"log_dups_size":0,"ondisk_log_size":953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62455808,"num_objects":953,"num_object_clones":0,"num_object_copies":2859,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":953,"num_write_kb":60992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.343877+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:26:38.343877+0000","last_peered":"2024-09-15T12:26:38.343877+0000","last_clean":"2024-09-15T12:26:38.343877+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:26:38.343877+0000","last_undegraded":"2024-09-15T12:26:38.343877+0000","last_fullsized":"2024-09-15T12:26:38.343877+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"78'1007","reported_seq":1079,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.748934+0000","last_change":"2024-09-15T12:25:19.429640+0000","last_active":"2024-09-15T12:26:40.748934+0000","last_peered":"2024-09-15T12:26:40.748934+0000","last_clean":"2024-09-15T12:26:40.748934+0000","last_became_active":"2024-09-15T12:25:19.422585+0000","last_became_peered":"2024-09-15T12:25:19.422585+0000","last_unstale":"2024-09-15T12:26:40.748934+0000","last_undegraded":"2024-09-15T12:26:40.748934+0000","last_fullsized":"2024-09-15T12:26:40.748934+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1007,"log_dups_size":0,"ondisk_log_size":1007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65994752,"num_objects":1007,"num_object_clones":0,"num_object_copies":3021,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1007,"num_write_kb":64448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.285548+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:26:38.285548+0000","last_peered":"2024-09-15T12:26:38.285548+0000","last_clean":"2024-09-15T12:26:38.285548+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:26:38.285548+0000","last_undegraded":"2024-09-15T12:26:38.285548+0000","last_fullsized":"2024-09-15T12:26:38.285548+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"78'1024","reported_seq":1096,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:41.749788+0000","last_change":"2024-09-15T12:25:19.429532+0000","last_active":"2024-09-15T12:26:41.749788+0000","last_peered":"2024-09-15T12:26:41.749788+0000","last_clean":"2024-09-15T12:26:41.749788+0000","last_became_active":"2024-09-15T12:25:19.424570+0000","last_became_peered":"2024-09-15T12:25:19.424570+0000","last_unstale":"2024-09-15T12:26:41.749788+0000","last_undegraded":"2024-09-15T12:26:41.749788+0000","last_fullsized":"2024-09-15T12:26:41.749788+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1024,"log_dups_size":0,"ondisk_log_size":1024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":1024,"num_object_clones":0,"num_object_copies":3072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1024,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.331592+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:26:38.331592+0000","last_peered":"2024-09-15T12:26:38.331592+0000","last_clean":"2024-09-15T12:26:38.331592+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:26:38.331592+0000","last_undegraded":"2024-09-15T12:26:38.331592+0000","last_fullsized":"2024-09-15T12:26:38.331592+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"78'959","reported_seq":1031,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.643126+0000","last_change":"2024-09-15T12:25:19.453184+0000","last_active":"2024-09-15T12:26:40.643126+0000","last_peered":"2024-09-15T12:26:40.643126+0000","last_clean":"2024-09-15T12:26:40.643126+0000","last_became_active":"2024-09-15T12:25:19.441520+0000","last_became_peered":"2024-09-15T12:25:19.441520+0000","last_unstale":"2024-09-15T12:26:40.643126+0000","last_undegraded":"2024-09-15T12:26:40.643126+0000","last_fullsized":"2024-09-15T12:26:40.643126+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":959,"log_dups_size":0,"ondisk_log_size":959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62849024,"num_objects":959,"num_object_clones":0,"num_object_copies":2877,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":959,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.305972+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:26:38.305972+0000","last_peered":"2024-09-15T12:26:38.305972+0000","last_clean":"2024-09-15T12:26:38.305972+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:26:38.305972+0000","last_undegraded":"2024-09-15T12:26:38.305972+0000","last_fullsized":"2024-09-15T12:26:38.305972+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1038090240,"num_objects":15840,"num_object_clones":0,"num_object_copies":47520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15840,"num_write_kb":1013760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":194895872,"data_stored":3118333952,"data_compressed":148071851,"data_compressed_allocated":194895872,"data_compressed_original":3118333952,"omap_allocated":0,"internal_metadata":0},"log_size":15840,"ondisk_log_size":15840,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673438,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":129468,"kb_used_data":44332,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94242372,"statfs":{"total":96636764160,"available":96504188928,"internally_reserved":0,"allocated":45395968,"data_stored":715765913,"data_compressed":33978113,"data_compressed_allocated":44724224,"data_compressed_original":715505664,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706142,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":153136,"kb_used_data":55520,"kb_used_omap":0,"kb_used_meta":97600,"kb_avail":94218704,"statfs":{"total":96636764160,"available":96479952896,"internally_reserved":0,"allocated":56852480,"data_stored":899004588,"data_compressed":42679023,"data_compressed_allocated":56176640,"data_compressed_original":898744320,"omap_allocated":0,"internal_metadata":99942400},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706142,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":133076,"kb_used_data":39620,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94238764,"statfs":{"total":96636764160,"available":96500494336,"internally_reserved":0,"allocated":40570880,"data_stored":638891660,"data_compressed":30325696,"data_compressed_allocated":39915520,"data_compressed_original":638648320,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706142,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":140856,"kb_used_data":51560,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94230984,"statfs":{"total":96636764160,"available":96492527616,"internally_reserved":0,"allocated":52797440,"data_stored":834123948,"data_compressed":39598219,"data_compressed_allocated":52121600,"data_compressed_original":833863680,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":52596736,"data_stored":841547776,"data_compressed":39960299,"data_compressed_allocated":52596736,"data_compressed_original":841547776,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40402944,"data_stored":646447104,"data_compressed":30696024,"data_compressed_allocated":40402944,"data_compressed_original":646447104,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":56754176,"data_stored":908066816,"data_compressed":43118903,"data_compressed_allocated":56754176,"data_compressed_original":908066816,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45142016,"data_stored":722272256,"data_compressed":34296625,"data_compressed_allocated":45142016,"data_compressed_original":722272256,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:27:00.362 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:27:00.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:00.521+0000 7fef65e9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:00.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:00.529+0000 7fef65e9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:02.921 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:27:03.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:03.065+0000 7f5a29d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:03.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:03.072+0000 7f5a29d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:04.577 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:27:04.577 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:27:04.577 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:27:04.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:04.735+0000 7fbaa7023640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:04.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:04.747+0000 7fbaa7023640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:05.082 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:27:05.083 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:27:05.104 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":322,"stamp":"2024-09-15T12:27:03.801808+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1038680627,"num_objects":15844,"num_object_clones":0,"num_object_copies":47532,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":15921,"num_write_kb":1014868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15895,"ondisk_log_size":15895,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":556536,"kb_used_data":191032,"kb_used_omap":0,"kb_used_meta":365440,"kb_avail":376930824,"statfs":{"total":386547056640,"available":385977163776,"internally_reserved":0,"allocated":195616768,"data_stored":3087786109,"data_compressed":146581051,"data_compressed_allocated":192937984,"data_compressed_original":3086761984,"omap_allocated":0,"internal_metadata":374210560},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002306"},"pg_stats":[{"pgid":"5.f","version":"78'1018","reported_seq":1090,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.453663+0000","last_change":"2024-09-15T12:25:19.440663+0000","last_active":"2024-09-15T12:26:40.453663+0000","last_peered":"2024-09-15T12:26:40.453663+0000","last_clean":"2024-09-15T12:26:40.453663+0000","last_became_active":"2024-09-15T12:25:19.421824+0000","last_became_peered":"2024-09-15T12:25:19.421824+0000","last_unstale":"2024-09-15T12:26:40.453663+0000","last_undegraded":"2024-09-15T12:26:40.453663+0000","last_fullsized":"2024-09-15T12:26:40.453663+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1018,"log_dups_size":0,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66715648,"num_objects":1018,"num_object_clones":0,"num_object_copies":3054,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1018,"num_write_kb":65152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"78'959","reported_seq":1031,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.568522+0000","last_change":"2024-09-15T12:25:19.444566+0000","last_active":"2024-09-15T12:26:40.568522+0000","last_peered":"2024-09-15T12:26:40.568522+0000","last_clean":"2024-09-15T12:26:40.568522+0000","last_became_active":"2024-09-15T12:25:19.436490+0000","last_became_peered":"2024-09-15T12:25:19.436490+0000","last_unstale":"2024-09-15T12:26:40.568522+0000","last_undegraded":"2024-09-15T12:26:40.568522+0000","last_fullsized":"2024-09-15T12:26:40.568522+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":959,"log_dups_size":0,"ondisk_log_size":959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62849024,"num_objects":959,"num_object_clones":0,"num_object_copies":2877,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":959,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"78'974","reported_seq":1046,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.624618+0000","last_change":"2024-09-15T12:25:19.466585+0000","last_active":"2024-09-15T12:26:40.624618+0000","last_peered":"2024-09-15T12:26:40.624618+0000","last_clean":"2024-09-15T12:26:40.624618+0000","last_became_active":"2024-09-15T12:25:19.449036+0000","last_became_peered":"2024-09-15T12:25:19.449036+0000","last_unstale":"2024-09-15T12:26:40.624618+0000","last_undegraded":"2024-09-15T12:26:40.624618+0000","last_fullsized":"2024-09-15T12:26:40.624618+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":974,"log_dups_size":0,"ondisk_log_size":974,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63832064,"num_objects":974,"num_object_clones":0,"num_object_copies":2922,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":974,"num_write_kb":62336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"78'1021","reported_seq":1093,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:41.584960+0000","last_change":"2024-09-15T12:25:19.412052+0000","last_active":"2024-09-15T12:26:41.584960+0000","last_peered":"2024-09-15T12:26:41.584960+0000","last_clean":"2024-09-15T12:26:41.584960+0000","last_became_active":"2024-09-15T12:25:19.396072+0000","last_became_peered":"2024-09-15T12:25:19.396072+0000","last_unstale":"2024-09-15T12:26:41.584960+0000","last_undegraded":"2024-09-15T12:26:41.584960+0000","last_fullsized":"2024-09-15T12:26:41.584960+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1021,"log_dups_size":0,"ondisk_log_size":1021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66912256,"num_objects":1021,"num_object_clones":0,"num_object_copies":3063,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1021,"num_write_kb":65344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"78'951","reported_seq":1023,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.700661+0000","last_change":"2024-09-15T12:25:19.447319+0000","last_active":"2024-09-15T12:26:40.700661+0000","last_peered":"2024-09-15T12:26:40.700661+0000","last_clean":"2024-09-15T12:26:40.700661+0000","last_became_active":"2024-09-15T12:25:19.436362+0000","last_became_peered":"2024-09-15T12:25:19.436362+0000","last_unstale":"2024-09-15T12:26:40.700661+0000","last_undegraded":"2024-09-15T12:26:40.700661+0000","last_fullsized":"2024-09-15T12:26:40.700661+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":951,"log_dups_size":0,"ondisk_log_size":951,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62324736,"num_objects":951,"num_object_clones":0,"num_object_copies":2853,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":951,"num_write_kb":60864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"78'982","reported_seq":1054,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.590368+0000","last_change":"2024-09-15T12:25:19.475504+0000","last_active":"2024-09-15T12:26:40.590368+0000","last_peered":"2024-09-15T12:26:40.590368+0000","last_clean":"2024-09-15T12:26:40.590368+0000","last_became_active":"2024-09-15T12:25:19.467940+0000","last_became_peered":"2024-09-15T12:25:19.467940+0000","last_unstale":"2024-09-15T12:26:40.590368+0000","last_undegraded":"2024-09-15T12:26:40.590368+0000","last_fullsized":"2024-09-15T12:26:40.590368+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":982,"log_dups_size":0,"ondisk_log_size":982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64356352,"num_objects":982,"num_object_clones":0,"num_object_copies":2946,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":982,"num_write_kb":62848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"78'972","reported_seq":1044,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.595751+0000","last_change":"2024-09-15T12:25:19.403222+0000","last_active":"2024-09-15T12:26:40.595751+0000","last_peered":"2024-09-15T12:26:40.595751+0000","last_clean":"2024-09-15T12:26:40.595751+0000","last_became_active":"2024-09-15T12:25:19.396442+0000","last_became_peered":"2024-09-15T12:25:19.396442+0000","last_unstale":"2024-09-15T12:26:40.595751+0000","last_undegraded":"2024-09-15T12:26:40.595751+0000","last_fullsized":"2024-09-15T12:26:40.595751+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":972,"log_dups_size":0,"ondisk_log_size":972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63700992,"num_objects":972,"num_object_clones":0,"num_object_copies":2916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":972,"num_write_kb":62208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"78'1007","reported_seq":1079,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.722153+0000","last_change":"2024-09-15T12:25:19.418093+0000","last_active":"2024-09-15T12:26:40.722153+0000","last_peered":"2024-09-15T12:26:40.722153+0000","last_clean":"2024-09-15T12:26:40.722153+0000","last_became_active":"2024-09-15T12:25:19.412762+0000","last_became_peered":"2024-09-15T12:25:19.412762+0000","last_unstale":"2024-09-15T12:26:40.722153+0000","last_undegraded":"2024-09-15T12:26:40.722153+0000","last_fullsized":"2024-09-15T12:26:40.722153+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1007,"log_dups_size":0,"ondisk_log_size":1007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65994752,"num_objects":1007,"num_object_clones":0,"num_object_copies":3021,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1007,"num_write_kb":64448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"78'964","reported_seq":1036,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.660244+0000","last_change":"2024-09-15T12:25:19.514099+0000","last_active":"2024-09-15T12:26:40.660244+0000","last_peered":"2024-09-15T12:26:40.660244+0000","last_clean":"2024-09-15T12:26:40.660244+0000","last_became_active":"2024-09-15T12:25:19.506892+0000","last_became_peered":"2024-09-15T12:25:19.506892+0000","last_unstale":"2024-09-15T12:26:40.660244+0000","last_undegraded":"2024-09-15T12:26:40.660244+0000","last_fullsized":"2024-09-15T12:26:40.660244+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":964,"log_dups_size":0,"ondisk_log_size":964,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63176704,"num_objects":964,"num_object_clones":0,"num_object_copies":2892,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":964,"num_write_kb":61696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":277,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.283839+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:26:38.283839+0000","last_peered":"2024-09-15T12:26:38.283839+0000","last_clean":"2024-09-15T12:26:38.283839+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:26:38.283839+0000","last_undegraded":"2024-09-15T12:26:38.283839+0000","last_fullsized":"2024-09-15T12:26:38.283839+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":206,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.307035+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:26:38.307035+0000","last_peered":"2024-09-15T12:26:38.307035+0000","last_clean":"2024-09-15T12:26:38.307035+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:26:38.307035+0000","last_undegraded":"2024-09-15T12:26:38.307035+0000","last_fullsized":"2024-09-15T12:26:38.307035+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"78'1028","reported_seq":1100,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.755192+0000","last_change":"2024-09-15T12:25:19.470256+0000","last_active":"2024-09-15T12:26:40.755192+0000","last_peered":"2024-09-15T12:26:40.755192+0000","last_clean":"2024-09-15T12:26:40.755192+0000","last_became_active":"2024-09-15T12:25:19.458317+0000","last_became_peered":"2024-09-15T12:25:19.458317+0000","last_unstale":"2024-09-15T12:26:40.755192+0000","last_undegraded":"2024-09-15T12:26:40.755192+0000","last_fullsized":"2024-09-15T12:26:40.755192+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1028,"log_dups_size":0,"ondisk_log_size":1028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67371008,"num_objects":1028,"num_object_clones":0,"num_object_copies":3084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1028,"num_write_kb":65792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.297600+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:26:38.297600+0000","last_peered":"2024-09-15T12:26:38.297600+0000","last_clean":"2024-09-15T12:26:38.297600+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:26:38.297600+0000","last_undegraded":"2024-09-15T12:26:38.297600+0000","last_fullsized":"2024-09-15T12:26:38.297600+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"78'1008","reported_seq":1080,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.381678+0000","last_change":"2024-09-15T12:25:19.478666+0000","last_active":"2024-09-15T12:26:40.381678+0000","last_peered":"2024-09-15T12:26:40.381678+0000","last_clean":"2024-09-15T12:26:40.381678+0000","last_became_active":"2024-09-15T12:25:19.468663+0000","last_became_peered":"2024-09-15T12:25:19.468663+0000","last_unstale":"2024-09-15T12:26:40.381678+0000","last_undegraded":"2024-09-15T12:26:40.381678+0000","last_fullsized":"2024-09-15T12:26:40.381678+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1008,"log_dups_size":0,"ondisk_log_size":1008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66060288,"num_objects":1008,"num_object_clones":0,"num_object_copies":3024,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1008,"num_write_kb":64512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.300626+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:26:38.300626+0000","last_peered":"2024-09-15T12:26:38.300626+0000","last_clean":"2024-09-15T12:26:38.300626+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:26:38.300626+0000","last_undegraded":"2024-09-15T12:26:38.300626+0000","last_fullsized":"2024-09-15T12:26:38.300626+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"78'1013","reported_seq":1085,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.543210+0000","last_change":"2024-09-15T12:25:19.499536+0000","last_active":"2024-09-15T12:26:40.543210+0000","last_peered":"2024-09-15T12:26:40.543210+0000","last_clean":"2024-09-15T12:26:40.543210+0000","last_became_active":"2024-09-15T12:25:19.493017+0000","last_became_peered":"2024-09-15T12:25:19.493017+0000","last_unstale":"2024-09-15T12:26:40.543210+0000","last_undegraded":"2024-09-15T12:26:40.543210+0000","last_fullsized":"2024-09-15T12:26:40.543210+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66387968,"num_objects":1013,"num_object_clones":0,"num_object_copies":3039,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1013,"num_write_kb":64832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":207,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.292803+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:26:38.292803+0000","last_peered":"2024-09-15T12:26:38.292803+0000","last_clean":"2024-09-15T12:26:38.292803+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:26:38.292803+0000","last_undegraded":"2024-09-15T12:26:38.292803+0000","last_fullsized":"2024-09-15T12:26:38.292803+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"78'953","reported_seq":1025,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.726306+0000","last_change":"2024-09-15T12:25:19.413209+0000","last_active":"2024-09-15T12:26:40.726306+0000","last_peered":"2024-09-15T12:26:40.726306+0000","last_clean":"2024-09-15T12:26:40.726306+0000","last_became_active":"2024-09-15T12:25:19.403123+0000","last_became_peered":"2024-09-15T12:25:19.403123+0000","last_unstale":"2024-09-15T12:26:40.726306+0000","last_undegraded":"2024-09-15T12:26:40.726306+0000","last_fullsized":"2024-09-15T12:26:40.726306+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":953,"log_dups_size":0,"ondisk_log_size":953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62455808,"num_objects":953,"num_object_clones":0,"num_object_copies":2859,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":953,"num_write_kb":60992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.343877+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:26:38.343877+0000","last_peered":"2024-09-15T12:26:38.343877+0000","last_clean":"2024-09-15T12:26:38.343877+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:26:38.343877+0000","last_undegraded":"2024-09-15T12:26:38.343877+0000","last_fullsized":"2024-09-15T12:26:38.343877+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"78'1007","reported_seq":1079,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.748934+0000","last_change":"2024-09-15T12:25:19.429640+0000","last_active":"2024-09-15T12:26:40.748934+0000","last_peered":"2024-09-15T12:26:40.748934+0000","last_clean":"2024-09-15T12:26:40.748934+0000","last_became_active":"2024-09-15T12:25:19.422585+0000","last_became_peered":"2024-09-15T12:25:19.422585+0000","last_unstale":"2024-09-15T12:26:40.748934+0000","last_undegraded":"2024-09-15T12:26:40.748934+0000","last_fullsized":"2024-09-15T12:26:40.748934+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1007,"log_dups_size":0,"ondisk_log_size":1007,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65994752,"num_objects":1007,"num_object_clones":0,"num_object_copies":3021,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1007,"num_write_kb":64448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.285548+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:26:38.285548+0000","last_peered":"2024-09-15T12:26:38.285548+0000","last_clean":"2024-09-15T12:26:38.285548+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:26:38.285548+0000","last_undegraded":"2024-09-15T12:26:38.285548+0000","last_fullsized":"2024-09-15T12:26:38.285548+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"78'1024","reported_seq":1096,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:41.749788+0000","last_change":"2024-09-15T12:25:19.429532+0000","last_active":"2024-09-15T12:26:41.749788+0000","last_peered":"2024-09-15T12:26:41.749788+0000","last_clean":"2024-09-15T12:26:41.749788+0000","last_became_active":"2024-09-15T12:25:19.424570+0000","last_became_peered":"2024-09-15T12:25:19.424570+0000","last_unstale":"2024-09-15T12:26:41.749788+0000","last_undegraded":"2024-09-15T12:26:41.749788+0000","last_fullsized":"2024-09-15T12:26:41.749788+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1024,"log_dups_size":0,"ondisk_log_size":1024,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":1024,"num_object_clones":0,"num_object_copies":3072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1024,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.331592+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:26:38.331592+0000","last_peered":"2024-09-15T12:26:38.331592+0000","last_clean":"2024-09-15T12:26:38.331592+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:26:38.331592+0000","last_undegraded":"2024-09-15T12:26:38.331592+0000","last_fullsized":"2024-09-15T12:26:38.331592+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"78'959","reported_seq":1031,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:40.643126+0000","last_change":"2024-09-15T12:25:19.453184+0000","last_active":"2024-09-15T12:26:40.643126+0000","last_peered":"2024-09-15T12:26:40.643126+0000","last_clean":"2024-09-15T12:26:40.643126+0000","last_became_active":"2024-09-15T12:25:19.441520+0000","last_became_peered":"2024-09-15T12:25:19.441520+0000","last_unstale":"2024-09-15T12:26:40.643126+0000","last_undegraded":"2024-09-15T12:26:40.643126+0000","last_fullsized":"2024-09-15T12:26:40.643126+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":959,"log_dups_size":0,"ondisk_log_size":959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62849024,"num_objects":959,"num_object_clones":0,"num_object_copies":2877,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":959,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.305972+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:26:38.305972+0000","last_peered":"2024-09-15T12:26:38.305972+0000","last_clean":"2024-09-15T12:26:38.305972+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:26:38.305972+0000","last_undegraded":"2024-09-15T12:26:38.305972+0000","last_fullsized":"2024-09-15T12:26:38.305972+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":1038090240,"num_objects":15840,"num_object_clones":0,"num_object_copies":47520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15840,"num_write_kb":1013760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":194895872,"data_stored":3118333952,"data_compressed":148071851,"data_compressed_allocated":194895872,"data_compressed_original":3118333952,"omap_allocated":0,"internal_metadata":0},"log_size":15840,"ondisk_log_size":15840,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673438,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":129468,"kb_used_data":44332,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94242372,"statfs":{"total":96636764160,"available":96504188928,"internally_reserved":0,"allocated":45395968,"data_stored":715765913,"data_compressed":33978113,"data_compressed_allocated":44724224,"data_compressed_original":715505664,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706142,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":153136,"kb_used_data":55520,"kb_used_omap":0,"kb_used_meta":97600,"kb_avail":94218704,"statfs":{"total":96636764160,"available":96479952896,"internally_reserved":0,"allocated":56852480,"data_stored":899004588,"data_compressed":42679023,"data_compressed_allocated":56176640,"data_compressed_original":898744320,"omap_allocated":0,"internal_metadata":99942400},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706142,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":133076,"kb_used_data":39620,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94238764,"statfs":{"total":96636764160,"available":96500494336,"internally_reserved":0,"allocated":40570880,"data_stored":638891660,"data_compressed":30325696,"data_compressed_allocated":39915520,"data_compressed_original":638648320,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706142,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":140856,"kb_used_data":51560,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94230984,"statfs":{"total":96636764160,"available":96492527616,"internally_reserved":0,"allocated":52797440,"data_stored":834123948,"data_compressed":39598219,"data_compressed_allocated":52121600,"data_compressed_original":833863680,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":52596736,"data_stored":841547776,"data_compressed":39960299,"data_compressed_allocated":52596736,"data_compressed_original":841547776,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40402944,"data_stored":646447104,"data_compressed":30696024,"data_compressed_allocated":40402944,"data_compressed_original":646447104,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":56754176,"data_stored":908066816,"data_compressed":43118903,"data_compressed_allocated":56754176,"data_compressed_original":908066816,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45142016,"data_stored":722272256,"data_compressed":34296625,"data_compressed_allocated":45142016,"data_compressed_original":722272256,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:27:05.383 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:27:05.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:05.542+0000 7fcdb12d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:05.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:05.553+0000 7fcdb12d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:07.706 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:27:07.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:07.859+0000 7fb3f80a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:07.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:07.867+0000 7fb3f80a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:10.105 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:27:10.105 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:27:10.106 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:27:10.106 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:27:10.131 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:27:10.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:10.262+0000 7f4981b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:10.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:10.277+0000 7f4981b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:10.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:10.308+0000 7fcb8a791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:10.315 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:27:10.315 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:27:10.315 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:27:10.315 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:27:10.315 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:27:10.315 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:27:10.315 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:27:10.315 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:27:10.315 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:27:10.315 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:27:10.315 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:27:10.315 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:27:10.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:10.317+0000 7fcb8a791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:10.320 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:27:10.320 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:27:10.320 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:27:10.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:10.493+0000 7f2e4c191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:10.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:10.511+0000 7f2e4c191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:10.651 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:27:10.651 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:27:10.651 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:27:10.651 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:27:10.652 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:27:10.652 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:27:10.652 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:27:10.652 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:27:10.652 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:27:10.652 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:27:10.652 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:27:10.652 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:27:10.655 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:27:10.656 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:27:10.656 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:27:10.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:10.805+0000 7f8c194ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:10.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:10.819+0000 7f8c194ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:10.931 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:27:10.931 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:27:10.931 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:27:10.931 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:27:10.931 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:27:10.931 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:27:10.931 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:27:10.931 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:27:10.931 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:27:10.932 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:27:10.932 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:27:10.932 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:27:10.934 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:27:10.934 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:27:10.935 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:27:11.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:11.117+0000 7f21ca4bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:11.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:11.129+0000 7f21ca4bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:11.154 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:27:11.154 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:27:11.154 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:27:11.154 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:27:11.154 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:27:11.154 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:27:11.154 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:27:11.155 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:27:11.155 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:27:11.155 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:27:11.155 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:27:11.155 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:27:11.158 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:27:11.158 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:27:12.804 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:27:12.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:12.952+0000 7fc509511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:12.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:12.964+0000 7fc509511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:15.265 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:27:15.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:15.413+0000 7fe2e9791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:15.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:15.422+0000 7fe2e9791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:16.159 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:27:16.159 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:27:16.160 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:27:16.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:16.324+0000 7f6ed1151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:16.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:16.336+0000 7f6ed1151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:16.648 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:27:16.649 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:27:16.665 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":328,"stamp":"2024-09-15T12:27:15.804407+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":901120587,"num_objects":13746,"num_object_clones":0,"num_object_copies":41238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":21373,"num_write_kb":1122133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21347,"ondisk_log_size":21347,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":513904,"kb_used_data":169196,"kb_used_omap":0,"kb_used_meta":344640,"kb_avail":376973456,"statfs":{"total":386547056640,"available":386020818944,"internally_reserved":0,"allocated":173256704,"data_stored":2729828549,"data_compressed":129586637,"data_compressed_allocated":170565632,"data_compressed_original":2728804352,"omap_allocated":0,"internal_metadata":352911360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-137560040,"num_objects":-2098,"num_object_clones":0,"num_object_copies":-6294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5452,"num_write_kb":107265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002599"},"pg_stats":[{"pgid":"5.f","version":"78'1326","reported_seq":1398,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.635529+0000","last_change":"2024-09-15T12:25:19.440663+0000","last_active":"2024-09-15T12:27:10.635529+0000","last_peered":"2024-09-15T12:27:10.635529+0000","last_clean":"2024-09-15T12:27:10.635529+0000","last_became_active":"2024-09-15T12:25:19.421824+0000","last_became_peered":"2024-09-15T12:25:19.421824+0000","last_unstale":"2024-09-15T12:27:10.635529+0000","last_undegraded":"2024-09-15T12:27:10.635529+0000","last_fullsized":"2024-09-15T12:27:10.635529+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1326,"log_dups_size":0,"ondisk_log_size":1326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58064896,"num_objects":886,"num_object_clones":0,"num_object_copies":2658,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1326,"num_write_kb":70784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"78'1272","reported_seq":1344,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.708893+0000","last_change":"2024-09-15T12:25:19.444566+0000","last_active":"2024-09-15T12:27:10.708893+0000","last_peered":"2024-09-15T12:27:10.708893+0000","last_clean":"2024-09-15T12:27:10.708893+0000","last_became_active":"2024-09-15T12:25:19.436490+0000","last_became_peered":"2024-09-15T12:25:19.436490+0000","last_unstale":"2024-09-15T12:27:10.708893+0000","last_undegraded":"2024-09-15T12:27:10.708893+0000","last_fullsized":"2024-09-15T12:27:10.708893+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1272,"log_dups_size":0,"ondisk_log_size":1272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53739520,"num_objects":820,"num_object_clones":0,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1272,"num_write_kb":66944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"78'1317","reported_seq":1390,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.653665+0000","last_change":"2024-09-15T12:25:19.466585+0000","last_active":"2024-09-15T12:27:10.653665+0000","last_peered":"2024-09-15T12:27:10.653665+0000","last_clean":"2024-09-15T12:27:10.653665+0000","last_became_active":"2024-09-15T12:25:19.449036+0000","last_became_peered":"2024-09-15T12:25:19.449036+0000","last_unstale":"2024-09-15T12:27:10.653665+0000","last_undegraded":"2024-09-15T12:27:10.653665+0000","last_fullsized":"2024-09-15T12:27:10.653665+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1317,"log_dups_size":0,"ondisk_log_size":1317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57802776,"num_objects":883,"num_object_clones":0,"num_object_copies":2649,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1317,"num_write_kb":70337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"78'1407","reported_seq":1479,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:11.644676+0000","last_change":"2024-09-15T12:25:19.412052+0000","last_active":"2024-09-15T12:27:11.644676+0000","last_peered":"2024-09-15T12:27:11.644676+0000","last_clean":"2024-09-15T12:27:11.644676+0000","last_became_active":"2024-09-15T12:25:19.396072+0000","last_became_peered":"2024-09-15T12:25:19.396072+0000","last_unstale":"2024-09-15T12:27:11.644676+0000","last_undegraded":"2024-09-15T12:27:11.644676+0000","last_fullsized":"2024-09-15T12:27:11.644676+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1407,"log_dups_size":0,"ondisk_log_size":1407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55508992,"num_objects":847,"num_object_clones":0,"num_object_copies":2541,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1407,"num_write_kb":72128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"78'1272","reported_seq":1344,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.547902+0000","last_change":"2024-09-15T12:25:19.447319+0000","last_active":"2024-09-15T12:27:10.547902+0000","last_peered":"2024-09-15T12:27:10.547902+0000","last_clean":"2024-09-15T12:27:10.547902+0000","last_became_active":"2024-09-15T12:25:19.436362+0000","last_became_peered":"2024-09-15T12:25:19.436362+0000","last_unstale":"2024-09-15T12:27:10.547902+0000","last_undegraded":"2024-09-15T12:27:10.547902+0000","last_fullsized":"2024-09-15T12:27:10.547902+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1272,"log_dups_size":0,"ondisk_log_size":1272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54001664,"num_objects":824,"num_object_clones":0,"num_object_copies":2472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1272,"num_write_kb":67072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"78'1347","reported_seq":1419,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.587008+0000","last_change":"2024-09-15T12:25:19.475504+0000","last_active":"2024-09-15T12:27:10.587008+0000","last_peered":"2024-09-15T12:27:10.587008+0000","last_clean":"2024-09-15T12:27:10.587008+0000","last_became_active":"2024-09-15T12:25:19.467940+0000","last_became_peered":"2024-09-15T12:25:19.467940+0000","last_unstale":"2024-09-15T12:27:10.587008+0000","last_undegraded":"2024-09-15T12:27:10.587008+0000","last_fullsized":"2024-09-15T12:27:10.587008+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1347,"log_dups_size":0,"ondisk_log_size":1347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55377920,"num_objects":845,"num_object_clones":0,"num_object_copies":2535,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1347,"num_write_kb":70144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"78'1313","reported_seq":1385,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.581198+0000","last_change":"2024-09-15T12:25:19.403222+0000","last_active":"2024-09-15T12:27:10.581198+0000","last_peered":"2024-09-15T12:27:10.581198+0000","last_clean":"2024-09-15T12:27:10.581198+0000","last_became_active":"2024-09-15T12:25:19.396442+0000","last_became_peered":"2024-09-15T12:25:19.396442+0000","last_unstale":"2024-09-15T12:27:10.581198+0000","last_undegraded":"2024-09-15T12:27:10.581198+0000","last_fullsized":"2024-09-15T12:27:10.581198+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1313,"log_dups_size":0,"ondisk_log_size":1313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57475072,"num_objects":877,"num_object_clones":0,"num_object_copies":2631,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1313,"num_write_kb":70080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"78'1320","reported_seq":1392,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.401853+0000","last_change":"2024-09-15T12:25:19.418093+0000","last_active":"2024-09-15T12:27:10.401853+0000","last_peered":"2024-09-15T12:27:10.401853+0000","last_clean":"2024-09-15T12:27:10.401853+0000","last_became_active":"2024-09-15T12:25:19.412762+0000","last_became_peered":"2024-09-15T12:25:19.412762+0000","last_unstale":"2024-09-15T12:27:10.401853+0000","last_undegraded":"2024-09-15T12:27:10.401853+0000","last_fullsized":"2024-09-15T12:27:10.401853+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1320,"log_dups_size":0,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57147392,"num_objects":872,"num_object_clones":0,"num_object_copies":2616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1320,"num_write_kb":70144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"78'1314","reported_seq":1386,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.578347+0000","last_change":"2024-09-15T12:25:19.514099+0000","last_active":"2024-09-15T12:27:10.578347+0000","last_peered":"2024-09-15T12:27:10.578347+0000","last_clean":"2024-09-15T12:27:10.578347+0000","last_became_active":"2024-09-15T12:25:19.506892+0000","last_became_peered":"2024-09-15T12:25:19.506892+0000","last_unstale":"2024-09-15T12:27:10.578347+0000","last_undegraded":"2024-09-15T12:27:10.578347+0000","last_fullsized":"2024-09-15T12:27:10.578347+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1314,"log_dups_size":0,"ondisk_log_size":1314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54657024,"num_objects":834,"num_object_clones":0,"num_object_copies":2502,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1314,"num_write_kb":68736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":277,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.283839+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:26:38.283839+0000","last_peered":"2024-09-15T12:26:38.283839+0000","last_clean":"2024-09-15T12:26:38.283839+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:26:38.283839+0000","last_undegraded":"2024-09-15T12:26:38.283839+0000","last_fullsized":"2024-09-15T12:26:38.283839+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":206,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.307035+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:26:38.307035+0000","last_peered":"2024-09-15T12:26:38.307035+0000","last_clean":"2024-09-15T12:26:38.307035+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:26:38.307035+0000","last_undegraded":"2024-09-15T12:26:38.307035+0000","last_fullsized":"2024-09-15T12:26:38.307035+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"78'1352","reported_seq":1424,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.729120+0000","last_change":"2024-09-15T12:25:19.470256+0000","last_active":"2024-09-15T12:27:10.729120+0000","last_peered":"2024-09-15T12:27:10.729120+0000","last_clean":"2024-09-15T12:27:10.729120+0000","last_became_active":"2024-09-15T12:25:19.458317+0000","last_became_peered":"2024-09-15T12:25:19.458317+0000","last_unstale":"2024-09-15T12:27:10.729120+0000","last_undegraded":"2024-09-15T12:27:10.729120+0000","last_fullsized":"2024-09-15T12:27:10.729120+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1352,"log_dups_size":0,"ondisk_log_size":1352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":896,"num_object_clones":0,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1352,"num_write_kb":71936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.297600+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:26:38.297600+0000","last_peered":"2024-09-15T12:26:38.297600+0000","last_clean":"2024-09-15T12:26:38.297600+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:26:38.297600+0000","last_undegraded":"2024-09-15T12:26:38.297600+0000","last_fullsized":"2024-09-15T12:26:38.297600+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"78'1315","reported_seq":1387,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.675717+0000","last_change":"2024-09-15T12:25:19.478666+0000","last_active":"2024-09-15T12:27:10.675717+0000","last_peered":"2024-09-15T12:27:10.675717+0000","last_clean":"2024-09-15T12:27:10.675717+0000","last_became_active":"2024-09-15T12:25:19.468663+0000","last_became_peered":"2024-09-15T12:25:19.468663+0000","last_unstale":"2024-09-15T12:27:10.675717+0000","last_undegraded":"2024-09-15T12:27:10.675717+0000","last_fullsized":"2024-09-15T12:27:10.675717+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1315,"log_dups_size":0,"ondisk_log_size":1315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58916864,"num_objects":899,"num_object_clones":0,"num_object_copies":2697,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1315,"num_write_kb":70848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.300626+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:26:38.300626+0000","last_peered":"2024-09-15T12:26:38.300626+0000","last_clean":"2024-09-15T12:26:38.300626+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:26:38.300626+0000","last_undegraded":"2024-09-15T12:26:38.300626+0000","last_fullsized":"2024-09-15T12:26:38.300626+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"78'1345","reported_seq":1417,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.566936+0000","last_change":"2024-09-15T12:25:19.499536+0000","last_active":"2024-09-15T12:27:10.566936+0000","last_peered":"2024-09-15T12:27:10.566936+0000","last_clean":"2024-09-15T12:27:10.566936+0000","last_became_active":"2024-09-15T12:25:19.493017+0000","last_became_peered":"2024-09-15T12:25:19.493017+0000","last_unstale":"2024-09-15T12:27:10.566936+0000","last_undegraded":"2024-09-15T12:27:10.566936+0000","last_fullsized":"2024-09-15T12:27:10.566936+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1345,"log_dups_size":0,"ondisk_log_size":1345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55771136,"num_objects":851,"num_object_clones":0,"num_object_copies":2553,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1345,"num_write_kb":70272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":207,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.292803+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:26:38.292803+0000","last_peered":"2024-09-15T12:26:38.292803+0000","last_clean":"2024-09-15T12:26:38.292803+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:26:38.292803+0000","last_undegraded":"2024-09-15T12:26:38.292803+0000","last_fullsized":"2024-09-15T12:26:38.292803+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"78'1322","reported_seq":1394,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.597394+0000","last_change":"2024-09-15T12:25:19.413209+0000","last_active":"2024-09-15T12:27:10.597394+0000","last_peered":"2024-09-15T12:27:10.597394+0000","last_clean":"2024-09-15T12:27:10.597394+0000","last_became_active":"2024-09-15T12:25:19.403123+0000","last_became_peered":"2024-09-15T12:25:19.403123+0000","last_unstale":"2024-09-15T12:27:10.597394+0000","last_undegraded":"2024-09-15T12:27:10.597394+0000","last_fullsized":"2024-09-15T12:27:10.597394+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1322,"log_dups_size":0,"ondisk_log_size":1322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53739520,"num_objects":820,"num_object_clones":0,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1322,"num_write_kb":68544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.343877+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:26:38.343877+0000","last_peered":"2024-09-15T12:26:38.343877+0000","last_clean":"2024-09-15T12:26:38.343877+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:26:38.343877+0000","last_undegraded":"2024-09-15T12:26:38.343877+0000","last_fullsized":"2024-09-15T12:26:38.343877+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"78'1384","reported_seq":1456,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.587433+0000","last_change":"2024-09-15T12:25:19.429640+0000","last_active":"2024-09-15T12:27:10.587433+0000","last_peered":"2024-09-15T12:27:10.587433+0000","last_clean":"2024-09-15T12:27:10.587433+0000","last_became_active":"2024-09-15T12:25:19.422585+0000","last_became_peered":"2024-09-15T12:25:19.422585+0000","last_unstale":"2024-09-15T12:27:10.587433+0000","last_undegraded":"2024-09-15T12:27:10.587433+0000","last_fullsized":"2024-09-15T12:27:10.587433+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1384,"log_dups_size":0,"ondisk_log_size":1384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57278464,"num_objects":874,"num_object_clones":0,"num_object_copies":2622,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1384,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.285548+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:26:38.285548+0000","last_peered":"2024-09-15T12:26:38.285548+0000","last_clean":"2024-09-15T12:26:38.285548+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:26:38.285548+0000","last_undegraded":"2024-09-15T12:26:38.285548+0000","last_fullsized":"2024-09-15T12:26:38.285548+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"78'1360","reported_seq":1432,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:11.762638+0000","last_change":"2024-09-15T12:25:19.429532+0000","last_active":"2024-09-15T12:27:11.762638+0000","last_peered":"2024-09-15T12:27:11.762638+0000","last_clean":"2024-09-15T12:27:11.762638+0000","last_became_active":"2024-09-15T12:25:19.424570+0000","last_became_peered":"2024-09-15T12:25:19.424570+0000","last_unstale":"2024-09-15T12:27:11.762638+0000","last_undegraded":"2024-09-15T12:27:11.762638+0000","last_fullsized":"2024-09-15T12:27:11.762638+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1360,"log_dups_size":0,"ondisk_log_size":1360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57802752,"num_objects":882,"num_object_clones":0,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1360,"num_write_kb":71744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.331592+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:26:38.331592+0000","last_peered":"2024-09-15T12:26:38.331592+0000","last_clean":"2024-09-15T12:26:38.331592+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:26:38.331592+0000","last_undegraded":"2024-09-15T12:26:38.331592+0000","last_fullsized":"2024-09-15T12:26:38.331592+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"78'1326","reported_seq":1398,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.525567+0000","last_change":"2024-09-15T12:25:19.453184+0000","last_active":"2024-09-15T12:27:10.525567+0000","last_peered":"2024-09-15T12:27:10.525567+0000","last_clean":"2024-09-15T12:27:10.525567+0000","last_became_active":"2024-09-15T12:25:19.441520+0000","last_became_peered":"2024-09-15T12:25:19.441520+0000","last_unstale":"2024-09-15T12:27:10.525567+0000","last_undegraded":"2024-09-15T12:27:10.525567+0000","last_fullsized":"2024-09-15T12:27:10.525567+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1326,"log_dups_size":0,"ondisk_log_size":1326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":832,"num_object_clones":0,"num_object_copies":2496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1326,"num_write_kb":69056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.305972+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:26:38.305972+0000","last_peered":"2024-09-15T12:26:38.305972+0000","last_clean":"2024-09-15T12:26:38.305972+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:26:38.305972+0000","last_undegraded":"2024-09-15T12:26:38.305972+0000","last_fullsized":"2024-09-15T12:26:38.305972+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":900530200,"num_objects":13742,"num_object_clones":0,"num_object_copies":41226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":21292,"num_write_kb":1121025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":168640512,"data_stored":2698051656,"data_compressed":128117925,"data_compressed_allocated":168628224,"data_compressed_original":2698051584,"omap_allocated":0,"internal_metadata":0},"log_size":21292,"ondisk_log_size":21292,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673468,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123532,"kb_used_data":38396,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94248308,"statfs":{"total":96636764160,"available":96510267392,"internally_reserved":0,"allocated":39317504,"data_stored":618444977,"data_compressed":29357519,"data_compressed_allocated":38641664,"data_compressed_original":618184704,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":130512,"kb_used_data":49532,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94241328,"statfs":{"total":96636764160,"available":96503119872,"internally_reserved":0,"allocated":50720768,"data_stored":800831684,"data_compressed":38018215,"data_compressed_allocated":50040832,"data_compressed_original":800571392,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":124456,"kb_used_data":35160,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94247384,"statfs":{"total":96636764160,"available":96509321216,"internally_reserved":0,"allocated":36003840,"data_stored":565819020,"data_compressed":26856560,"data_compressed_allocated":35348480,"data_compressed_original":565575680,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":135404,"kb_used_data":46108,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94236436,"statfs":{"total":96636764160,"available":96498110464,"internally_reserved":0,"allocated":47214592,"data_stored":744732868,"data_compressed":35354343,"data_compressed_allocated":46534656,"data_compressed_original":744472576,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46010368,"data_stored":736100376,"data_compressed":34953983,"data_compressed_allocated":46006272,"data_compressed_original":736100352,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":34979840,"data_stored":559677440,"data_compressed":26576480,"data_compressed_allocated":34979840,"data_compressed_original":559677440,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49451008,"data_stored":791150616,"data_compressed":37568063,"data_compressed_allocated":49446912,"data_compressed_original":791150592,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":38199296,"data_stored":611123224,"data_compressed":29019399,"data_compressed_allocated":38195200,"data_compressed_original":611123200,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:27:17.641 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:27:17.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:17.788+0000 7f29c5391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:17.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:17.796+0000 7f29c5391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:20.042 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:27:20.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:20.212+0000 7f3330111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:20.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:20.226+0000 7f3330111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:21.667 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:27:21.667 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:27:21.668 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:27:21.668 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:27:21.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:21.824+0000 7ff6bbf51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:21.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:21.840+0000 7ff6bbf51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:21.895 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:27:21.895 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:27:21.895 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:27:21.895 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:27:21.895 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:27:21.895 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:27:21.895 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:27:21.895 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:27:21.896 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:27:21.896 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:27:21.896 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:27:21.896 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:27:21.900 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:27:21.900 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:27:21.900 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:27:22.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:22.027+0000 7f37a0a74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:22.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:22.042+0000 7f37a0a74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:22.079 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:27:22.079 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:27:22.079 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:27:22.079 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:27:22.079 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:27:22.079 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:27:22.079 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:27:22.079 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:27:22.079 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:27:22.079 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:27:22.079 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:27:22.080 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:27:22.083 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:27:22.084 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:27:22.084 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:27:22.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:22.232+0000 7f84e2791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:22.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:22.243+0000 7f84e2791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:22.304 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:27:22.304 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:27:22.304 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:27:22.305 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:27:22.305 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:27:22.305 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:27:22.305 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:27:22.305 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:27:22.305 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:27:22.305 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:27:22.305 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:27:22.305 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:27:22.309 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:27:22.310 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:27:22.310 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:27:22.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:22.462+0000 7f3678cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:22.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:22.479+0000 7f3678cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:22.525 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:27:22.525 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:27:22.525 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:27:22.525 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:27:22.525 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:27:22.525 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:27:22.526 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:27:22.526 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:27:22.526 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:27:22.526 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:27:22.526 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:27:22.526 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:27:22.530 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:27:22.530 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:27:22.556 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:27:22.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:22.710+0000 7f87fbb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:22.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:22.718+0000 7f87fbb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:25.060 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:27:25.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:25.196+0000 7fb4edd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:25.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:25.203+0000 7fb4edd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:27.469 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:27:27.531 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:27:27.531 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:27:27.532 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:27:27.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:27.631+0000 7f026ef51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:27.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:27.643+0000 7f026ef51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:27.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:27.695+0000 7f8ee4591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:27.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:27.711+0000 7f8ee4591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:28.044 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:27:28.044 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:27:28.064 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":334,"stamp":"2024-09-15T12:27:27.806703+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":901120587,"num_objects":13746,"num_object_clones":0,"num_object_copies":41238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":21373,"num_write_kb":1122133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21347,"ondisk_log_size":21347,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":513904,"kb_used_data":169196,"kb_used_omap":0,"kb_used_meta":344640,"kb_avail":376973456,"statfs":{"total":386547056640,"available":386020818944,"internally_reserved":0,"allocated":173256704,"data_stored":2729828549,"data_compressed":129586637,"data_compressed_allocated":170565632,"data_compressed_original":2728804352,"omap_allocated":0,"internal_metadata":352911360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002295"},"pg_stats":[{"pgid":"5.f","version":"78'1326","reported_seq":1398,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.635529+0000","last_change":"2024-09-15T12:25:19.440663+0000","last_active":"2024-09-15T12:27:10.635529+0000","last_peered":"2024-09-15T12:27:10.635529+0000","last_clean":"2024-09-15T12:27:10.635529+0000","last_became_active":"2024-09-15T12:25:19.421824+0000","last_became_peered":"2024-09-15T12:25:19.421824+0000","last_unstale":"2024-09-15T12:27:10.635529+0000","last_undegraded":"2024-09-15T12:27:10.635529+0000","last_fullsized":"2024-09-15T12:27:10.635529+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1326,"log_dups_size":0,"ondisk_log_size":1326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58064896,"num_objects":886,"num_object_clones":0,"num_object_copies":2658,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1326,"num_write_kb":70784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"78'1272","reported_seq":1344,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.708893+0000","last_change":"2024-09-15T12:25:19.444566+0000","last_active":"2024-09-15T12:27:10.708893+0000","last_peered":"2024-09-15T12:27:10.708893+0000","last_clean":"2024-09-15T12:27:10.708893+0000","last_became_active":"2024-09-15T12:25:19.436490+0000","last_became_peered":"2024-09-15T12:25:19.436490+0000","last_unstale":"2024-09-15T12:27:10.708893+0000","last_undegraded":"2024-09-15T12:27:10.708893+0000","last_fullsized":"2024-09-15T12:27:10.708893+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1272,"log_dups_size":0,"ondisk_log_size":1272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53739520,"num_objects":820,"num_object_clones":0,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1272,"num_write_kb":66944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"78'1317","reported_seq":1390,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.653665+0000","last_change":"2024-09-15T12:25:19.466585+0000","last_active":"2024-09-15T12:27:10.653665+0000","last_peered":"2024-09-15T12:27:10.653665+0000","last_clean":"2024-09-15T12:27:10.653665+0000","last_became_active":"2024-09-15T12:25:19.449036+0000","last_became_peered":"2024-09-15T12:25:19.449036+0000","last_unstale":"2024-09-15T12:27:10.653665+0000","last_undegraded":"2024-09-15T12:27:10.653665+0000","last_fullsized":"2024-09-15T12:27:10.653665+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1317,"log_dups_size":0,"ondisk_log_size":1317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57802776,"num_objects":883,"num_object_clones":0,"num_object_copies":2649,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1317,"num_write_kb":70337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"78'1407","reported_seq":1479,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:11.644676+0000","last_change":"2024-09-15T12:25:19.412052+0000","last_active":"2024-09-15T12:27:11.644676+0000","last_peered":"2024-09-15T12:27:11.644676+0000","last_clean":"2024-09-15T12:27:11.644676+0000","last_became_active":"2024-09-15T12:25:19.396072+0000","last_became_peered":"2024-09-15T12:25:19.396072+0000","last_unstale":"2024-09-15T12:27:11.644676+0000","last_undegraded":"2024-09-15T12:27:11.644676+0000","last_fullsized":"2024-09-15T12:27:11.644676+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1407,"log_dups_size":0,"ondisk_log_size":1407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55508992,"num_objects":847,"num_object_clones":0,"num_object_copies":2541,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1407,"num_write_kb":72128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"78'1272","reported_seq":1344,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.547902+0000","last_change":"2024-09-15T12:25:19.447319+0000","last_active":"2024-09-15T12:27:10.547902+0000","last_peered":"2024-09-15T12:27:10.547902+0000","last_clean":"2024-09-15T12:27:10.547902+0000","last_became_active":"2024-09-15T12:25:19.436362+0000","last_became_peered":"2024-09-15T12:25:19.436362+0000","last_unstale":"2024-09-15T12:27:10.547902+0000","last_undegraded":"2024-09-15T12:27:10.547902+0000","last_fullsized":"2024-09-15T12:27:10.547902+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1272,"log_dups_size":0,"ondisk_log_size":1272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54001664,"num_objects":824,"num_object_clones":0,"num_object_copies":2472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1272,"num_write_kb":67072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"78'1347","reported_seq":1419,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.587008+0000","last_change":"2024-09-15T12:25:19.475504+0000","last_active":"2024-09-15T12:27:10.587008+0000","last_peered":"2024-09-15T12:27:10.587008+0000","last_clean":"2024-09-15T12:27:10.587008+0000","last_became_active":"2024-09-15T12:25:19.467940+0000","last_became_peered":"2024-09-15T12:25:19.467940+0000","last_unstale":"2024-09-15T12:27:10.587008+0000","last_undegraded":"2024-09-15T12:27:10.587008+0000","last_fullsized":"2024-09-15T12:27:10.587008+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1347,"log_dups_size":0,"ondisk_log_size":1347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55377920,"num_objects":845,"num_object_clones":0,"num_object_copies":2535,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1347,"num_write_kb":70144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"78'1313","reported_seq":1385,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.581198+0000","last_change":"2024-09-15T12:25:19.403222+0000","last_active":"2024-09-15T12:27:10.581198+0000","last_peered":"2024-09-15T12:27:10.581198+0000","last_clean":"2024-09-15T12:27:10.581198+0000","last_became_active":"2024-09-15T12:25:19.396442+0000","last_became_peered":"2024-09-15T12:25:19.396442+0000","last_unstale":"2024-09-15T12:27:10.581198+0000","last_undegraded":"2024-09-15T12:27:10.581198+0000","last_fullsized":"2024-09-15T12:27:10.581198+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1313,"log_dups_size":0,"ondisk_log_size":1313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57475072,"num_objects":877,"num_object_clones":0,"num_object_copies":2631,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1313,"num_write_kb":70080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"78'1320","reported_seq":1392,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.401853+0000","last_change":"2024-09-15T12:25:19.418093+0000","last_active":"2024-09-15T12:27:10.401853+0000","last_peered":"2024-09-15T12:27:10.401853+0000","last_clean":"2024-09-15T12:27:10.401853+0000","last_became_active":"2024-09-15T12:25:19.412762+0000","last_became_peered":"2024-09-15T12:25:19.412762+0000","last_unstale":"2024-09-15T12:27:10.401853+0000","last_undegraded":"2024-09-15T12:27:10.401853+0000","last_fullsized":"2024-09-15T12:27:10.401853+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1320,"log_dups_size":0,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57147392,"num_objects":872,"num_object_clones":0,"num_object_copies":2616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1320,"num_write_kb":70144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"78'1314","reported_seq":1386,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.578347+0000","last_change":"2024-09-15T12:25:19.514099+0000","last_active":"2024-09-15T12:27:10.578347+0000","last_peered":"2024-09-15T12:27:10.578347+0000","last_clean":"2024-09-15T12:27:10.578347+0000","last_became_active":"2024-09-15T12:25:19.506892+0000","last_became_peered":"2024-09-15T12:25:19.506892+0000","last_unstale":"2024-09-15T12:27:10.578347+0000","last_undegraded":"2024-09-15T12:27:10.578347+0000","last_fullsized":"2024-09-15T12:27:10.578347+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1314,"log_dups_size":0,"ondisk_log_size":1314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54657024,"num_objects":834,"num_object_clones":0,"num_object_copies":2502,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1314,"num_write_kb":68736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":277,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.283839+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:26:38.283839+0000","last_peered":"2024-09-15T12:26:38.283839+0000","last_clean":"2024-09-15T12:26:38.283839+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:26:38.283839+0000","last_undegraded":"2024-09-15T12:26:38.283839+0000","last_fullsized":"2024-09-15T12:26:38.283839+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":206,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.307035+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:26:38.307035+0000","last_peered":"2024-09-15T12:26:38.307035+0000","last_clean":"2024-09-15T12:26:38.307035+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:26:38.307035+0000","last_undegraded":"2024-09-15T12:26:38.307035+0000","last_fullsized":"2024-09-15T12:26:38.307035+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"78'1352","reported_seq":1424,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.729120+0000","last_change":"2024-09-15T12:25:19.470256+0000","last_active":"2024-09-15T12:27:10.729120+0000","last_peered":"2024-09-15T12:27:10.729120+0000","last_clean":"2024-09-15T12:27:10.729120+0000","last_became_active":"2024-09-15T12:25:19.458317+0000","last_became_peered":"2024-09-15T12:25:19.458317+0000","last_unstale":"2024-09-15T12:27:10.729120+0000","last_undegraded":"2024-09-15T12:27:10.729120+0000","last_fullsized":"2024-09-15T12:27:10.729120+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1352,"log_dups_size":0,"ondisk_log_size":1352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":896,"num_object_clones":0,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1352,"num_write_kb":71936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.297600+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:26:38.297600+0000","last_peered":"2024-09-15T12:26:38.297600+0000","last_clean":"2024-09-15T12:26:38.297600+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:26:38.297600+0000","last_undegraded":"2024-09-15T12:26:38.297600+0000","last_fullsized":"2024-09-15T12:26:38.297600+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"78'1315","reported_seq":1387,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.675717+0000","last_change":"2024-09-15T12:25:19.478666+0000","last_active":"2024-09-15T12:27:10.675717+0000","last_peered":"2024-09-15T12:27:10.675717+0000","last_clean":"2024-09-15T12:27:10.675717+0000","last_became_active":"2024-09-15T12:25:19.468663+0000","last_became_peered":"2024-09-15T12:25:19.468663+0000","last_unstale":"2024-09-15T12:27:10.675717+0000","last_undegraded":"2024-09-15T12:27:10.675717+0000","last_fullsized":"2024-09-15T12:27:10.675717+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1315,"log_dups_size":0,"ondisk_log_size":1315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58916864,"num_objects":899,"num_object_clones":0,"num_object_copies":2697,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1315,"num_write_kb":70848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.300626+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:26:38.300626+0000","last_peered":"2024-09-15T12:26:38.300626+0000","last_clean":"2024-09-15T12:26:38.300626+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:26:38.300626+0000","last_undegraded":"2024-09-15T12:26:38.300626+0000","last_fullsized":"2024-09-15T12:26:38.300626+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"78'1345","reported_seq":1417,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.566936+0000","last_change":"2024-09-15T12:25:19.499536+0000","last_active":"2024-09-15T12:27:10.566936+0000","last_peered":"2024-09-15T12:27:10.566936+0000","last_clean":"2024-09-15T12:27:10.566936+0000","last_became_active":"2024-09-15T12:25:19.493017+0000","last_became_peered":"2024-09-15T12:25:19.493017+0000","last_unstale":"2024-09-15T12:27:10.566936+0000","last_undegraded":"2024-09-15T12:27:10.566936+0000","last_fullsized":"2024-09-15T12:27:10.566936+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1345,"log_dups_size":0,"ondisk_log_size":1345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55771136,"num_objects":851,"num_object_clones":0,"num_object_copies":2553,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1345,"num_write_kb":70272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":207,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.292803+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:26:38.292803+0000","last_peered":"2024-09-15T12:26:38.292803+0000","last_clean":"2024-09-15T12:26:38.292803+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:26:38.292803+0000","last_undegraded":"2024-09-15T12:26:38.292803+0000","last_fullsized":"2024-09-15T12:26:38.292803+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"78'1322","reported_seq":1394,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.597394+0000","last_change":"2024-09-15T12:25:19.413209+0000","last_active":"2024-09-15T12:27:10.597394+0000","last_peered":"2024-09-15T12:27:10.597394+0000","last_clean":"2024-09-15T12:27:10.597394+0000","last_became_active":"2024-09-15T12:25:19.403123+0000","last_became_peered":"2024-09-15T12:25:19.403123+0000","last_unstale":"2024-09-15T12:27:10.597394+0000","last_undegraded":"2024-09-15T12:27:10.597394+0000","last_fullsized":"2024-09-15T12:27:10.597394+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1322,"log_dups_size":0,"ondisk_log_size":1322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53739520,"num_objects":820,"num_object_clones":0,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1322,"num_write_kb":68544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.343877+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:26:38.343877+0000","last_peered":"2024-09-15T12:26:38.343877+0000","last_clean":"2024-09-15T12:26:38.343877+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:26:38.343877+0000","last_undegraded":"2024-09-15T12:26:38.343877+0000","last_fullsized":"2024-09-15T12:26:38.343877+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"78'1384","reported_seq":1456,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.587433+0000","last_change":"2024-09-15T12:25:19.429640+0000","last_active":"2024-09-15T12:27:10.587433+0000","last_peered":"2024-09-15T12:27:10.587433+0000","last_clean":"2024-09-15T12:27:10.587433+0000","last_became_active":"2024-09-15T12:25:19.422585+0000","last_became_peered":"2024-09-15T12:25:19.422585+0000","last_unstale":"2024-09-15T12:27:10.587433+0000","last_undegraded":"2024-09-15T12:27:10.587433+0000","last_fullsized":"2024-09-15T12:27:10.587433+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1384,"log_dups_size":0,"ondisk_log_size":1384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57278464,"num_objects":874,"num_object_clones":0,"num_object_copies":2622,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1384,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.285548+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:26:38.285548+0000","last_peered":"2024-09-15T12:26:38.285548+0000","last_clean":"2024-09-15T12:26:38.285548+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:26:38.285548+0000","last_undegraded":"2024-09-15T12:26:38.285548+0000","last_fullsized":"2024-09-15T12:26:38.285548+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"78'1360","reported_seq":1432,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:11.762638+0000","last_change":"2024-09-15T12:25:19.429532+0000","last_active":"2024-09-15T12:27:11.762638+0000","last_peered":"2024-09-15T12:27:11.762638+0000","last_clean":"2024-09-15T12:27:11.762638+0000","last_became_active":"2024-09-15T12:25:19.424570+0000","last_became_peered":"2024-09-15T12:25:19.424570+0000","last_unstale":"2024-09-15T12:27:11.762638+0000","last_undegraded":"2024-09-15T12:27:11.762638+0000","last_fullsized":"2024-09-15T12:27:11.762638+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1360,"log_dups_size":0,"ondisk_log_size":1360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57802752,"num_objects":882,"num_object_clones":0,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1360,"num_write_kb":71744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.331592+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:26:38.331592+0000","last_peered":"2024-09-15T12:26:38.331592+0000","last_clean":"2024-09-15T12:26:38.331592+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:26:38.331592+0000","last_undegraded":"2024-09-15T12:26:38.331592+0000","last_fullsized":"2024-09-15T12:26:38.331592+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"78'1326","reported_seq":1398,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.525567+0000","last_change":"2024-09-15T12:25:19.453184+0000","last_active":"2024-09-15T12:27:10.525567+0000","last_peered":"2024-09-15T12:27:10.525567+0000","last_clean":"2024-09-15T12:27:10.525567+0000","last_became_active":"2024-09-15T12:25:19.441520+0000","last_became_peered":"2024-09-15T12:25:19.441520+0000","last_unstale":"2024-09-15T12:27:10.525567+0000","last_undegraded":"2024-09-15T12:27:10.525567+0000","last_fullsized":"2024-09-15T12:27:10.525567+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1326,"log_dups_size":0,"ondisk_log_size":1326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":832,"num_object_clones":0,"num_object_copies":2496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1326,"num_write_kb":69056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.305972+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:26:38.305972+0000","last_peered":"2024-09-15T12:26:38.305972+0000","last_clean":"2024-09-15T12:26:38.305972+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:26:38.305972+0000","last_undegraded":"2024-09-15T12:26:38.305972+0000","last_fullsized":"2024-09-15T12:26:38.305972+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":900530200,"num_objects":13742,"num_object_clones":0,"num_object_copies":41226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":21292,"num_write_kb":1121025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":168640512,"data_stored":2698051656,"data_compressed":128117925,"data_compressed_allocated":168628224,"data_compressed_original":2698051584,"omap_allocated":0,"internal_metadata":0},"log_size":21292,"ondisk_log_size":21292,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673468,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123532,"kb_used_data":38396,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94248308,"statfs":{"total":96636764160,"available":96510267392,"internally_reserved":0,"allocated":39317504,"data_stored":618444977,"data_compressed":29357519,"data_compressed_allocated":38641664,"data_compressed_original":618184704,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":130512,"kb_used_data":49532,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94241328,"statfs":{"total":96636764160,"available":96503119872,"internally_reserved":0,"allocated":50720768,"data_stored":800831684,"data_compressed":38018215,"data_compressed_allocated":50040832,"data_compressed_original":800571392,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":124456,"kb_used_data":35160,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94247384,"statfs":{"total":96636764160,"available":96509321216,"internally_reserved":0,"allocated":36003840,"data_stored":565819020,"data_compressed":26856560,"data_compressed_allocated":35348480,"data_compressed_original":565575680,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":135404,"kb_used_data":46108,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94236436,"statfs":{"total":96636764160,"available":96498110464,"internally_reserved":0,"allocated":47214592,"data_stored":744732868,"data_compressed":35354343,"data_compressed_allocated":46534656,"data_compressed_original":744472576,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46010368,"data_stored":736100376,"data_compressed":34953983,"data_compressed_allocated":46006272,"data_compressed_original":736100352,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":34979840,"data_stored":559677440,"data_compressed":26576480,"data_compressed_allocated":34979840,"data_compressed_original":559677440,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49451008,"data_stored":791150616,"data_compressed":37568063,"data_compressed_allocated":49446912,"data_compressed_original":791150592,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":38199296,"data_stored":611123224,"data_compressed":29019399,"data_compressed_allocated":38195200,"data_compressed_original":611123200,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:27:29.967 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:27:30.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:30.100+0000 7fc627391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:30.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:30.107+0000 7fc627391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:32.359 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:27:32.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:32.508+0000 7f5d89151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:32.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:32.515+0000 7f5d89151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:33.066 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:27:33.066 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:27:33.066 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:27:33.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:33.204+0000 7fc53409c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:33.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:33.214+0000 7fc53409c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:33.533 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:27:33.533 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:27:33.548 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":336,"stamp":"2024-09-15T12:27:31.807473+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":901120587,"num_objects":13746,"num_object_clones":0,"num_object_copies":41238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":21373,"num_write_kb":1122133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21347,"ondisk_log_size":21347,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":513904,"kb_used_data":169196,"kb_used_omap":0,"kb_used_meta":344640,"kb_avail":376973456,"statfs":{"total":386547056640,"available":386020818944,"internally_reserved":0,"allocated":173256704,"data_stored":2729828549,"data_compressed":129586637,"data_compressed_allocated":170565632,"data_compressed_original":2728804352,"omap_allocated":0,"internal_metadata":352911360},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002391"},"pg_stats":[{"pgid":"5.f","version":"78'1326","reported_seq":1398,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.635529+0000","last_change":"2024-09-15T12:25:19.440663+0000","last_active":"2024-09-15T12:27:10.635529+0000","last_peered":"2024-09-15T12:27:10.635529+0000","last_clean":"2024-09-15T12:27:10.635529+0000","last_became_active":"2024-09-15T12:25:19.421824+0000","last_became_peered":"2024-09-15T12:25:19.421824+0000","last_unstale":"2024-09-15T12:27:10.635529+0000","last_undegraded":"2024-09-15T12:27:10.635529+0000","last_fullsized":"2024-09-15T12:27:10.635529+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1326,"log_dups_size":0,"ondisk_log_size":1326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58064896,"num_objects":886,"num_object_clones":0,"num_object_copies":2658,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1326,"num_write_kb":70784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"78'1272","reported_seq":1344,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.708893+0000","last_change":"2024-09-15T12:25:19.444566+0000","last_active":"2024-09-15T12:27:10.708893+0000","last_peered":"2024-09-15T12:27:10.708893+0000","last_clean":"2024-09-15T12:27:10.708893+0000","last_became_active":"2024-09-15T12:25:19.436490+0000","last_became_peered":"2024-09-15T12:25:19.436490+0000","last_unstale":"2024-09-15T12:27:10.708893+0000","last_undegraded":"2024-09-15T12:27:10.708893+0000","last_fullsized":"2024-09-15T12:27:10.708893+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1272,"log_dups_size":0,"ondisk_log_size":1272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53739520,"num_objects":820,"num_object_clones":0,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1272,"num_write_kb":66944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"78'1317","reported_seq":1390,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.653665+0000","last_change":"2024-09-15T12:25:19.466585+0000","last_active":"2024-09-15T12:27:10.653665+0000","last_peered":"2024-09-15T12:27:10.653665+0000","last_clean":"2024-09-15T12:27:10.653665+0000","last_became_active":"2024-09-15T12:25:19.449036+0000","last_became_peered":"2024-09-15T12:25:19.449036+0000","last_unstale":"2024-09-15T12:27:10.653665+0000","last_undegraded":"2024-09-15T12:27:10.653665+0000","last_fullsized":"2024-09-15T12:27:10.653665+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1317,"log_dups_size":0,"ondisk_log_size":1317,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57802776,"num_objects":883,"num_object_clones":0,"num_object_copies":2649,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1317,"num_write_kb":70337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"78'1407","reported_seq":1479,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:11.644676+0000","last_change":"2024-09-15T12:25:19.412052+0000","last_active":"2024-09-15T12:27:11.644676+0000","last_peered":"2024-09-15T12:27:11.644676+0000","last_clean":"2024-09-15T12:27:11.644676+0000","last_became_active":"2024-09-15T12:25:19.396072+0000","last_became_peered":"2024-09-15T12:25:19.396072+0000","last_unstale":"2024-09-15T12:27:11.644676+0000","last_undegraded":"2024-09-15T12:27:11.644676+0000","last_fullsized":"2024-09-15T12:27:11.644676+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1407,"log_dups_size":0,"ondisk_log_size":1407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55508992,"num_objects":847,"num_object_clones":0,"num_object_copies":2541,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1407,"num_write_kb":72128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"78'1272","reported_seq":1344,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.547902+0000","last_change":"2024-09-15T12:25:19.447319+0000","last_active":"2024-09-15T12:27:10.547902+0000","last_peered":"2024-09-15T12:27:10.547902+0000","last_clean":"2024-09-15T12:27:10.547902+0000","last_became_active":"2024-09-15T12:25:19.436362+0000","last_became_peered":"2024-09-15T12:25:19.436362+0000","last_unstale":"2024-09-15T12:27:10.547902+0000","last_undegraded":"2024-09-15T12:27:10.547902+0000","last_fullsized":"2024-09-15T12:27:10.547902+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1272,"log_dups_size":0,"ondisk_log_size":1272,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54001664,"num_objects":824,"num_object_clones":0,"num_object_copies":2472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1272,"num_write_kb":67072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"78'1347","reported_seq":1419,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.587008+0000","last_change":"2024-09-15T12:25:19.475504+0000","last_active":"2024-09-15T12:27:10.587008+0000","last_peered":"2024-09-15T12:27:10.587008+0000","last_clean":"2024-09-15T12:27:10.587008+0000","last_became_active":"2024-09-15T12:25:19.467940+0000","last_became_peered":"2024-09-15T12:25:19.467940+0000","last_unstale":"2024-09-15T12:27:10.587008+0000","last_undegraded":"2024-09-15T12:27:10.587008+0000","last_fullsized":"2024-09-15T12:27:10.587008+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1347,"log_dups_size":0,"ondisk_log_size":1347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55377920,"num_objects":845,"num_object_clones":0,"num_object_copies":2535,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1347,"num_write_kb":70144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"78'1313","reported_seq":1385,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.581198+0000","last_change":"2024-09-15T12:25:19.403222+0000","last_active":"2024-09-15T12:27:10.581198+0000","last_peered":"2024-09-15T12:27:10.581198+0000","last_clean":"2024-09-15T12:27:10.581198+0000","last_became_active":"2024-09-15T12:25:19.396442+0000","last_became_peered":"2024-09-15T12:25:19.396442+0000","last_unstale":"2024-09-15T12:27:10.581198+0000","last_undegraded":"2024-09-15T12:27:10.581198+0000","last_fullsized":"2024-09-15T12:27:10.581198+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1313,"log_dups_size":0,"ondisk_log_size":1313,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57475072,"num_objects":877,"num_object_clones":0,"num_object_copies":2631,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1313,"num_write_kb":70080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"78'1320","reported_seq":1392,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.401853+0000","last_change":"2024-09-15T12:25:19.418093+0000","last_active":"2024-09-15T12:27:10.401853+0000","last_peered":"2024-09-15T12:27:10.401853+0000","last_clean":"2024-09-15T12:27:10.401853+0000","last_became_active":"2024-09-15T12:25:19.412762+0000","last_became_peered":"2024-09-15T12:25:19.412762+0000","last_unstale":"2024-09-15T12:27:10.401853+0000","last_undegraded":"2024-09-15T12:27:10.401853+0000","last_fullsized":"2024-09-15T12:27:10.401853+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1320,"log_dups_size":0,"ondisk_log_size":1320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57147392,"num_objects":872,"num_object_clones":0,"num_object_copies":2616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1320,"num_write_kb":70144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"78'1314","reported_seq":1386,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.578347+0000","last_change":"2024-09-15T12:25:19.514099+0000","last_active":"2024-09-15T12:27:10.578347+0000","last_peered":"2024-09-15T12:27:10.578347+0000","last_clean":"2024-09-15T12:27:10.578347+0000","last_became_active":"2024-09-15T12:25:19.506892+0000","last_became_peered":"2024-09-15T12:25:19.506892+0000","last_unstale":"2024-09-15T12:27:10.578347+0000","last_undegraded":"2024-09-15T12:27:10.578347+0000","last_fullsized":"2024-09-15T12:27:10.578347+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1314,"log_dups_size":0,"ondisk_log_size":1314,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54657024,"num_objects":834,"num_object_clones":0,"num_object_copies":2502,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1314,"num_write_kb":68736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":277,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.283839+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:26:38.283839+0000","last_peered":"2024-09-15T12:26:38.283839+0000","last_clean":"2024-09-15T12:26:38.283839+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:26:38.283839+0000","last_undegraded":"2024-09-15T12:26:38.283839+0000","last_fullsized":"2024-09-15T12:26:38.283839+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":206,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.307035+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:26:38.307035+0000","last_peered":"2024-09-15T12:26:38.307035+0000","last_clean":"2024-09-15T12:26:38.307035+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:26:38.307035+0000","last_undegraded":"2024-09-15T12:26:38.307035+0000","last_fullsized":"2024-09-15T12:26:38.307035+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"78'1352","reported_seq":1424,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.729120+0000","last_change":"2024-09-15T12:25:19.470256+0000","last_active":"2024-09-15T12:27:10.729120+0000","last_peered":"2024-09-15T12:27:10.729120+0000","last_clean":"2024-09-15T12:27:10.729120+0000","last_became_active":"2024-09-15T12:25:19.458317+0000","last_became_peered":"2024-09-15T12:25:19.458317+0000","last_unstale":"2024-09-15T12:27:10.729120+0000","last_undegraded":"2024-09-15T12:27:10.729120+0000","last_fullsized":"2024-09-15T12:27:10.729120+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1352,"log_dups_size":0,"ondisk_log_size":1352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":896,"num_object_clones":0,"num_object_copies":2688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1352,"num_write_kb":71936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.297600+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:26:38.297600+0000","last_peered":"2024-09-15T12:26:38.297600+0000","last_clean":"2024-09-15T12:26:38.297600+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:26:38.297600+0000","last_undegraded":"2024-09-15T12:26:38.297600+0000","last_fullsized":"2024-09-15T12:26:38.297600+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"78'1315","reported_seq":1387,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.675717+0000","last_change":"2024-09-15T12:25:19.478666+0000","last_active":"2024-09-15T12:27:10.675717+0000","last_peered":"2024-09-15T12:27:10.675717+0000","last_clean":"2024-09-15T12:27:10.675717+0000","last_became_active":"2024-09-15T12:25:19.468663+0000","last_became_peered":"2024-09-15T12:25:19.468663+0000","last_unstale":"2024-09-15T12:27:10.675717+0000","last_undegraded":"2024-09-15T12:27:10.675717+0000","last_fullsized":"2024-09-15T12:27:10.675717+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1315,"log_dups_size":0,"ondisk_log_size":1315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58916864,"num_objects":899,"num_object_clones":0,"num_object_copies":2697,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1315,"num_write_kb":70848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.300626+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:26:38.300626+0000","last_peered":"2024-09-15T12:26:38.300626+0000","last_clean":"2024-09-15T12:26:38.300626+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:26:38.300626+0000","last_undegraded":"2024-09-15T12:26:38.300626+0000","last_fullsized":"2024-09-15T12:26:38.300626+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"78'1345","reported_seq":1417,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.566936+0000","last_change":"2024-09-15T12:25:19.499536+0000","last_active":"2024-09-15T12:27:10.566936+0000","last_peered":"2024-09-15T12:27:10.566936+0000","last_clean":"2024-09-15T12:27:10.566936+0000","last_became_active":"2024-09-15T12:25:19.493017+0000","last_became_peered":"2024-09-15T12:25:19.493017+0000","last_unstale":"2024-09-15T12:27:10.566936+0000","last_undegraded":"2024-09-15T12:27:10.566936+0000","last_fullsized":"2024-09-15T12:27:10.566936+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1345,"log_dups_size":0,"ondisk_log_size":1345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55771136,"num_objects":851,"num_object_clones":0,"num_object_copies":2553,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1345,"num_write_kb":70272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":207,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.292803+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:26:38.292803+0000","last_peered":"2024-09-15T12:26:38.292803+0000","last_clean":"2024-09-15T12:26:38.292803+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:26:38.292803+0000","last_undegraded":"2024-09-15T12:26:38.292803+0000","last_fullsized":"2024-09-15T12:26:38.292803+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"78'1322","reported_seq":1394,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.597394+0000","last_change":"2024-09-15T12:25:19.413209+0000","last_active":"2024-09-15T12:27:10.597394+0000","last_peered":"2024-09-15T12:27:10.597394+0000","last_clean":"2024-09-15T12:27:10.597394+0000","last_became_active":"2024-09-15T12:25:19.403123+0000","last_became_peered":"2024-09-15T12:25:19.403123+0000","last_unstale":"2024-09-15T12:27:10.597394+0000","last_undegraded":"2024-09-15T12:27:10.597394+0000","last_fullsized":"2024-09-15T12:27:10.597394+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1322,"log_dups_size":0,"ondisk_log_size":1322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53739520,"num_objects":820,"num_object_clones":0,"num_object_copies":2460,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1322,"num_write_kb":68544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.343877+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:26:38.343877+0000","last_peered":"2024-09-15T12:26:38.343877+0000","last_clean":"2024-09-15T12:26:38.343877+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:26:38.343877+0000","last_undegraded":"2024-09-15T12:26:38.343877+0000","last_fullsized":"2024-09-15T12:26:38.343877+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"78'1384","reported_seq":1456,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.587433+0000","last_change":"2024-09-15T12:25:19.429640+0000","last_active":"2024-09-15T12:27:10.587433+0000","last_peered":"2024-09-15T12:27:10.587433+0000","last_clean":"2024-09-15T12:27:10.587433+0000","last_became_active":"2024-09-15T12:25:19.422585+0000","last_became_peered":"2024-09-15T12:25:19.422585+0000","last_unstale":"2024-09-15T12:27:10.587433+0000","last_undegraded":"2024-09-15T12:27:10.587433+0000","last_fullsized":"2024-09-15T12:27:10.587433+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1384,"log_dups_size":0,"ondisk_log_size":1384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57278464,"num_objects":874,"num_object_clones":0,"num_object_copies":2622,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1384,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.285548+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:26:38.285548+0000","last_peered":"2024-09-15T12:26:38.285548+0000","last_clean":"2024-09-15T12:26:38.285548+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:26:38.285548+0000","last_undegraded":"2024-09-15T12:26:38.285548+0000","last_fullsized":"2024-09-15T12:26:38.285548+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"78'1360","reported_seq":1432,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:11.762638+0000","last_change":"2024-09-15T12:25:19.429532+0000","last_active":"2024-09-15T12:27:11.762638+0000","last_peered":"2024-09-15T12:27:11.762638+0000","last_clean":"2024-09-15T12:27:11.762638+0000","last_became_active":"2024-09-15T12:25:19.424570+0000","last_became_peered":"2024-09-15T12:25:19.424570+0000","last_unstale":"2024-09-15T12:27:11.762638+0000","last_undegraded":"2024-09-15T12:27:11.762638+0000","last_fullsized":"2024-09-15T12:27:11.762638+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1360,"log_dups_size":0,"ondisk_log_size":1360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57802752,"num_objects":882,"num_object_clones":0,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1360,"num_write_kb":71744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.331592+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:26:38.331592+0000","last_peered":"2024-09-15T12:26:38.331592+0000","last_clean":"2024-09-15T12:26:38.331592+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:26:38.331592+0000","last_undegraded":"2024-09-15T12:26:38.331592+0000","last_fullsized":"2024-09-15T12:26:38.331592+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"78'1326","reported_seq":1398,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:10.525567+0000","last_change":"2024-09-15T12:25:19.453184+0000","last_active":"2024-09-15T12:27:10.525567+0000","last_peered":"2024-09-15T12:27:10.525567+0000","last_clean":"2024-09-15T12:27:10.525567+0000","last_became_active":"2024-09-15T12:25:19.441520+0000","last_became_peered":"2024-09-15T12:25:19.441520+0000","last_unstale":"2024-09-15T12:27:10.525567+0000","last_undegraded":"2024-09-15T12:27:10.525567+0000","last_fullsized":"2024-09-15T12:27:10.525567+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1326,"log_dups_size":0,"ondisk_log_size":1326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":832,"num_object_clones":0,"num_object_copies":2496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1326,"num_write_kb":69056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.305972+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:26:38.305972+0000","last_peered":"2024-09-15T12:26:38.305972+0000","last_clean":"2024-09-15T12:26:38.305972+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:26:38.305972+0000","last_undegraded":"2024-09-15T12:26:38.305972+0000","last_fullsized":"2024-09-15T12:26:38.305972+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":900530200,"num_objects":13742,"num_object_clones":0,"num_object_copies":41226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":21292,"num_write_kb":1121025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":168640512,"data_stored":2698051656,"data_compressed":128117925,"data_compressed_allocated":168628224,"data_compressed_original":2698051584,"omap_allocated":0,"internal_metadata":0},"log_size":21292,"ondisk_log_size":21292,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673468,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":123532,"kb_used_data":38396,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94248308,"statfs":{"total":96636764160,"available":96510267392,"internally_reserved":0,"allocated":39317504,"data_stored":618444977,"data_compressed":29357519,"data_compressed_allocated":38641664,"data_compressed_original":618184704,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":130512,"kb_used_data":49532,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94241328,"statfs":{"total":96636764160,"available":96503119872,"internally_reserved":0,"allocated":50720768,"data_stored":800831684,"data_compressed":38018215,"data_compressed_allocated":50040832,"data_compressed_original":800571392,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":124456,"kb_used_data":35160,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94247384,"statfs":{"total":96636764160,"available":96509321216,"internally_reserved":0,"allocated":36003840,"data_stored":565819020,"data_compressed":26856560,"data_compressed_allocated":35348480,"data_compressed_original":565575680,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":135404,"kb_used_data":46108,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94236436,"statfs":{"total":96636764160,"available":96498110464,"internally_reserved":0,"allocated":47214592,"data_stored":744732868,"data_compressed":35354343,"data_compressed_allocated":46534656,"data_compressed_original":744472576,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46010368,"data_stored":736100376,"data_compressed":34953983,"data_compressed_allocated":46006272,"data_compressed_original":736100352,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":34979840,"data_stored":559677440,"data_compressed":26576480,"data_compressed_allocated":34979840,"data_compressed_original":559677440,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49451008,"data_stored":791150616,"data_compressed":37568063,"data_compressed_allocated":49446912,"data_compressed_original":791150592,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":38199296,"data_stored":611123224,"data_compressed":29019399,"data_compressed_allocated":38195200,"data_compressed_original":611123200,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:27:34.787 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:27:34.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:34.924+0000 7f25d2791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:34.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:34.931+0000 7f25d2791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:37.255 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:27:37.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:37.393+0000 7f83c9311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:37.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:37.400+0000 7f83c9311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:38.550 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:27:38.551 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:27:38.551 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:27:38.551 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:27:38.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:38.699+0000 7fe7b3a57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:38.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:38.712+0000 7fe7b3a57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:38.746 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:27:38.746 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:27:38.746 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:27:38.746 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:27:38.746 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:27:38.746 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:27:38.746 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:27:38.747 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:27:38.747 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:27:38.747 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:27:38.747 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:27:38.747 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:27:38.753 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:27:38.754 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:27:38.754 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:27:38.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:38.917+0000 7ff061351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:38.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:38.935+0000 7ff061351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:39.057 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:27:39.057 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:27:39.057 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:27:39.057 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:27:39.057 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:27:39.058 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:27:39.058 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:27:39.058 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:27:39.058 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:27:39.058 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:27:39.058 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:27:39.058 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:27:39.060 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:27:39.060 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:27:39.061 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:27:39.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:39.214+0000 7f3d85d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:39.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:39.224+0000 7f3d85d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:39.259 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:27:39.259 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:27:39.259 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:27:39.259 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:27:39.260 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:27:39.260 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:27:39.260 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:27:39.260 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:27:39.260 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:27:39.260 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:27:39.260 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:27:39.260 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:27:39.263 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:27:39.264 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:27:39.264 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:27:39.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:39.422+0000 7f83a88d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:39.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:39.437+0000 7f83a88d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:39.479 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:27:39.479 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:27:39.479 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:27:39.479 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:27:39.479 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:27:39.479 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:27:39.479 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:27:39.479 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:27:39.479 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:27:39.479 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:27:39.480 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:27:39.480 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:27:39.481 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:27:39.482 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:27:39.667 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:27:39.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:39.807+0000 7ffa9ed91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:39.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:39.815+0000 7ffa9ed91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:42.075 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:27:42.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:42.224+0000 7fcfd8cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:42.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:42.232+0000 7fcfd8cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:44.468 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:27:44.483 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:27:44.483 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:27:44.483 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:27:44.483 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:27:44.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:44.639+0000 7f191c0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:44.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:44.649+0000 7f191c0d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:44.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:44.681+0000 7fa1f1111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:44.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:44.699+0000 7fa1f1111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:44.908 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:27:44.908 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:27:44.909 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:27:44.909 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:27:44.909 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:27:44.909 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:27:44.909 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:27:44.909 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:27:44.909 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:27:44.909 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:27:44.909 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:27:44.909 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:27:44.912 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:27:44.913 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:27:44.913 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:27:45.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:45.046+0000 7f88ffb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:45.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:45.063+0000 7f88ffb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:45.141 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:27:45.141 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:27:45.141 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:27:45.141 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:27:45.141 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:27:45.141 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:27:45.141 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:27:45.141 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:27:45.141 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:27:45.142 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:27:45.142 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:27:45.142 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:27:45.145 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:27:45.145 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:27:45.146 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:27:45.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:45.336+0000 7f8618874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:45.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:45.353+0000 7f8618874640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:45.378 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:27:45.379 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:27:45.379 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:27:45.379 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:27:45.379 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:27:45.379 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:27:45.379 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:27:45.379 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:27:45.379 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:27:45.379 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:27:45.379 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:27:45.379 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:27:45.384 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:27:45.384 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:27:45.384 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:27:45.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:45.532+0000 7f0745591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:45.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:45.549+0000 7f0745591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:45.579 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:27:45.579 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:27:45.579 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:27:45.579 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:27:45.579 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:27:45.579 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:27:45.579 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:27:45.579 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:27:45.579 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:27:45.579 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:27:45.580 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:27:45.580 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:27:45.585 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:27:45.585 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:27:47.122 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:27:47.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:47.266+0000 7f67ee67d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:47.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:47.275+0000 7f67ee67d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:49.667 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:27:49.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:49.819+0000 7fecd0ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:49.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:49.830+0000 7fecd0ebd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:50.586 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:27:50.587 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:27:50.587 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:27:50.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:50.714+0000 7fbb37391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:50.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:50.726+0000 7fbb37391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:51.057 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:27:51.057 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:27:51.078 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":345,"stamp":"2024-09-15T12:27:49.811430+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":551486027,"num_objects":8411,"num_object_clones":0,"num_object_copies":25233,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":26708,"num_write_kb":1122133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26682,"ondisk_log_size":26682,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":467852,"kb_used_data":105096,"kb_used_omap":0,"kb_used_meta":362688,"kb_avail":377019508,"statfs":{"total":386547056640,"available":386067976192,"internally_reserved":0,"allocated":107618304,"data_stored":1679614149,"data_compressed":79716837,"data_compressed_allocated":104927232,"data_compressed_original":1678589952,"omap_allocated":0,"internal_metadata":371392512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-349634560,"num_objects":-5335,"num_object_clones":0,"num_object_copies":-16005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5335,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002659"},"pg_stats":[{"pgid":"5.f","version":"78'1682","reported_seq":1754,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:40.470146+0000","last_change":"2024-09-15T12:25:19.440663+0000","last_active":"2024-09-15T12:27:40.470146+0000","last_peered":"2024-09-15T12:27:40.470146+0000","last_clean":"2024-09-15T12:27:40.470146+0000","last_became_active":"2024-09-15T12:25:19.421824+0000","last_became_peered":"2024-09-15T12:25:19.421824+0000","last_unstale":"2024-09-15T12:27:40.470146+0000","last_undegraded":"2024-09-15T12:27:40.470146+0000","last_fullsized":"2024-09-15T12:27:40.470146+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1682,"log_dups_size":0,"ondisk_log_size":1682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34734080,"num_objects":530,"num_object_clones":0,"num_object_copies":1590,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1682,"num_write_kb":70784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"78'1598","reported_seq":1670,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:40.727705+0000","last_change":"2024-09-15T12:25:19.444566+0000","last_active":"2024-09-15T12:27:40.727705+0000","last_peered":"2024-09-15T12:27:40.727705+0000","last_clean":"2024-09-15T12:27:40.727705+0000","last_became_active":"2024-09-15T12:25:19.436490+0000","last_became_peered":"2024-09-15T12:25:19.436490+0000","last_unstale":"2024-09-15T12:27:40.727705+0000","last_undegraded":"2024-09-15T12:27:40.727705+0000","last_fullsized":"2024-09-15T12:27:40.727705+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1598,"log_dups_size":0,"ondisk_log_size":1598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32374784,"num_objects":494,"num_object_clones":0,"num_object_copies":1482,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1598,"num_write_kb":66944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"78'1658","reported_seq":1731,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:40.633388+0000","last_change":"2024-09-15T12:25:19.466585+0000","last_active":"2024-09-15T12:27:40.633388+0000","last_peered":"2024-09-15T12:27:40.633388+0000","last_clean":"2024-09-15T12:27:40.633388+0000","last_became_active":"2024-09-15T12:25:19.449036+0000","last_became_peered":"2024-09-15T12:25:19.449036+0000","last_unstale":"2024-09-15T12:27:40.633388+0000","last_undegraded":"2024-09-15T12:27:40.633388+0000","last_fullsized":"2024-09-15T12:27:40.633388+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1658,"log_dups_size":0,"ondisk_log_size":1658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35455000,"num_objects":542,"num_object_clones":0,"num_object_copies":1626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1658,"num_write_kb":70337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"78'1759","reported_seq":1831,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:41.548411+0000","last_change":"2024-09-15T12:25:19.412052+0000","last_active":"2024-09-15T12:27:41.548411+0000","last_peered":"2024-09-15T12:27:41.548411+0000","last_clean":"2024-09-15T12:27:41.548411+0000","last_became_active":"2024-09-15T12:25:19.396072+0000","last_became_peered":"2024-09-15T12:25:19.396072+0000","last_unstale":"2024-09-15T12:27:41.548411+0000","last_undegraded":"2024-09-15T12:27:41.548411+0000","last_fullsized":"2024-09-15T12:27:41.548411+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1759,"log_dups_size":0,"ondisk_log_size":1759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32440320,"num_objects":495,"num_object_clones":0,"num_object_copies":1485,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1759,"num_write_kb":72128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"78'1596","reported_seq":1668,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:40.622227+0000","last_change":"2024-09-15T12:25:19.447319+0000","last_active":"2024-09-15T12:27:40.622227+0000","last_peered":"2024-09-15T12:27:40.622227+0000","last_clean":"2024-09-15T12:27:40.622227+0000","last_became_active":"2024-09-15T12:25:19.436362+0000","last_became_peered":"2024-09-15T12:25:19.436362+0000","last_unstale":"2024-09-15T12:27:40.622227+0000","last_undegraded":"2024-09-15T12:27:40.622227+0000","last_fullsized":"2024-09-15T12:27:40.622227+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1596,"log_dups_size":0,"ondisk_log_size":1596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32768000,"num_objects":500,"num_object_clones":0,"num_object_copies":1500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1596,"num_write_kb":67072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"78'1669","reported_seq":1741,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:40.283368+0000","last_change":"2024-09-15T12:25:19.475504+0000","last_active":"2024-09-15T12:27:40.283368+0000","last_peered":"2024-09-15T12:27:40.283368+0000","last_clean":"2024-09-15T12:27:40.283368+0000","last_became_active":"2024-09-15T12:25:19.467940+0000","last_became_peered":"2024-09-15T12:25:19.467940+0000","last_unstale":"2024-09-15T12:27:40.283368+0000","last_undegraded":"2024-09-15T12:27:40.283368+0000","last_fullsized":"2024-09-15T12:27:40.283368+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1669,"log_dups_size":0,"ondisk_log_size":1669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34275328,"num_objects":523,"num_object_clones":0,"num_object_copies":1569,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1669,"num_write_kb":70144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"78'1640","reported_seq":1712,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:40.666945+0000","last_change":"2024-09-15T12:25:19.403222+0000","last_active":"2024-09-15T12:27:40.666945+0000","last_peered":"2024-09-15T12:27:40.666945+0000","last_clean":"2024-09-15T12:27:40.666945+0000","last_became_active":"2024-09-15T12:25:19.396442+0000","last_became_peered":"2024-09-15T12:25:19.396442+0000","last_unstale":"2024-09-15T12:27:40.666945+0000","last_undegraded":"2024-09-15T12:27:40.666945+0000","last_fullsized":"2024-09-15T12:27:40.666945+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1640,"log_dups_size":0,"ondisk_log_size":1640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36044800,"num_objects":550,"num_object_clones":0,"num_object_copies":1650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1640,"num_write_kb":70080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"78'1682","reported_seq":1754,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:40.713353+0000","last_change":"2024-09-15T12:25:19.418093+0000","last_active":"2024-09-15T12:27:40.713353+0000","last_peered":"2024-09-15T12:27:40.713353+0000","last_clean":"2024-09-15T12:27:40.713353+0000","last_became_active":"2024-09-15T12:25:19.412762+0000","last_became_peered":"2024-09-15T12:25:19.412762+0000","last_unstale":"2024-09-15T12:27:40.713353+0000","last_undegraded":"2024-09-15T12:27:40.713353+0000","last_fullsized":"2024-09-15T12:27:40.713353+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1682,"log_dups_size":0,"ondisk_log_size":1682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33423360,"num_objects":510,"num_object_clones":0,"num_object_copies":1530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1682,"num_write_kb":70144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"78'1634","reported_seq":1706,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:40.425497+0000","last_change":"2024-09-15T12:25:19.514099+0000","last_active":"2024-09-15T12:27:40.425497+0000","last_peered":"2024-09-15T12:27:40.425497+0000","last_clean":"2024-09-15T12:27:40.425497+0000","last_became_active":"2024-09-15T12:25:19.506892+0000","last_became_peered":"2024-09-15T12:25:19.506892+0000","last_unstale":"2024-09-15T12:27:40.425497+0000","last_undegraded":"2024-09-15T12:27:40.425497+0000","last_fullsized":"2024-09-15T12:27:40.425497+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1634,"log_dups_size":0,"ondisk_log_size":1634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33685504,"num_objects":514,"num_object_clones":0,"num_object_copies":1542,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1634,"num_write_kb":68736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":277,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.283839+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:26:38.283839+0000","last_peered":"2024-09-15T12:26:38.283839+0000","last_clean":"2024-09-15T12:26:38.283839+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:26:38.283839+0000","last_undegraded":"2024-09-15T12:26:38.283839+0000","last_fullsized":"2024-09-15T12:26:38.283839+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":206,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.307035+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:26:38.307035+0000","last_peered":"2024-09-15T12:26:38.307035+0000","last_clean":"2024-09-15T12:26:38.307035+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:26:38.307035+0000","last_undegraded":"2024-09-15T12:26:38.307035+0000","last_fullsized":"2024-09-15T12:26:38.307035+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"78'1703","reported_seq":1775,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:40.621238+0000","last_change":"2024-09-15T12:25:19.470256+0000","last_active":"2024-09-15T12:27:40.621238+0000","last_peered":"2024-09-15T12:27:40.621238+0000","last_clean":"2024-09-15T12:27:40.621238+0000","last_became_active":"2024-09-15T12:25:19.458317+0000","last_became_peered":"2024-09-15T12:25:19.458317+0000","last_unstale":"2024-09-15T12:27:40.621238+0000","last_undegraded":"2024-09-15T12:27:40.621238+0000","last_fullsized":"2024-09-15T12:27:40.621238+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1703,"log_dups_size":0,"ondisk_log_size":1703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35717120,"num_objects":545,"num_object_clones":0,"num_object_copies":1635,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1703,"num_write_kb":71936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.297600+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:26:38.297600+0000","last_peered":"2024-09-15T12:26:38.297600+0000","last_clean":"2024-09-15T12:26:38.297600+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:26:38.297600+0000","last_undegraded":"2024-09-15T12:26:38.297600+0000","last_fullsized":"2024-09-15T12:26:38.297600+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"78'1673","reported_seq":1745,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:40.518313+0000","last_change":"2024-09-15T12:25:19.478666+0000","last_active":"2024-09-15T12:27:40.518313+0000","last_peered":"2024-09-15T12:27:40.518313+0000","last_clean":"2024-09-15T12:27:40.518313+0000","last_became_active":"2024-09-15T12:25:19.468663+0000","last_became_peered":"2024-09-15T12:25:19.468663+0000","last_unstale":"2024-09-15T12:27:40.518313+0000","last_undegraded":"2024-09-15T12:27:40.518313+0000","last_fullsized":"2024-09-15T12:27:40.518313+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1673,"log_dups_size":0,"ondisk_log_size":1673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35454976,"num_objects":541,"num_object_clones":0,"num_object_copies":1623,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1673,"num_write_kb":70848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.300626+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:26:38.300626+0000","last_peered":"2024-09-15T12:26:38.300626+0000","last_clean":"2024-09-15T12:26:38.300626+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:26:38.300626+0000","last_undegraded":"2024-09-15T12:26:38.300626+0000","last_fullsized":"2024-09-15T12:26:38.300626+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"78'1663","reported_seq":1735,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:40.513719+0000","last_change":"2024-09-15T12:25:19.499536+0000","last_active":"2024-09-15T12:27:40.513719+0000","last_peered":"2024-09-15T12:27:40.513719+0000","last_clean":"2024-09-15T12:27:40.513719+0000","last_became_active":"2024-09-15T12:25:19.493017+0000","last_became_peered":"2024-09-15T12:25:19.493017+0000","last_unstale":"2024-09-15T12:27:40.513719+0000","last_undegraded":"2024-09-15T12:27:40.513719+0000","last_fullsized":"2024-09-15T12:27:40.513719+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1663,"log_dups_size":0,"ondisk_log_size":1663,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34930688,"num_objects":533,"num_object_clones":0,"num_object_copies":1599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1663,"num_write_kb":70272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":207,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.292803+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:26:38.292803+0000","last_peered":"2024-09-15T12:26:38.292803+0000","last_clean":"2024-09-15T12:26:38.292803+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:26:38.292803+0000","last_undegraded":"2024-09-15T12:26:38.292803+0000","last_fullsized":"2024-09-15T12:26:38.292803+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"78'1624","reported_seq":1696,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:40.744689+0000","last_change":"2024-09-15T12:25:19.413209+0000","last_active":"2024-09-15T12:27:40.744689+0000","last_peered":"2024-09-15T12:27:40.744689+0000","last_clean":"2024-09-15T12:27:40.744689+0000","last_became_active":"2024-09-15T12:25:19.403123+0000","last_became_peered":"2024-09-15T12:25:19.403123+0000","last_unstale":"2024-09-15T12:27:40.744689+0000","last_undegraded":"2024-09-15T12:27:40.744689+0000","last_fullsized":"2024-09-15T12:27:40.744689+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1624,"log_dups_size":0,"ondisk_log_size":1624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33947648,"num_objects":518,"num_object_clones":0,"num_object_copies":1554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1624,"num_write_kb":68544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.343877+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:26:38.343877+0000","last_peered":"2024-09-15T12:26:38.343877+0000","last_clean":"2024-09-15T12:26:38.343877+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:26:38.343877+0000","last_undegraded":"2024-09-15T12:26:38.343877+0000","last_fullsized":"2024-09-15T12:26:38.343877+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"78'1734","reported_seq":1806,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:40.780845+0000","last_change":"2024-09-15T12:25:19.429640+0000","last_active":"2024-09-15T12:27:40.780845+0000","last_peered":"2024-09-15T12:27:40.780845+0000","last_clean":"2024-09-15T12:27:40.780845+0000","last_became_active":"2024-09-15T12:25:19.422585+0000","last_became_peered":"2024-09-15T12:25:19.422585+0000","last_unstale":"2024-09-15T12:27:40.780845+0000","last_undegraded":"2024-09-15T12:27:40.780845+0000","last_fullsized":"2024-09-15T12:27:40.780845+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1734,"log_dups_size":0,"ondisk_log_size":1734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34340864,"num_objects":524,"num_object_clones":0,"num_object_copies":1572,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1734,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.285548+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:26:38.285548+0000","last_peered":"2024-09-15T12:26:38.285548+0000","last_clean":"2024-09-15T12:26:38.285548+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:26:38.285548+0000","last_undegraded":"2024-09-15T12:26:38.285548+0000","last_fullsized":"2024-09-15T12:26:38.285548+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"78'1696","reported_seq":1768,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:41.796056+0000","last_change":"2024-09-15T12:25:19.429532+0000","last_active":"2024-09-15T12:27:41.796056+0000","last_peered":"2024-09-15T12:27:41.796056+0000","last_clean":"2024-09-15T12:27:41.796056+0000","last_became_active":"2024-09-15T12:25:19.424570+0000","last_became_peered":"2024-09-15T12:25:19.424570+0000","last_unstale":"2024-09-15T12:27:41.796056+0000","last_undegraded":"2024-09-15T12:27:41.796056+0000","last_fullsized":"2024-09-15T12:27:41.796056+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1696,"log_dups_size":0,"ondisk_log_size":1696,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35782656,"num_objects":546,"num_object_clones":0,"num_object_copies":1638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1696,"num_write_kb":71744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.331592+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:26:38.331592+0000","last_peered":"2024-09-15T12:26:38.331592+0000","last_clean":"2024-09-15T12:26:38.331592+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:26:38.331592+0000","last_undegraded":"2024-09-15T12:26:38.331592+0000","last_fullsized":"2024-09-15T12:26:38.331592+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"78'1616","reported_seq":1688,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:27:40.610536+0000","last_change":"2024-09-15T12:25:19.453184+0000","last_active":"2024-09-15T12:27:40.610536+0000","last_peered":"2024-09-15T12:27:40.610536+0000","last_clean":"2024-09-15T12:27:40.610536+0000","last_became_active":"2024-09-15T12:25:19.441520+0000","last_became_peered":"2024-09-15T12:25:19.441520+0000","last_unstale":"2024-09-15T12:27:40.610536+0000","last_undegraded":"2024-09-15T12:27:40.610536+0000","last_fullsized":"2024-09-15T12:27:40.610536+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1616,"log_dups_size":0,"ondisk_log_size":1616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35520512,"num_objects":542,"num_object_clones":0,"num_object_copies":1626,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1616,"num_write_kb":69056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.305972+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:26:38.305972+0000","last_peered":"2024-09-15T12:26:38.305972+0000","last_clean":"2024-09-15T12:26:38.305972+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:26:38.305972+0000","last_undegraded":"2024-09-15T12:26:38.305972+0000","last_fullsized":"2024-09-15T12:26:38.305972+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":550895640,"num_objects":8407,"num_object_clones":0,"num_object_copies":25221,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":26627,"num_write_kb":1121025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":103129088,"data_stored":1649868872,"data_compressed":78344597,"data_compressed_allocated":103116800,"data_compressed_original":1649868800,"omap_allocated":0,"internal_metadata":0},"log_size":26627,"ondisk_log_size":26627,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673498,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":122676,"kb_used_data":23652,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94249164,"statfs":{"total":96636764160,"available":96511143936,"internally_reserved":0,"allocated":24219648,"data_stored":376879281,"data_compressed":17886687,"data_compressed_allocated":23543808,"data_compressed_original":376619008,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706202,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":115980,"kb_used_data":30844,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94255860,"statfs":{"total":96636764160,"available":96518000640,"internally_reserved":0,"allocated":31584256,"data_stored":494647492,"data_compressed":23478951,"data_compressed_allocated":30904320,"data_compressed_original":494387200,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706202,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":111312,"kb_used_data":22012,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94260528,"statfs":{"total":96636764160,"available":96522780672,"internally_reserved":0,"allocated":22540288,"data_stored":350402188,"data_compressed":16627416,"data_compressed_allocated":21884928,"data_compressed_original":350158848,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706202,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":117884,"kb_used_data":28588,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94253956,"statfs":{"total":96636764160,"available":96516050944,"internally_reserved":0,"allocated":29274112,"data_stored":457685188,"data_compressed":21723783,"data_compressed_allocated":28594176,"data_compressed_original":457424896,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28147712,"data_stored":450297880,"data_compressed":21382551,"data_compressed_allocated":28143616,"data_compressed_original":450297856,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21479424,"data_stored":343670784,"data_compressed":16319328,"data_compressed_allocated":21479424,"data_compressed_original":343670784,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":30347264,"data_stored":485490712,"data_compressed":23053695,"data_compressed_allocated":30343168,"data_compressed_original":485490688,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":23154688,"data_stored":370409496,"data_compressed":17589023,"data_compressed_allocated":23150592,"data_compressed_original":370409472,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:27:52.128 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:27:52.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:52.280+0000 7f27f6274640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:52.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:52.288+0000 7f27f6274640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:54.620 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:27:54.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:54.780+0000 7fdb8b191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:54.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:54.786+0000 7fdb8b191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:56.080 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:27:56.080 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:27:56.080 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:27:56.081 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:27:56.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:56.222+0000 7fdf34391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:56.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:56.234+0000 7fdf34391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:56.284 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:27:56.284 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:27:56.284 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:27:56.284 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:27:56.284 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:27:56.284 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:27:56.284 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:27:56.284 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:27:56.284 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:27:56.284 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:27:56.284 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:27:56.285 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:27:56.288 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:27:56.288 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:27:56.288 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:27:56.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:56.422+0000 7fbcf8ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:56.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:56.434+0000 7fbcf8ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:56.504 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:27:56.504 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:27:56.504 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:27:56.504 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:27:56.504 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:27:56.504 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:27:56.504 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:27:56.504 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:27:56.504 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:27:56.504 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:27:56.504 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:27:56.504 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:27:56.508 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:27:56.508 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:27:56.508 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:27:56.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:56.639+0000 7f2b21191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:56.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:56.657+0000 7f2b21191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:56.753 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:27:56.753 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:27:56.753 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:27:56.753 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:27:56.753 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:27:56.753 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:27:56.754 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:27:56.754 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:27:56.754 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:27:56.754 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:27:56.754 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:27:56.754 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:27:56.757 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:27:56.757 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:27:56.757 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:27:56.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:56.898+0000 7fa5f2d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:56.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:56.910+0000 7fa5f2d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:56.934 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:27:56.935 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:27:56.935 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:27:56.935 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:27:56.935 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:27:56.935 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:27:56.935 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:27:56.935 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:27:56.935 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:27:56.935 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:27:56.935 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:27:56.935 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:27:56.940 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:27:56.941 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:27:56.995 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:27:57.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:57.148+0000 7fb4ebb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:57.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:57.155+0000 7fb4ebb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:59.477 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:27:59.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:59.629+0000 7f0be0246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:27:59.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:27:59.637+0000 7f0be0246640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:01.913 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:28:01.941 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:28:01.941 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:28:01.942 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:28:01.942 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:28:02.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:02.073+0000 7f0939e8e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:02.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:02.083+0000 7f0938c2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:02.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:02.107+0000 7fd8c0b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:02.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:02.125+0000 7fd8c0b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:02.281 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:28:02.281 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:28:02.281 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:28:02.281 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:28:02.281 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:28:02.281 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:28:02.281 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:28:02.281 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:28:02.281 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:28:02.281 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:28:02.281 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:28:02.282 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:28:02.284 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:28:02.284 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:28:02.284 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:28:02.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:02.430+0000 7f9154ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:02.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:02.443+0000 7f9154ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:02.471 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:28:02.471 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:28:02.472 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:28:02.472 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:28:02.472 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:28:02.472 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:28:02.472 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:28:02.472 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:28:02.472 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:28:02.472 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:28:02.472 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:28:02.472 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:28:02.477 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:28:02.477 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:28:02.477 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:28:02.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:02.614+0000 7fd8e8791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:02.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:02.629+0000 7fd8e8791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:02.676 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:28:02.676 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:28:02.676 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:28:02.676 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:28:02.676 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:28:02.676 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:28:02.676 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:28:02.676 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:28:02.676 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:28:02.676 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:28:02.676 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:28:02.676 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:28:02.684 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:28:02.685 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:28:02.685 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:28:02.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:02.829+0000 7fe5bd791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:02.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:02.843+0000 7fe5bd791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:02.874 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:28:02.874 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:28:02.874 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:28:02.874 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:28:02.874 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:28:02.874 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:28:02.874 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:28:02.874 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:28:02.874 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:28:02.874 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:28:02.874 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:28:02.875 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:28:02.879 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:28:02.880 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:28:04.360 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:28:04.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:04.512+0000 7fc9230d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:04.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:04.520+0000 7fc9230d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:06.896 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:28:07.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:07.047+0000 7f47fb046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:07.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:07.055+0000 7f47fb046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:07.881 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:28:07.881 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:28:07.881 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:28:07.882 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:28:08.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:08.032+0000 7f9f3fca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:08.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:08.047+0000 7f9f3fca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:08.104 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:28:08.105 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:28:08.105 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:28:08.105 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:28:08.105 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:28:08.105 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:28:08.105 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:28:08.105 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:28:08.105 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:28:08.105 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:28:08.105 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:28:08.105 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:28:08.111 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:28:08.111 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:28:08.111 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:28:08.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:08.270+0000 7fee31b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:08.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:08.288+0000 7fee31b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:08.340 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:28:08.340 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:28:08.340 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:28:08.340 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:28:08.340 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:28:08.340 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:28:08.340 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:28:08.340 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:28:08.341 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:28:08.341 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:28:08.341 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:28:08.341 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:28:08.343 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:28:08.343 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:28:08.344 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:28:08.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:08.492+0000 7f97c7ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:08.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:08.507+0000 7f97c7ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:08.648 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:28:08.649 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:28:08.649 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:28:08.649 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:28:08.649 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:28:08.649 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:28:08.649 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:28:08.649 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:28:08.649 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:28:08.649 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:28:08.649 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:28:08.649 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:28:08.651 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:28:08.652 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:28:08.652 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:28:08.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:08.788+0000 7f7982cb4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:08.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:08.804+0000 7f7982cb4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:08.826 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:28:08.826 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:28:08.826 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:28:08.826 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:28:08.826 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:28:08.826 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:28:08.826 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:28:08.826 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:28:08.826 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:28:08.827 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:28:08.827 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:28:08.827 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:28:08.832 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:28:08.832 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:28:09.352 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:28:09.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:09.509+0000 7f351c391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:09.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:09.518+0000 7f351c391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:11.900 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:28:12.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:12.027+0000 7fd083b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:12.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:12.034+0000 7fd083b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:13.834 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:28:13.834 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:28:13.834 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:28:13.834 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:28:14.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:13.995+0000 7fddf3351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:14.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:14.013+0000 7fddf3351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:14.075 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:28:14.075 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:28:14.075 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:28:14.075 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:28:14.075 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:28:14.075 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:28:14.075 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:28:14.076 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:28:14.076 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:28:14.076 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:28:14.076 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:28:14.076 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:28:14.078 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:28:14.078 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:28:14.079 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:28:14.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:14.231+0000 7fd290e97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:14.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:14.242+0000 7fd290e97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:14.366 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:28:14.367 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:28:14.367 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:28:14.367 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:28:14.367 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:28:14.367 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:28:14.367 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:28:14.367 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:28:14.367 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:28:14.367 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:28:14.367 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:28:14.367 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:28:14.372 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:28:14.372 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:28:14.372 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:28:14.381 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:28:14.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:14.546+0000 7f42c9751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:14.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:14.557+0000 7f0c71d08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:14.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:14.559+0000 7f42c9751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:14.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:14.566+0000 7f0c71d08640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:14.614 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:28:14.614 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:28:14.614 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:28:14.614 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:28:14.614 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:28:14.614 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:28:14.614 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:28:14.614 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:28:14.615 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:28:14.615 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:28:14.615 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:28:14.615 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:28:14.618 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:28:14.619 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:28:14.619 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:28:14.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:14.778+0000 7fe3b9c63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:14.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:14.791+0000 7fe3b9c63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:14.848 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:28:14.848 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:28:14.848 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:28:14.848 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:28:14.849 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:28:14.849 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:28:14.849 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:28:14.849 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:28:14.849 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:28:14.849 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:28:14.849 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:28:14.849 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:28:14.853 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:28:14.853 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:28:16.978 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:28:17.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:17.132+0000 7fe79a911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:17.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:17.140+0000 7fe79a911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:19.404 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:28:19.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:19.559+0000 7f6a5dd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:19.570 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:19.569+0000 7f6a5dd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:19.854 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:28:19.854 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:28:19.854 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:28:19.854 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:28:20.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:20.025+0000 7f0e638d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:20.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:20.040+0000 7f0e638d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:20.070 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:28:20.071 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:28:20.071 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:28:20.071 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:28:20.071 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:28:20.071 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:28:20.071 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:28:20.071 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:28:20.071 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:28:20.071 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:28:20.071 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:28:20.071 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:28:20.076 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:28:20.076 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:28:20.076 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:28:20.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:20.238+0000 7fca2c791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:20.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:20.251+0000 7fca2c791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:20.298 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:28:20.298 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:28:20.298 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:28:20.299 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:28:20.299 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:28:20.299 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:28:20.299 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:28:20.299 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:28:20.299 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:28:20.299 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:28:20.299 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:28:20.299 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:28:20.301 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:28:20.301 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:28:20.302 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:28:20.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:20.429+0000 7fefccf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:20.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:20.440+0000 7fefccf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:20.548 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:28:20.548 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:28:20.548 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:28:20.548 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:28:20.548 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:28:20.548 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:28:20.548 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:28:20.548 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:28:20.548 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:28:20.548 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:28:20.548 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:28:20.548 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:28:20.551 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:28:20.551 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:28:20.551 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:28:20.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:20.684+0000 7f5bfb908640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:20.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:20.697+0000 7f5bfb908640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:20.738 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:28:20.738 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:28:20.738 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:28:20.738 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:28:20.738 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:28:20.738 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:28:20.738 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:28:20.738 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:28:20.739 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:28:20.739 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:28:20.739 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:28:20.739 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:28:20.741 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:28:20.742 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:28:21.819 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:28:21.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:21.962+0000 7f45536bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:21.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:21.970+0000 7f45536bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:24.326 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:28:24.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:24.469+0000 7f1e14b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:24.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:24.477+0000 7f1e14b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:25.742 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:28:25.743 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-15T12:28:25.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:25.897+0000 7fb43fd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:25.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:25.925+0000 7fb43fd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:26.306 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.0 to 1 (10000) 2024-09-15T12:28:26.329 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-15T12:28:26.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:26.497+0000 7f4a69cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:26.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:26.515+0000 7f4a69cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:26.731 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:28:26.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:26.879+0000 7f8344b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:26.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:26.889+0000 7f8344b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:27.307 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.1 to 1 (10000) 2024-09-15T12:28:27.329 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-15T12:28:27.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:27.519+0000 7ff823791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:27.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:27.533+0000 7ff823791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:28.318 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.2 to 1 (10000) 2024-09-15T12:28:28.338 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-15T12:28:28.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:28.497+0000 7f14b6511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:28.514 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:28.513+0000 7f14b6511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:29.320 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.3 to 1 (10000) 2024-09-15T12:28:29.321 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:28:29.346 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-15T12:28:29.346 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:28:29.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:29.485+0000 7facd3f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:29.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:29.492+0000 7facd3f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:29.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:29.543+0000 7fdbadd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:29.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:29.557+0000 7fdbadd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:29.883 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:28:29.884 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:28:29.898 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":369,"stamp":"2024-09-15T12:28:29.819294+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":231539275,"num_objects":3529,"num_object_clones":0,"num_object_copies":10587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":31590,"num_write_kb":1122133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31564,"ondisk_log_size":31564,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":417264,"kb_used_data":46184,"kb_used_omap":0,"kb_used_meta":371008,"kb_avail":377070096,"statfs":{"total":386547056640,"available":386119778304,"internally_reserved":0,"allocated":47292416,"data_stored":714399941,"data_compressed":33883304,"data_compressed_allocated":44601344,"data_compressed_original":713375744,"omap_allocated":0,"internal_metadata":379912192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000701"},"pg_stats":[{"pgid":"5.f","version":"78'2001","reported_seq":2073,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.678409+0000","last_change":"2024-09-15T12:25:19.440663+0000","last_active":"2024-09-15T12:28:10.678409+0000","last_peered":"2024-09-15T12:28:10.678409+0000","last_clean":"2024-09-15T12:28:10.678409+0000","last_became_active":"2024-09-15T12:25:19.421824+0000","last_became_peered":"2024-09-15T12:25:19.421824+0000","last_unstale":"2024-09-15T12:28:10.678409+0000","last_undegraded":"2024-09-15T12:28:10.678409+0000","last_fullsized":"2024-09-15T12:28:10.678409+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":2001,"log_dups_size":0,"ondisk_log_size":2001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13828096,"num_objects":211,"num_object_clones":0,"num_object_copies":633,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2001,"num_write_kb":70784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"78'1913","reported_seq":1985,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.532736+0000","last_change":"2024-09-15T12:25:19.444566+0000","last_active":"2024-09-15T12:28:10.532736+0000","last_peered":"2024-09-15T12:28:10.532736+0000","last_clean":"2024-09-15T12:28:10.532736+0000","last_became_active":"2024-09-15T12:25:19.436490+0000","last_became_peered":"2024-09-15T12:25:19.436490+0000","last_unstale":"2024-09-15T12:28:10.532736+0000","last_undegraded":"2024-09-15T12:28:10.532736+0000","last_fullsized":"2024-09-15T12:28:10.532736+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1913,"log_dups_size":0,"ondisk_log_size":1913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11730944,"num_objects":179,"num_object_clones":0,"num_object_copies":537,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1913,"num_write_kb":66944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"78'1952","reported_seq":2025,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.393717+0000","last_change":"2024-09-15T12:25:19.466585+0000","last_active":"2024-09-15T12:28:10.393717+0000","last_peered":"2024-09-15T12:28:10.393717+0000","last_clean":"2024-09-15T12:28:10.393717+0000","last_became_active":"2024-09-15T12:25:19.449036+0000","last_became_peered":"2024-09-15T12:25:19.449036+0000","last_unstale":"2024-09-15T12:28:10.393717+0000","last_undegraded":"2024-09-15T12:28:10.393717+0000","last_fullsized":"2024-09-15T12:28:10.393717+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1952,"log_dups_size":0,"ondisk_log_size":1952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16187416,"num_objects":248,"num_object_clones":0,"num_object_copies":744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1952,"num_write_kb":70337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"78'2038","reported_seq":2110,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:11.501973+0000","last_change":"2024-09-15T12:25:19.412052+0000","last_active":"2024-09-15T12:28:11.501973+0000","last_peered":"2024-09-15T12:28:11.501973+0000","last_clean":"2024-09-15T12:28:11.501973+0000","last_became_active":"2024-09-15T12:25:19.396072+0000","last_became_peered":"2024-09-15T12:25:19.396072+0000","last_unstale":"2024-09-15T12:28:11.501973+0000","last_undegraded":"2024-09-15T12:28:11.501973+0000","last_fullsized":"2024-09-15T12:28:11.501973+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":2038,"log_dups_size":0,"ondisk_log_size":2038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14155776,"num_objects":216,"num_object_clones":0,"num_object_copies":648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2038,"num_write_kb":72128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"78'1875","reported_seq":1947,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.618911+0000","last_change":"2024-09-15T12:25:19.447319+0000","last_active":"2024-09-15T12:28:10.618911+0000","last_peered":"2024-09-15T12:28:10.618911+0000","last_clean":"2024-09-15T12:28:10.618911+0000","last_became_active":"2024-09-15T12:25:19.436362+0000","last_became_peered":"2024-09-15T12:25:19.436362+0000","last_unstale":"2024-09-15T12:28:10.618911+0000","last_undegraded":"2024-09-15T12:28:10.618911+0000","last_fullsized":"2024-09-15T12:28:10.618911+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1875,"log_dups_size":0,"ondisk_log_size":1875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14483456,"num_objects":221,"num_object_clones":0,"num_object_copies":663,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1875,"num_write_kb":67072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"78'1971","reported_seq":2043,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.677277+0000","last_change":"2024-09-15T12:25:19.475504+0000","last_active":"2024-09-15T12:28:10.677277+0000","last_peered":"2024-09-15T12:28:10.677277+0000","last_clean":"2024-09-15T12:28:10.677277+0000","last_became_active":"2024-09-15T12:25:19.467940+0000","last_became_peered":"2024-09-15T12:25:19.467940+0000","last_unstale":"2024-09-15T12:28:10.677277+0000","last_undegraded":"2024-09-15T12:28:10.677277+0000","last_fullsized":"2024-09-15T12:28:10.677277+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1971,"log_dups_size":0,"ondisk_log_size":1971,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14483456,"num_objects":221,"num_object_clones":0,"num_object_copies":663,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1971,"num_write_kb":70144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"78'1946","reported_seq":2018,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.618317+0000","last_change":"2024-09-15T12:25:19.403222+0000","last_active":"2024-09-15T12:28:10.618317+0000","last_peered":"2024-09-15T12:28:10.618317+0000","last_clean":"2024-09-15T12:28:10.618317+0000","last_became_active":"2024-09-15T12:25:19.396442+0000","last_became_peered":"2024-09-15T12:25:19.396442+0000","last_unstale":"2024-09-15T12:28:10.618317+0000","last_undegraded":"2024-09-15T12:28:10.618317+0000","last_fullsized":"2024-09-15T12:28:10.618317+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1946,"log_dups_size":0,"ondisk_log_size":1946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15990784,"num_objects":244,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1946,"num_write_kb":70080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"78'1987","reported_seq":2059,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.300423+0000","last_change":"2024-09-15T12:25:19.418093+0000","last_active":"2024-09-15T12:28:10.300423+0000","last_peered":"2024-09-15T12:28:10.300423+0000","last_clean":"2024-09-15T12:28:10.300423+0000","last_became_active":"2024-09-15T12:25:19.412762+0000","last_became_peered":"2024-09-15T12:25:19.412762+0000","last_unstale":"2024-09-15T12:28:10.300423+0000","last_undegraded":"2024-09-15T12:28:10.300423+0000","last_fullsized":"2024-09-15T12:28:10.300423+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1987,"log_dups_size":0,"ondisk_log_size":1987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13434880,"num_objects":205,"num_object_clones":0,"num_object_copies":615,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1987,"num_write_kb":70144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"78'1921","reported_seq":1993,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.531588+0000","last_change":"2024-09-15T12:25:19.514099+0000","last_active":"2024-09-15T12:28:10.531588+0000","last_peered":"2024-09-15T12:28:10.531588+0000","last_clean":"2024-09-15T12:28:10.531588+0000","last_became_active":"2024-09-15T12:25:19.506892+0000","last_became_peered":"2024-09-15T12:25:19.506892+0000","last_unstale":"2024-09-15T12:28:10.531588+0000","last_undegraded":"2024-09-15T12:28:10.531588+0000","last_fullsized":"2024-09-15T12:28:10.531588+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1921,"log_dups_size":0,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14876672,"num_objects":227,"num_object_clones":0,"num_object_copies":681,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1921,"num_write_kb":68736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":277,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.283839+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:26:38.283839+0000","last_peered":"2024-09-15T12:26:38.283839+0000","last_clean":"2024-09-15T12:26:38.283839+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:26:38.283839+0000","last_undegraded":"2024-09-15T12:26:38.283839+0000","last_fullsized":"2024-09-15T12:26:38.283839+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":206,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.307035+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:26:38.307035+0000","last_peered":"2024-09-15T12:26:38.307035+0000","last_clean":"2024-09-15T12:26:38.307035+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:26:38.307035+0000","last_undegraded":"2024-09-15T12:26:38.307035+0000","last_fullsized":"2024-09-15T12:26:38.307035+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"78'2021","reported_seq":2093,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.343652+0000","last_change":"2024-09-15T12:25:19.470256+0000","last_active":"2024-09-15T12:28:10.343652+0000","last_peered":"2024-09-15T12:28:10.343652+0000","last_clean":"2024-09-15T12:28:10.343652+0000","last_became_active":"2024-09-15T12:25:19.458317+0000","last_became_peered":"2024-09-15T12:25:19.458317+0000","last_unstale":"2024-09-15T12:28:10.343652+0000","last_undegraded":"2024-09-15T12:28:10.343652+0000","last_fullsized":"2024-09-15T12:28:10.343652+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":2021,"log_dups_size":0,"ondisk_log_size":2021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14876672,"num_objects":227,"num_object_clones":0,"num_object_copies":681,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2021,"num_write_kb":71936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.297600+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:26:38.297600+0000","last_peered":"2024-09-15T12:26:38.297600+0000","last_clean":"2024-09-15T12:26:38.297600+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:26:38.297600+0000","last_undegraded":"2024-09-15T12:26:38.297600+0000","last_fullsized":"2024-09-15T12:26:38.297600+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"78'1980","reported_seq":2052,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.547807+0000","last_change":"2024-09-15T12:25:19.478666+0000","last_active":"2024-09-15T12:28:10.547807+0000","last_peered":"2024-09-15T12:28:10.547807+0000","last_clean":"2024-09-15T12:28:10.547807+0000","last_became_active":"2024-09-15T12:25:19.468663+0000","last_became_peered":"2024-09-15T12:25:19.468663+0000","last_unstale":"2024-09-15T12:28:10.547807+0000","last_undegraded":"2024-09-15T12:28:10.547807+0000","last_fullsized":"2024-09-15T12:28:10.547807+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15335424,"num_objects":234,"num_object_clones":0,"num_object_copies":702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1980,"num_write_kb":70848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.300626+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:26:38.300626+0000","last_peered":"2024-09-15T12:26:38.300626+0000","last_clean":"2024-09-15T12:26:38.300626+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:26:38.300626+0000","last_undegraded":"2024-09-15T12:26:38.300626+0000","last_fullsized":"2024-09-15T12:26:38.300626+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"78'1992","reported_seq":2064,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.389494+0000","last_change":"2024-09-15T12:25:19.499536+0000","last_active":"2024-09-15T12:28:10.389494+0000","last_peered":"2024-09-15T12:28:10.389494+0000","last_clean":"2024-09-15T12:28:10.389494+0000","last_became_active":"2024-09-15T12:25:19.493017+0000","last_became_peered":"2024-09-15T12:25:19.493017+0000","last_unstale":"2024-09-15T12:28:10.389494+0000","last_undegraded":"2024-09-15T12:28:10.389494+0000","last_fullsized":"2024-09-15T12:28:10.389494+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1992,"log_dups_size":0,"ondisk_log_size":1992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13369344,"num_objects":204,"num_object_clones":0,"num_object_copies":612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1992,"num_write_kb":70272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":207,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.292803+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:26:38.292803+0000","last_peered":"2024-09-15T12:26:38.292803+0000","last_clean":"2024-09-15T12:26:38.292803+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:26:38.292803+0000","last_undegraded":"2024-09-15T12:26:38.292803+0000","last_fullsized":"2024-09-15T12:26:38.292803+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"78'1932","reported_seq":2004,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.733700+0000","last_change":"2024-09-15T12:25:19.413209+0000","last_active":"2024-09-15T12:28:10.733700+0000","last_peered":"2024-09-15T12:28:10.733700+0000","last_clean":"2024-09-15T12:28:10.733700+0000","last_became_active":"2024-09-15T12:25:19.403123+0000","last_became_peered":"2024-09-15T12:25:19.403123+0000","last_unstale":"2024-09-15T12:28:10.733700+0000","last_undegraded":"2024-09-15T12:28:10.733700+0000","last_fullsized":"2024-09-15T12:28:10.733700+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1932,"log_dups_size":0,"ondisk_log_size":1932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13762560,"num_objects":210,"num_object_clones":0,"num_object_copies":630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1932,"num_write_kb":68544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.343877+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:26:38.343877+0000","last_peered":"2024-09-15T12:26:38.343877+0000","last_clean":"2024-09-15T12:26:38.343877+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:26:38.343877+0000","last_undegraded":"2024-09-15T12:26:38.343877+0000","last_fullsized":"2024-09-15T12:26:38.343877+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"78'2033","reported_seq":2105,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.678547+0000","last_change":"2024-09-15T12:25:19.429640+0000","last_active":"2024-09-15T12:28:10.678547+0000","last_peered":"2024-09-15T12:28:10.678547+0000","last_clean":"2024-09-15T12:28:10.678547+0000","last_became_active":"2024-09-15T12:25:19.422585+0000","last_became_peered":"2024-09-15T12:25:19.422585+0000","last_unstale":"2024-09-15T12:28:10.678547+0000","last_undegraded":"2024-09-15T12:28:10.678547+0000","last_fullsized":"2024-09-15T12:28:10.678547+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":2033,"log_dups_size":0,"ondisk_log_size":2033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14745600,"num_objects":225,"num_object_clones":0,"num_object_copies":675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2033,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.285548+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:26:38.285548+0000","last_peered":"2024-09-15T12:26:38.285548+0000","last_clean":"2024-09-15T12:26:38.285548+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:26:38.285548+0000","last_undegraded":"2024-09-15T12:26:38.285548+0000","last_fullsized":"2024-09-15T12:26:38.285548+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"78'2033","reported_seq":2105,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:11.347612+0000","last_change":"2024-09-15T12:25:19.429532+0000","last_active":"2024-09-15T12:28:11.347612+0000","last_peered":"2024-09-15T12:28:11.347612+0000","last_clean":"2024-09-15T12:28:11.347612+0000","last_became_active":"2024-09-15T12:25:19.424570+0000","last_became_peered":"2024-09-15T12:25:19.424570+0000","last_unstale":"2024-09-15T12:28:11.347612+0000","last_undegraded":"2024-09-15T12:28:11.347612+0000","last_fullsized":"2024-09-15T12:28:11.347612+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":2033,"log_dups_size":0,"ondisk_log_size":2033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13697024,"num_objects":209,"num_object_clones":0,"num_object_copies":627,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2033,"num_write_kb":71744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.331592+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:26:38.331592+0000","last_peered":"2024-09-15T12:26:38.331592+0000","last_clean":"2024-09-15T12:26:38.331592+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:26:38.331592+0000","last_undegraded":"2024-09-15T12:26:38.331592+0000","last_fullsized":"2024-09-15T12:26:38.331592+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"78'1914","reported_seq":1986,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.754514+0000","last_change":"2024-09-15T12:25:19.453184+0000","last_active":"2024-09-15T12:28:10.754514+0000","last_peered":"2024-09-15T12:28:10.754514+0000","last_clean":"2024-09-15T12:28:10.754514+0000","last_became_active":"2024-09-15T12:25:19.441520+0000","last_became_peered":"2024-09-15T12:25:19.441520+0000","last_unstale":"2024-09-15T12:28:10.754514+0000","last_undegraded":"2024-09-15T12:28:10.754514+0000","last_fullsized":"2024-09-15T12:28:10.754514+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1914,"log_dups_size":0,"ondisk_log_size":1914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15990784,"num_objects":244,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1914,"num_write_kb":69056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.305972+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:26:38.305972+0000","last_peered":"2024-09-15T12:26:38.305972+0000","last_clean":"2024-09-15T12:26:38.305972+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:26:38.305972+0000","last_undegraded":"2024-09-15T12:26:38.305972+0000","last_fullsized":"2024-09-15T12:26:38.305972+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":230948888,"num_objects":3525,"num_object_clones":0,"num_object_copies":10575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":31509,"num_write_kb":1121025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":43134976,"data_stored":689963080,"data_compressed":32763136,"data_compressed_allocated":43122688,"data_compressed_original":689963008,"omap_allocated":0,"internal_metadata":0},"log_size":31509,"ondisk_log_size":31509,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673528,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":121668,"kb_used_data":10164,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94250172,"statfs":{"total":96636764160,"available":96512176128,"internally_reserved":0,"allocated":10407936,"data_stored":155891889,"data_compressed":7393024,"data_compressed_allocated":9732096,"data_compressed_original":155631616,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706232,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":98664,"kb_used_data":13524,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94273176,"statfs":{"total":96636764160,"available":96535732224,"internally_reserved":0,"allocated":13848576,"data_stored":210876612,"data_compressed":10003992,"data_compressed_allocated":13168640,"data_compressed_original":210616320,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706232,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":95028,"kb_used_data":9892,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94276812,"statfs":{"total":96636764160,"available":96539455488,"internally_reserved":0,"allocated":10129408,"data_stored":151828108,"data_compressed":7198056,"data_compressed_allocated":9474048,"data_compressed_original":151584768,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706232,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":101904,"kb_used_data":12604,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94269936,"statfs":{"total":96636764160,"available":96532414464,"internally_reserved":0,"allocated":12906496,"data_stored":195803332,"data_compressed":9288232,"data_compressed_allocated":12226560,"data_compressed_original":195543040,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11878400,"data_stored":189988888,"data_compressed":9021688,"data_compressed_allocated":11874304,"data_compressed_original":189988864,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9166848,"data_stored":146669568,"data_compressed":6964656,"data_compressed_allocated":9166848,"data_compressed_original":146669568,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12709888,"data_stored":203292696,"data_compressed":9653424,"data_compressed_allocated":12705792,"data_compressed_original":203292672,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9379840,"data_stored":150011928,"data_compressed":7123368,"data_compressed_allocated":9375744,"data_compressed_original":150011904,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:28:29.900 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:28:30.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:30.031+0000 7fe898abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:30.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:30.041+0000 7fe898abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:30.391 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:28:30.392 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:28:30.409 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":369,"stamp":"2024-09-15T12:28:29.819294+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":231539275,"num_objects":3529,"num_object_clones":0,"num_object_copies":10587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":31590,"num_write_kb":1122133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31564,"ondisk_log_size":31564,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":417264,"kb_used_data":46184,"kb_used_omap":0,"kb_used_meta":371008,"kb_avail":377070096,"statfs":{"total":386547056640,"available":386119778304,"internally_reserved":0,"allocated":47292416,"data_stored":714399941,"data_compressed":33883304,"data_compressed_allocated":44601344,"data_compressed_original":713375744,"omap_allocated":0,"internal_metadata":379912192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000701"},"pg_stats":[{"pgid":"5.f","version":"78'2001","reported_seq":2073,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.678409+0000","last_change":"2024-09-15T12:25:19.440663+0000","last_active":"2024-09-15T12:28:10.678409+0000","last_peered":"2024-09-15T12:28:10.678409+0000","last_clean":"2024-09-15T12:28:10.678409+0000","last_became_active":"2024-09-15T12:25:19.421824+0000","last_became_peered":"2024-09-15T12:25:19.421824+0000","last_unstale":"2024-09-15T12:28:10.678409+0000","last_undegraded":"2024-09-15T12:28:10.678409+0000","last_fullsized":"2024-09-15T12:28:10.678409+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":2001,"log_dups_size":0,"ondisk_log_size":2001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13828096,"num_objects":211,"num_object_clones":0,"num_object_copies":633,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2001,"num_write_kb":70784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"78'1913","reported_seq":1985,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.532736+0000","last_change":"2024-09-15T12:25:19.444566+0000","last_active":"2024-09-15T12:28:10.532736+0000","last_peered":"2024-09-15T12:28:10.532736+0000","last_clean":"2024-09-15T12:28:10.532736+0000","last_became_active":"2024-09-15T12:25:19.436490+0000","last_became_peered":"2024-09-15T12:25:19.436490+0000","last_unstale":"2024-09-15T12:28:10.532736+0000","last_undegraded":"2024-09-15T12:28:10.532736+0000","last_fullsized":"2024-09-15T12:28:10.532736+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1913,"log_dups_size":0,"ondisk_log_size":1913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11730944,"num_objects":179,"num_object_clones":0,"num_object_copies":537,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1913,"num_write_kb":66944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"78'1952","reported_seq":2025,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.393717+0000","last_change":"2024-09-15T12:25:19.466585+0000","last_active":"2024-09-15T12:28:10.393717+0000","last_peered":"2024-09-15T12:28:10.393717+0000","last_clean":"2024-09-15T12:28:10.393717+0000","last_became_active":"2024-09-15T12:25:19.449036+0000","last_became_peered":"2024-09-15T12:25:19.449036+0000","last_unstale":"2024-09-15T12:28:10.393717+0000","last_undegraded":"2024-09-15T12:28:10.393717+0000","last_fullsized":"2024-09-15T12:28:10.393717+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1952,"log_dups_size":0,"ondisk_log_size":1952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16187416,"num_objects":248,"num_object_clones":0,"num_object_copies":744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1952,"num_write_kb":70337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"78'2038","reported_seq":2110,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:11.501973+0000","last_change":"2024-09-15T12:25:19.412052+0000","last_active":"2024-09-15T12:28:11.501973+0000","last_peered":"2024-09-15T12:28:11.501973+0000","last_clean":"2024-09-15T12:28:11.501973+0000","last_became_active":"2024-09-15T12:25:19.396072+0000","last_became_peered":"2024-09-15T12:25:19.396072+0000","last_unstale":"2024-09-15T12:28:11.501973+0000","last_undegraded":"2024-09-15T12:28:11.501973+0000","last_fullsized":"2024-09-15T12:28:11.501973+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":2038,"log_dups_size":0,"ondisk_log_size":2038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14155776,"num_objects":216,"num_object_clones":0,"num_object_copies":648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2038,"num_write_kb":72128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"78'1875","reported_seq":1947,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.618911+0000","last_change":"2024-09-15T12:25:19.447319+0000","last_active":"2024-09-15T12:28:10.618911+0000","last_peered":"2024-09-15T12:28:10.618911+0000","last_clean":"2024-09-15T12:28:10.618911+0000","last_became_active":"2024-09-15T12:25:19.436362+0000","last_became_peered":"2024-09-15T12:25:19.436362+0000","last_unstale":"2024-09-15T12:28:10.618911+0000","last_undegraded":"2024-09-15T12:28:10.618911+0000","last_fullsized":"2024-09-15T12:28:10.618911+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1875,"log_dups_size":0,"ondisk_log_size":1875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14483456,"num_objects":221,"num_object_clones":0,"num_object_copies":663,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1875,"num_write_kb":67072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"78'1971","reported_seq":2043,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.677277+0000","last_change":"2024-09-15T12:25:19.475504+0000","last_active":"2024-09-15T12:28:10.677277+0000","last_peered":"2024-09-15T12:28:10.677277+0000","last_clean":"2024-09-15T12:28:10.677277+0000","last_became_active":"2024-09-15T12:25:19.467940+0000","last_became_peered":"2024-09-15T12:25:19.467940+0000","last_unstale":"2024-09-15T12:28:10.677277+0000","last_undegraded":"2024-09-15T12:28:10.677277+0000","last_fullsized":"2024-09-15T12:28:10.677277+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1971,"log_dups_size":0,"ondisk_log_size":1971,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14483456,"num_objects":221,"num_object_clones":0,"num_object_copies":663,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1971,"num_write_kb":70144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"78'1946","reported_seq":2018,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.618317+0000","last_change":"2024-09-15T12:25:19.403222+0000","last_active":"2024-09-15T12:28:10.618317+0000","last_peered":"2024-09-15T12:28:10.618317+0000","last_clean":"2024-09-15T12:28:10.618317+0000","last_became_active":"2024-09-15T12:25:19.396442+0000","last_became_peered":"2024-09-15T12:25:19.396442+0000","last_unstale":"2024-09-15T12:28:10.618317+0000","last_undegraded":"2024-09-15T12:28:10.618317+0000","last_fullsized":"2024-09-15T12:28:10.618317+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1946,"log_dups_size":0,"ondisk_log_size":1946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15990784,"num_objects":244,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1946,"num_write_kb":70080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"78'1987","reported_seq":2059,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.300423+0000","last_change":"2024-09-15T12:25:19.418093+0000","last_active":"2024-09-15T12:28:10.300423+0000","last_peered":"2024-09-15T12:28:10.300423+0000","last_clean":"2024-09-15T12:28:10.300423+0000","last_became_active":"2024-09-15T12:25:19.412762+0000","last_became_peered":"2024-09-15T12:25:19.412762+0000","last_unstale":"2024-09-15T12:28:10.300423+0000","last_undegraded":"2024-09-15T12:28:10.300423+0000","last_fullsized":"2024-09-15T12:28:10.300423+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1987,"log_dups_size":0,"ondisk_log_size":1987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13434880,"num_objects":205,"num_object_clones":0,"num_object_copies":615,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1987,"num_write_kb":70144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"78'1921","reported_seq":1993,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.531588+0000","last_change":"2024-09-15T12:25:19.514099+0000","last_active":"2024-09-15T12:28:10.531588+0000","last_peered":"2024-09-15T12:28:10.531588+0000","last_clean":"2024-09-15T12:28:10.531588+0000","last_became_active":"2024-09-15T12:25:19.506892+0000","last_became_peered":"2024-09-15T12:25:19.506892+0000","last_unstale":"2024-09-15T12:28:10.531588+0000","last_undegraded":"2024-09-15T12:28:10.531588+0000","last_fullsized":"2024-09-15T12:28:10.531588+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1921,"log_dups_size":0,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14876672,"num_objects":227,"num_object_clones":0,"num_object_copies":681,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1921,"num_write_kb":68736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":277,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.283839+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:26:38.283839+0000","last_peered":"2024-09-15T12:26:38.283839+0000","last_clean":"2024-09-15T12:26:38.283839+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:26:38.283839+0000","last_undegraded":"2024-09-15T12:26:38.283839+0000","last_fullsized":"2024-09-15T12:26:38.283839+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":206,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.307035+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:26:38.307035+0000","last_peered":"2024-09-15T12:26:38.307035+0000","last_clean":"2024-09-15T12:26:38.307035+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:26:38.307035+0000","last_undegraded":"2024-09-15T12:26:38.307035+0000","last_fullsized":"2024-09-15T12:26:38.307035+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"78'2021","reported_seq":2093,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.343652+0000","last_change":"2024-09-15T12:25:19.470256+0000","last_active":"2024-09-15T12:28:10.343652+0000","last_peered":"2024-09-15T12:28:10.343652+0000","last_clean":"2024-09-15T12:28:10.343652+0000","last_became_active":"2024-09-15T12:25:19.458317+0000","last_became_peered":"2024-09-15T12:25:19.458317+0000","last_unstale":"2024-09-15T12:28:10.343652+0000","last_undegraded":"2024-09-15T12:28:10.343652+0000","last_fullsized":"2024-09-15T12:28:10.343652+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":2021,"log_dups_size":0,"ondisk_log_size":2021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14876672,"num_objects":227,"num_object_clones":0,"num_object_copies":681,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2021,"num_write_kb":71936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.297600+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:26:38.297600+0000","last_peered":"2024-09-15T12:26:38.297600+0000","last_clean":"2024-09-15T12:26:38.297600+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:26:38.297600+0000","last_undegraded":"2024-09-15T12:26:38.297600+0000","last_fullsized":"2024-09-15T12:26:38.297600+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"78'1980","reported_seq":2052,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.547807+0000","last_change":"2024-09-15T12:25:19.478666+0000","last_active":"2024-09-15T12:28:10.547807+0000","last_peered":"2024-09-15T12:28:10.547807+0000","last_clean":"2024-09-15T12:28:10.547807+0000","last_became_active":"2024-09-15T12:25:19.468663+0000","last_became_peered":"2024-09-15T12:25:19.468663+0000","last_unstale":"2024-09-15T12:28:10.547807+0000","last_undegraded":"2024-09-15T12:28:10.547807+0000","last_fullsized":"2024-09-15T12:28:10.547807+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15335424,"num_objects":234,"num_object_clones":0,"num_object_copies":702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1980,"num_write_kb":70848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.300626+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:26:38.300626+0000","last_peered":"2024-09-15T12:26:38.300626+0000","last_clean":"2024-09-15T12:26:38.300626+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:26:38.300626+0000","last_undegraded":"2024-09-15T12:26:38.300626+0000","last_fullsized":"2024-09-15T12:26:38.300626+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"78'1992","reported_seq":2064,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.389494+0000","last_change":"2024-09-15T12:25:19.499536+0000","last_active":"2024-09-15T12:28:10.389494+0000","last_peered":"2024-09-15T12:28:10.389494+0000","last_clean":"2024-09-15T12:28:10.389494+0000","last_became_active":"2024-09-15T12:25:19.493017+0000","last_became_peered":"2024-09-15T12:25:19.493017+0000","last_unstale":"2024-09-15T12:28:10.389494+0000","last_undegraded":"2024-09-15T12:28:10.389494+0000","last_fullsized":"2024-09-15T12:28:10.389494+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1992,"log_dups_size":0,"ondisk_log_size":1992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13369344,"num_objects":204,"num_object_clones":0,"num_object_copies":612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1992,"num_write_kb":70272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":207,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.292803+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:26:38.292803+0000","last_peered":"2024-09-15T12:26:38.292803+0000","last_clean":"2024-09-15T12:26:38.292803+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:26:38.292803+0000","last_undegraded":"2024-09-15T12:26:38.292803+0000","last_fullsized":"2024-09-15T12:26:38.292803+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"78'1932","reported_seq":2004,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.733700+0000","last_change":"2024-09-15T12:25:19.413209+0000","last_active":"2024-09-15T12:28:10.733700+0000","last_peered":"2024-09-15T12:28:10.733700+0000","last_clean":"2024-09-15T12:28:10.733700+0000","last_became_active":"2024-09-15T12:25:19.403123+0000","last_became_peered":"2024-09-15T12:25:19.403123+0000","last_unstale":"2024-09-15T12:28:10.733700+0000","last_undegraded":"2024-09-15T12:28:10.733700+0000","last_fullsized":"2024-09-15T12:28:10.733700+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1932,"log_dups_size":0,"ondisk_log_size":1932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13762560,"num_objects":210,"num_object_clones":0,"num_object_copies":630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1932,"num_write_kb":68544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.343877+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:26:38.343877+0000","last_peered":"2024-09-15T12:26:38.343877+0000","last_clean":"2024-09-15T12:26:38.343877+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:26:38.343877+0000","last_undegraded":"2024-09-15T12:26:38.343877+0000","last_fullsized":"2024-09-15T12:26:38.343877+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"78'2033","reported_seq":2105,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.678547+0000","last_change":"2024-09-15T12:25:19.429640+0000","last_active":"2024-09-15T12:28:10.678547+0000","last_peered":"2024-09-15T12:28:10.678547+0000","last_clean":"2024-09-15T12:28:10.678547+0000","last_became_active":"2024-09-15T12:25:19.422585+0000","last_became_peered":"2024-09-15T12:25:19.422585+0000","last_unstale":"2024-09-15T12:28:10.678547+0000","last_undegraded":"2024-09-15T12:28:10.678547+0000","last_fullsized":"2024-09-15T12:28:10.678547+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":2033,"log_dups_size":0,"ondisk_log_size":2033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14745600,"num_objects":225,"num_object_clones":0,"num_object_copies":675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2033,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.285548+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:26:38.285548+0000","last_peered":"2024-09-15T12:26:38.285548+0000","last_clean":"2024-09-15T12:26:38.285548+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:26:38.285548+0000","last_undegraded":"2024-09-15T12:26:38.285548+0000","last_fullsized":"2024-09-15T12:26:38.285548+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"78'2033","reported_seq":2105,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:11.347612+0000","last_change":"2024-09-15T12:25:19.429532+0000","last_active":"2024-09-15T12:28:11.347612+0000","last_peered":"2024-09-15T12:28:11.347612+0000","last_clean":"2024-09-15T12:28:11.347612+0000","last_became_active":"2024-09-15T12:25:19.424570+0000","last_became_peered":"2024-09-15T12:25:19.424570+0000","last_unstale":"2024-09-15T12:28:11.347612+0000","last_undegraded":"2024-09-15T12:28:11.347612+0000","last_fullsized":"2024-09-15T12:28:11.347612+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":2033,"log_dups_size":0,"ondisk_log_size":2033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13697024,"num_objects":209,"num_object_clones":0,"num_object_copies":627,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2033,"num_write_kb":71744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.331592+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:26:38.331592+0000","last_peered":"2024-09-15T12:26:38.331592+0000","last_clean":"2024-09-15T12:26:38.331592+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:26:38.331592+0000","last_undegraded":"2024-09-15T12:26:38.331592+0000","last_fullsized":"2024-09-15T12:26:38.331592+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"78'1914","reported_seq":1986,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.754514+0000","last_change":"2024-09-15T12:25:19.453184+0000","last_active":"2024-09-15T12:28:10.754514+0000","last_peered":"2024-09-15T12:28:10.754514+0000","last_clean":"2024-09-15T12:28:10.754514+0000","last_became_active":"2024-09-15T12:25:19.441520+0000","last_became_peered":"2024-09-15T12:25:19.441520+0000","last_unstale":"2024-09-15T12:28:10.754514+0000","last_undegraded":"2024-09-15T12:28:10.754514+0000","last_fullsized":"2024-09-15T12:28:10.754514+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1914,"log_dups_size":0,"ondisk_log_size":1914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15990784,"num_objects":244,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1914,"num_write_kb":69056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.305972+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:26:38.305972+0000","last_peered":"2024-09-15T12:26:38.305972+0000","last_clean":"2024-09-15T12:26:38.305972+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:26:38.305972+0000","last_undegraded":"2024-09-15T12:26:38.305972+0000","last_fullsized":"2024-09-15T12:26:38.305972+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":230948888,"num_objects":3525,"num_object_clones":0,"num_object_copies":10575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":31509,"num_write_kb":1121025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":43134976,"data_stored":689963080,"data_compressed":32763136,"data_compressed_allocated":43122688,"data_compressed_original":689963008,"omap_allocated":0,"internal_metadata":0},"log_size":31509,"ondisk_log_size":31509,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673528,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":121668,"kb_used_data":10164,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94250172,"statfs":{"total":96636764160,"available":96512176128,"internally_reserved":0,"allocated":10407936,"data_stored":155891889,"data_compressed":7393024,"data_compressed_allocated":9732096,"data_compressed_original":155631616,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706232,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":98664,"kb_used_data":13524,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94273176,"statfs":{"total":96636764160,"available":96535732224,"internally_reserved":0,"allocated":13848576,"data_stored":210876612,"data_compressed":10003992,"data_compressed_allocated":13168640,"data_compressed_original":210616320,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706232,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":95028,"kb_used_data":9892,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94276812,"statfs":{"total":96636764160,"available":96539455488,"internally_reserved":0,"allocated":10129408,"data_stored":151828108,"data_compressed":7198056,"data_compressed_allocated":9474048,"data_compressed_original":151584768,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706232,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":101904,"kb_used_data":12604,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94269936,"statfs":{"total":96636764160,"available":96532414464,"internally_reserved":0,"allocated":12906496,"data_stored":195803332,"data_compressed":9288232,"data_compressed_allocated":12226560,"data_compressed_original":195543040,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11878400,"data_stored":189988888,"data_compressed":9021688,"data_compressed_allocated":11874304,"data_compressed_original":189988864,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9166848,"data_stored":146669568,"data_compressed":6964656,"data_compressed_allocated":9166848,"data_compressed_original":146669568,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12709888,"data_stored":203292696,"data_compressed":9653424,"data_compressed_allocated":12705792,"data_compressed_original":203292672,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9379840,"data_stored":150011928,"data_compressed":7123368,"data_compressed_allocated":9375744,"data_compressed_original":150011904,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:28:30.410 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-15T12:28:30.410 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:28:30.410 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:28:30.410 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:28:30.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:30.552+0000 7fcb2b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:30.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:30.571+0000 7fcb2b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:30.711 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:28:30.711 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:28:30.711 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:28:30.711 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:28:30.711 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:28:30.711 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:28:30.711 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:28:30.712 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:28:30.712 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:28:30.712 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:28:30.712 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:28:30.712 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:28:30.716 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:28:30.716 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:28:30.716 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:28:30.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:30.866+0000 7f2fe6d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:30.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:30.882+0000 7f2fe6d51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:30.918 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:28:30.918 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:28:30.918 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:28:30.918 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:28:30.918 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:28:30.918 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:28:30.918 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:28:30.918 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:28:30.918 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:28:30.919 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:28:30.919 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:28:30.919 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:28:30.922 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:28:30.923 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:28:30.924 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:28:31.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:31.070+0000 7f2143151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:31.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:31.083+0000 7f2143151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:31.107 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:28:31.107 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:28:31.108 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:28:31.108 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:28:31.108 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:28:31.108 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:28:31.108 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:28:31.108 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:28:31.108 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:28:31.108 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:28:31.108 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:28:31.108 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:28:31.112 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:28:31.112 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:28:31.112 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:28:31.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:31.279+0000 7f23f4a74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:31.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:31.296+0000 7f23f4a74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:31.322 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:28:31.322 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:28:31.322 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:28:31.323 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:28:31.323 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:28:31.323 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:28:31.323 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:28:31.323 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:28:31.323 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:28:31.323 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:28:31.323 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:28:31.323 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:28:31.326 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:28:31.327 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:28:31.729 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:28:31.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:31.871+0000 7f87900d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:31.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:31.878+0000 7f87900d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:33.753 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Removed 17516 objects 2024-09-15T12:28:33.753 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Clean up completed and total clean up time :102.337 2024-09-15T12:28:34.185 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:28:34.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:34.289+0000 7f91e68bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:34.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:34.294+0000 7f91e68bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:35.560 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_2 2024-09-15T12:28:35.561 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_2 unique_pool_2 --yes-i-really-really-mean-it 2024-09-15T12:28:35.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:35.676+0000 7f70728c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:35.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:35.689+0000 7f70728c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:36.327 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:28:36.327 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:28:36.328 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:28:36.395 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:28:36.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:36.432+0000 7f31fb846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:36.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:36.440+0000 7f31fb846640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:36.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:36.501+0000 7f308d711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:36.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:36.507+0000 7f308d711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:36.651 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:28:36.651 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:28:36.663 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":372,"stamp":"2024-09-15T12:28:35.820555+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":231539275,"num_objects":3529,"num_object_clones":0,"num_object_copies":10587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":31590,"num_write_kb":1122133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31564,"ondisk_log_size":31564,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":417264,"kb_used_data":46184,"kb_used_omap":0,"kb_used_meta":371008,"kb_avail":377070096,"statfs":{"total":386547056640,"available":386119778304,"internally_reserved":0,"allocated":47292416,"data_stored":714399941,"data_compressed":33883304,"data_compressed_allocated":44601344,"data_compressed_original":713375744,"omap_allocated":0,"internal_metadata":379912192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001591"},"pg_stats":[{"pgid":"5.f","version":"78'2001","reported_seq":2073,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.678409+0000","last_change":"2024-09-15T12:25:19.440663+0000","last_active":"2024-09-15T12:28:10.678409+0000","last_peered":"2024-09-15T12:28:10.678409+0000","last_clean":"2024-09-15T12:28:10.678409+0000","last_became_active":"2024-09-15T12:25:19.421824+0000","last_became_peered":"2024-09-15T12:25:19.421824+0000","last_unstale":"2024-09-15T12:28:10.678409+0000","last_undegraded":"2024-09-15T12:28:10.678409+0000","last_fullsized":"2024-09-15T12:28:10.678409+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":2001,"log_dups_size":0,"ondisk_log_size":2001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13828096,"num_objects":211,"num_object_clones":0,"num_object_copies":633,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2001,"num_write_kb":70784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"78'1913","reported_seq":1985,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.532736+0000","last_change":"2024-09-15T12:25:19.444566+0000","last_active":"2024-09-15T12:28:10.532736+0000","last_peered":"2024-09-15T12:28:10.532736+0000","last_clean":"2024-09-15T12:28:10.532736+0000","last_became_active":"2024-09-15T12:25:19.436490+0000","last_became_peered":"2024-09-15T12:25:19.436490+0000","last_unstale":"2024-09-15T12:28:10.532736+0000","last_undegraded":"2024-09-15T12:28:10.532736+0000","last_fullsized":"2024-09-15T12:28:10.532736+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1913,"log_dups_size":0,"ondisk_log_size":1913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11730944,"num_objects":179,"num_object_clones":0,"num_object_copies":537,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1913,"num_write_kb":66944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"78'1952","reported_seq":2025,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.393717+0000","last_change":"2024-09-15T12:25:19.466585+0000","last_active":"2024-09-15T12:28:10.393717+0000","last_peered":"2024-09-15T12:28:10.393717+0000","last_clean":"2024-09-15T12:28:10.393717+0000","last_became_active":"2024-09-15T12:25:19.449036+0000","last_became_peered":"2024-09-15T12:25:19.449036+0000","last_unstale":"2024-09-15T12:28:10.393717+0000","last_undegraded":"2024-09-15T12:28:10.393717+0000","last_fullsized":"2024-09-15T12:28:10.393717+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1952,"log_dups_size":0,"ondisk_log_size":1952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16187416,"num_objects":248,"num_object_clones":0,"num_object_copies":744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1952,"num_write_kb":70337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"78'2038","reported_seq":2110,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:11.501973+0000","last_change":"2024-09-15T12:25:19.412052+0000","last_active":"2024-09-15T12:28:11.501973+0000","last_peered":"2024-09-15T12:28:11.501973+0000","last_clean":"2024-09-15T12:28:11.501973+0000","last_became_active":"2024-09-15T12:25:19.396072+0000","last_became_peered":"2024-09-15T12:25:19.396072+0000","last_unstale":"2024-09-15T12:28:11.501973+0000","last_undegraded":"2024-09-15T12:28:11.501973+0000","last_fullsized":"2024-09-15T12:28:11.501973+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":2038,"log_dups_size":0,"ondisk_log_size":2038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14155776,"num_objects":216,"num_object_clones":0,"num_object_copies":648,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2038,"num_write_kb":72128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"78'1875","reported_seq":1947,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.618911+0000","last_change":"2024-09-15T12:25:19.447319+0000","last_active":"2024-09-15T12:28:10.618911+0000","last_peered":"2024-09-15T12:28:10.618911+0000","last_clean":"2024-09-15T12:28:10.618911+0000","last_became_active":"2024-09-15T12:25:19.436362+0000","last_became_peered":"2024-09-15T12:25:19.436362+0000","last_unstale":"2024-09-15T12:28:10.618911+0000","last_undegraded":"2024-09-15T12:28:10.618911+0000","last_fullsized":"2024-09-15T12:28:10.618911+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1875,"log_dups_size":0,"ondisk_log_size":1875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14483456,"num_objects":221,"num_object_clones":0,"num_object_copies":663,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1875,"num_write_kb":67072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"78'1971","reported_seq":2043,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.677277+0000","last_change":"2024-09-15T12:25:19.475504+0000","last_active":"2024-09-15T12:28:10.677277+0000","last_peered":"2024-09-15T12:28:10.677277+0000","last_clean":"2024-09-15T12:28:10.677277+0000","last_became_active":"2024-09-15T12:25:19.467940+0000","last_became_peered":"2024-09-15T12:25:19.467940+0000","last_unstale":"2024-09-15T12:28:10.677277+0000","last_undegraded":"2024-09-15T12:28:10.677277+0000","last_fullsized":"2024-09-15T12:28:10.677277+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1971,"log_dups_size":0,"ondisk_log_size":1971,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14483456,"num_objects":221,"num_object_clones":0,"num_object_copies":663,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1971,"num_write_kb":70144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"78'1946","reported_seq":2018,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.618317+0000","last_change":"2024-09-15T12:25:19.403222+0000","last_active":"2024-09-15T12:28:10.618317+0000","last_peered":"2024-09-15T12:28:10.618317+0000","last_clean":"2024-09-15T12:28:10.618317+0000","last_became_active":"2024-09-15T12:25:19.396442+0000","last_became_peered":"2024-09-15T12:25:19.396442+0000","last_unstale":"2024-09-15T12:28:10.618317+0000","last_undegraded":"2024-09-15T12:28:10.618317+0000","last_fullsized":"2024-09-15T12:28:10.618317+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1946,"log_dups_size":0,"ondisk_log_size":1946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15990784,"num_objects":244,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1946,"num_write_kb":70080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"78'1987","reported_seq":2059,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.300423+0000","last_change":"2024-09-15T12:25:19.418093+0000","last_active":"2024-09-15T12:28:10.300423+0000","last_peered":"2024-09-15T12:28:10.300423+0000","last_clean":"2024-09-15T12:28:10.300423+0000","last_became_active":"2024-09-15T12:25:19.412762+0000","last_became_peered":"2024-09-15T12:25:19.412762+0000","last_unstale":"2024-09-15T12:28:10.300423+0000","last_undegraded":"2024-09-15T12:28:10.300423+0000","last_fullsized":"2024-09-15T12:28:10.300423+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1987,"log_dups_size":0,"ondisk_log_size":1987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13434880,"num_objects":205,"num_object_clones":0,"num_object_copies":615,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1987,"num_write_kb":70144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"78'1921","reported_seq":1993,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.531588+0000","last_change":"2024-09-15T12:25:19.514099+0000","last_active":"2024-09-15T12:28:10.531588+0000","last_peered":"2024-09-15T12:28:10.531588+0000","last_clean":"2024-09-15T12:28:10.531588+0000","last_became_active":"2024-09-15T12:25:19.506892+0000","last_became_peered":"2024-09-15T12:25:19.506892+0000","last_unstale":"2024-09-15T12:28:10.531588+0000","last_undegraded":"2024-09-15T12:28:10.531588+0000","last_fullsized":"2024-09-15T12:28:10.531588+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1921,"log_dups_size":0,"ondisk_log_size":1921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14876672,"num_objects":227,"num_object_clones":0,"num_object_copies":681,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1921,"num_write_kb":68736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":277,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.283839+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:26:38.283839+0000","last_peered":"2024-09-15T12:26:38.283839+0000","last_clean":"2024-09-15T12:26:38.283839+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:26:38.283839+0000","last_undegraded":"2024-09-15T12:26:38.283839+0000","last_fullsized":"2024-09-15T12:26:38.283839+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":206,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.307035+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:26:38.307035+0000","last_peered":"2024-09-15T12:26:38.307035+0000","last_clean":"2024-09-15T12:26:38.307035+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:26:38.307035+0000","last_undegraded":"2024-09-15T12:26:38.307035+0000","last_fullsized":"2024-09-15T12:26:38.307035+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"78'2021","reported_seq":2093,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.343652+0000","last_change":"2024-09-15T12:25:19.470256+0000","last_active":"2024-09-15T12:28:10.343652+0000","last_peered":"2024-09-15T12:28:10.343652+0000","last_clean":"2024-09-15T12:28:10.343652+0000","last_became_active":"2024-09-15T12:25:19.458317+0000","last_became_peered":"2024-09-15T12:25:19.458317+0000","last_unstale":"2024-09-15T12:28:10.343652+0000","last_undegraded":"2024-09-15T12:28:10.343652+0000","last_fullsized":"2024-09-15T12:28:10.343652+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":2021,"log_dups_size":0,"ondisk_log_size":2021,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14876672,"num_objects":227,"num_object_clones":0,"num_object_copies":681,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2021,"num_write_kb":71936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.297600+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:26:38.297600+0000","last_peered":"2024-09-15T12:26:38.297600+0000","last_clean":"2024-09-15T12:26:38.297600+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:26:38.297600+0000","last_undegraded":"2024-09-15T12:26:38.297600+0000","last_fullsized":"2024-09-15T12:26:38.297600+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"78'1980","reported_seq":2052,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.547807+0000","last_change":"2024-09-15T12:25:19.478666+0000","last_active":"2024-09-15T12:28:10.547807+0000","last_peered":"2024-09-15T12:28:10.547807+0000","last_clean":"2024-09-15T12:28:10.547807+0000","last_became_active":"2024-09-15T12:25:19.468663+0000","last_became_peered":"2024-09-15T12:25:19.468663+0000","last_unstale":"2024-09-15T12:28:10.547807+0000","last_undegraded":"2024-09-15T12:28:10.547807+0000","last_fullsized":"2024-09-15T12:28:10.547807+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15335424,"num_objects":234,"num_object_clones":0,"num_object_copies":702,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1980,"num_write_kb":70848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.300626+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:26:38.300626+0000","last_peered":"2024-09-15T12:26:38.300626+0000","last_clean":"2024-09-15T12:26:38.300626+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:26:38.300626+0000","last_undegraded":"2024-09-15T12:26:38.300626+0000","last_fullsized":"2024-09-15T12:26:38.300626+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"78'1992","reported_seq":2064,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.389494+0000","last_change":"2024-09-15T12:25:19.499536+0000","last_active":"2024-09-15T12:28:10.389494+0000","last_peered":"2024-09-15T12:28:10.389494+0000","last_clean":"2024-09-15T12:28:10.389494+0000","last_became_active":"2024-09-15T12:25:19.493017+0000","last_became_peered":"2024-09-15T12:25:19.493017+0000","last_unstale":"2024-09-15T12:28:10.389494+0000","last_undegraded":"2024-09-15T12:28:10.389494+0000","last_fullsized":"2024-09-15T12:28:10.389494+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1992,"log_dups_size":0,"ondisk_log_size":1992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13369344,"num_objects":204,"num_object_clones":0,"num_object_copies":612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1992,"num_write_kb":70272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":207,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.292803+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:26:38.292803+0000","last_peered":"2024-09-15T12:26:38.292803+0000","last_clean":"2024-09-15T12:26:38.292803+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:26:38.292803+0000","last_undegraded":"2024-09-15T12:26:38.292803+0000","last_fullsized":"2024-09-15T12:26:38.292803+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"78'1932","reported_seq":2004,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.733700+0000","last_change":"2024-09-15T12:25:19.413209+0000","last_active":"2024-09-15T12:28:10.733700+0000","last_peered":"2024-09-15T12:28:10.733700+0000","last_clean":"2024-09-15T12:28:10.733700+0000","last_became_active":"2024-09-15T12:25:19.403123+0000","last_became_peered":"2024-09-15T12:25:19.403123+0000","last_unstale":"2024-09-15T12:28:10.733700+0000","last_undegraded":"2024-09-15T12:28:10.733700+0000","last_fullsized":"2024-09-15T12:28:10.733700+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1932,"log_dups_size":0,"ondisk_log_size":1932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13762560,"num_objects":210,"num_object_clones":0,"num_object_copies":630,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1932,"num_write_kb":68544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.343877+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:26:38.343877+0000","last_peered":"2024-09-15T12:26:38.343877+0000","last_clean":"2024-09-15T12:26:38.343877+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:26:38.343877+0000","last_undegraded":"2024-09-15T12:26:38.343877+0000","last_fullsized":"2024-09-15T12:26:38.343877+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2","version":"78'2033","reported_seq":2105,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.678547+0000","last_change":"2024-09-15T12:25:19.429640+0000","last_active":"2024-09-15T12:28:10.678547+0000","last_peered":"2024-09-15T12:28:10.678547+0000","last_clean":"2024-09-15T12:28:10.678547+0000","last_became_active":"2024-09-15T12:25:19.422585+0000","last_became_peered":"2024-09-15T12:25:19.422585+0000","last_unstale":"2024-09-15T12:28:10.678547+0000","last_undegraded":"2024-09-15T12:28:10.678547+0000","last_fullsized":"2024-09-15T12:28:10.678547+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":2033,"log_dups_size":0,"ondisk_log_size":2033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14745600,"num_objects":225,"num_object_clones":0,"num_object_copies":675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2033,"num_write_kb":72256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.285548+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:26:38.285548+0000","last_peered":"2024-09-15T12:26:38.285548+0000","last_clean":"2024-09-15T12:26:38.285548+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:26:38.285548+0000","last_undegraded":"2024-09-15T12:26:38.285548+0000","last_fullsized":"2024-09-15T12:26:38.285548+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"78'2033","reported_seq":2105,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:11.347612+0000","last_change":"2024-09-15T12:25:19.429532+0000","last_active":"2024-09-15T12:28:11.347612+0000","last_peered":"2024-09-15T12:28:11.347612+0000","last_clean":"2024-09-15T12:28:11.347612+0000","last_became_active":"2024-09-15T12:25:19.424570+0000","last_became_peered":"2024-09-15T12:25:19.424570+0000","last_unstale":"2024-09-15T12:28:11.347612+0000","last_undegraded":"2024-09-15T12:28:11.347612+0000","last_fullsized":"2024-09-15T12:28:11.347612+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":2033,"log_dups_size":0,"ondisk_log_size":2033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13697024,"num_objects":209,"num_object_clones":0,"num_object_copies":627,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2033,"num_write_kb":71744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.331592+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:26:38.331592+0000","last_peered":"2024-09-15T12:26:38.331592+0000","last_clean":"2024-09-15T12:26:38.331592+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:26:38.331592+0000","last_undegraded":"2024-09-15T12:26:38.331592+0000","last_fullsized":"2024-09-15T12:26:38.331592+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"78'1914","reported_seq":1986,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:28:10.754514+0000","last_change":"2024-09-15T12:25:19.453184+0000","last_active":"2024-09-15T12:28:10.754514+0000","last_peered":"2024-09-15T12:28:10.754514+0000","last_clean":"2024-09-15T12:28:10.754514+0000","last_became_active":"2024-09-15T12:25:19.441520+0000","last_became_peered":"2024-09-15T12:25:19.441520+0000","last_unstale":"2024-09-15T12:28:10.754514+0000","last_undegraded":"2024-09-15T12:28:10.754514+0000","last_fullsized":"2024-09-15T12:28:10.754514+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:25:18.278836+0000","last_clean_scrub_stamp":"2024-09-15T12:25:18.278836+0000","objects_scrubbed":0,"log_size":1914,"log_dups_size":0,"ondisk_log_size":1914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15990784,"num_objects":244,"num_object_clones":0,"num_object_copies":732,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1914,"num_write_kb":69056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.305972+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:26:38.305972+0000","last_peered":"2024-09-15T12:26:38.305972+0000","last_clean":"2024-09-15T12:26:38.305972+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:26:38.305972+0000","last_undegraded":"2024-09-15T12:26:38.305972+0000","last_fullsized":"2024-09-15T12:26:38.305972+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":230948888,"num_objects":3525,"num_object_clones":0,"num_object_copies":10575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":31509,"num_write_kb":1121025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":43134976,"data_stored":689963080,"data_compressed":32763136,"data_compressed_allocated":43122688,"data_compressed_original":689963008,"omap_allocated":0,"internal_metadata":0},"log_size":31509,"ondisk_log_size":31509,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673528,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":121668,"kb_used_data":10164,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94250172,"statfs":{"total":96636764160,"available":96512176128,"internally_reserved":0,"allocated":10407936,"data_stored":155891889,"data_compressed":7393024,"data_compressed_allocated":9732096,"data_compressed_original":155631616,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706232,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":98664,"kb_used_data":13524,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94273176,"statfs":{"total":96636764160,"available":96535732224,"internally_reserved":0,"allocated":13848576,"data_stored":210876612,"data_compressed":10003992,"data_compressed_allocated":13168640,"data_compressed_original":210616320,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706232,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":95028,"kb_used_data":9892,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94276812,"statfs":{"total":96636764160,"available":96539455488,"internally_reserved":0,"allocated":10129408,"data_stored":151828108,"data_compressed":7198056,"data_compressed_allocated":9474048,"data_compressed_original":151584768,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706232,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":101904,"kb_used_data":12604,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94269936,"statfs":{"total":96636764160,"available":96532414464,"internally_reserved":0,"allocated":12906496,"data_stored":195803332,"data_compressed":9288232,"data_compressed_allocated":12226560,"data_compressed_original":195543040,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11878400,"data_stored":189988888,"data_compressed":9021688,"data_compressed_allocated":11874304,"data_compressed_original":189988864,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9166848,"data_stored":146669568,"data_compressed":6964656,"data_compressed_allocated":9166848,"data_compressed_original":146669568,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12709888,"data_stored":203292696,"data_compressed":9653424,"data_compressed_allocated":12705792,"data_compressed_original":203292672,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9379840,"data_stored":150011928,"data_compressed":7123368,"data_compressed_allocated":9375744,"data_compressed_original":150011904,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:28:36.878 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'unique_pool_2' removed 2024-09-15T12:28:36.899 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-15T12:28:36.900 INFO:tasks.radosbench:Beginning radosbench... 2024-09-15T12:28:36.900 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_3 2024-09-15T12:28:36.901 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_3 16 2024-09-15T12:28:37.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:37.069+0000 7f781386c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:37.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:37.085+0000 7f781386c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:37.885 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'unique_pool_3' created 2024-09-15T12:28:37.902 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_3 rados --yes-i-really-mean-it || true 2024-09-15T12:28:38.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:38.033+0000 7f391c4c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:38.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:38.047+0000 7f391c4c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:38.621 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:28:38.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:38.724+0000 7fb704791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:38.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:38.730+0000 7fb704791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:38.889 INFO:teuthology.orchestra.run.smithi077.stderr:enabled application 'rados' on pool 'unique_pool_3' 2024-09-15T12:28:39.952 DEBUG:teuthology.orchestra.run.smithi077:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_3 bench 90 write' 2024-09-15T12:28:39.955 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-15T12:28:39.955 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-15T12:28:40.017 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:hints = 1 2024-09-15T12:28:40.018 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-15T12:28:40.018 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Object prefix: benchmark_data_smithi077_54101 2024-09-15T12:28:40.018 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-15T12:28:40.018 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 0 0 0 0 0 0 - 0 2024-09-15T12:28:40.828 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:28:40.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:40.983+0000 7f0763591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:40.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:40.991+0000 7f0763591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:41.018 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 1 16 233 217 13.5618 13.5625 0.0932209 0.0716423 2024-09-15T12:28:41.665 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:28:41.665 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:28:41.665 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:28:41.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:41.830+0000 7fc7dc263640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:41.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:41.839+0000 7fc7dc263640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:42.018 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 2 16 443 427 13.3429 13.125 0.0970417 0.0736279 2024-09-15T12:28:42.175 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:28:42.175 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:28:42.192 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":379,"stamp":"2024-09-15T12:28:41.821749+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":9437747,"num_objects":139,"num_object_clones":0,"num_object_copies":417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":216,"num_write_kb":9748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":190,"ondisk_log_size":190,"up":63,"acting":63,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":438016,"kb_used_data":12800,"kb_used_omap":0,"kb_used_meta":425152,"kb_avail":377049344,"statfs":{"total":386547056640,"available":386098528256,"internally_reserved":0,"allocated":13107200,"data_stored":164306770,"data_compressed":7757845,"data_compressed_allocated":10215424,"data_compressed_original":163201024,"omap_allocated":0,"internal_metadata":435355648},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.941313"},"pg_stats":[{"pgid":"6.f","version":"86'15","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.743216+0000","last_change":"2024-09-15T12:28:39.077376+0000","last_active":"2024-09-15T12:28:40.743216+0000","last_peered":"2024-09-15T12:28:40.743216+0000","last_clean":"2024-09-15T12:28:40.743216+0000","last_became_active":"2024-09-15T12:28:39.068998+0000","last_became_peered":"2024-09-15T12:28:39.068998+0000","last_unstale":"2024-09-15T12:28:40.743216+0000","last_undegraded":"2024-09-15T12:28:40.743216+0000","last_fullsized":"2024-09-15T12:28:40.743216+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"86'14","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.715146+0000","last_change":"2024-09-15T12:28:39.087809+0000","last_active":"2024-09-15T12:28:40.715146+0000","last_peered":"2024-09-15T12:28:40.715146+0000","last_clean":"2024-09-15T12:28:40.715146+0000","last_became_active":"2024-09-15T12:28:39.074098+0000","last_became_peered":"2024-09-15T12:28:39.074098+0000","last_unstale":"2024-09-15T12:28:40.715146+0000","last_undegraded":"2024-09-15T12:28:40.715146+0000","last_fullsized":"2024-09-15T12:28:40.715146+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"86'14","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.665059+0000","last_change":"2024-09-15T12:28:39.061230+0000","last_active":"2024-09-15T12:28:40.665059+0000","last_peered":"2024-09-15T12:28:40.665059+0000","last_clean":"2024-09-15T12:28:40.665059+0000","last_became_active":"2024-09-15T12:28:39.046625+0000","last_became_peered":"2024-09-15T12:28:39.046625+0000","last_unstale":"2024-09-15T12:28:40.665059+0000","last_undegraded":"2024-09-15T12:28:40.665059+0000","last_fullsized":"2024-09-15T12:28:40.665059+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:28:37.878584+0000","last_change":"2024-09-15T12:28:37.878584+0000","last_active":"2024-09-15T12:28:37.878584+0000","last_peered":"2024-09-15T12:28:37.878584+0000","last_clean":"2024-09-15T12:28:37.878584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:28:37.878584+0000","last_undegraded":"2024-09-15T12:28:37.878584+0000","last_fullsized":"2024-09-15T12:28:37.878584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"86'5","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.512683+0000","last_change":"2024-09-15T12:28:39.083865+0000","last_active":"2024-09-15T12:28:40.512683+0000","last_peered":"2024-09-15T12:28:40.512683+0000","last_clean":"2024-09-15T12:28:40.512683+0000","last_became_active":"2024-09-15T12:28:39.075263+0000","last_became_peered":"2024-09-15T12:28:39.075263+0000","last_unstale":"2024-09-15T12:28:40.512683+0000","last_undegraded":"2024-09-15T12:28:40.512683+0000","last_fullsized":"2024-09-15T12:28:40.512683+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"86'16","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.509910+0000","last_change":"2024-09-15T12:28:39.031088+0000","last_active":"2024-09-15T12:28:40.509910+0000","last_peered":"2024-09-15T12:28:40.509910+0000","last_clean":"2024-09-15T12:28:40.509910+0000","last_became_active":"2024-09-15T12:28:39.025037+0000","last_became_peered":"2024-09-15T12:28:39.025037+0000","last_unstale":"2024-09-15T12:28:40.509910+0000","last_undegraded":"2024-09-15T12:28:40.509910+0000","last_fullsized":"2024-09-15T12:28:40.509910+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:28:37.878584+0000","last_change":"2024-09-15T12:28:37.878584+0000","last_active":"2024-09-15T12:28:37.878584+0000","last_peered":"2024-09-15T12:28:37.878584+0000","last_clean":"2024-09-15T12:28:37.878584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:28:37.878584+0000","last_undegraded":"2024-09-15T12:28:37.878584+0000","last_fullsized":"2024-09-15T12:28:37.878584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"86'7","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.700401+0000","last_change":"2024-09-15T12:28:38.993796+0000","last_active":"2024-09-15T12:28:40.700401+0000","last_peered":"2024-09-15T12:28:40.700401+0000","last_clean":"2024-09-15T12:28:40.700401+0000","last_became_active":"2024-09-15T12:28:38.987121+0000","last_became_peered":"2024-09-15T12:28:38.987121+0000","last_unstale":"2024-09-15T12:28:40.700401+0000","last_undegraded":"2024-09-15T12:28:40.700401+0000","last_fullsized":"2024-09-15T12:28:40.700401+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"86'9","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.721096+0000","last_change":"2024-09-15T12:28:39.047799+0000","last_active":"2024-09-15T12:28:40.721096+0000","last_peered":"2024-09-15T12:28:40.721096+0000","last_clean":"2024-09-15T12:28:40.721096+0000","last_became_active":"2024-09-15T12:28:39.017997+0000","last_became_peered":"2024-09-15T12:28:39.017997+0000","last_unstale":"2024-09-15T12:28:40.721096+0000","last_undegraded":"2024-09-15T12:28:40.721096+0000","last_fullsized":"2024-09-15T12:28:40.721096+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":277,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.283839+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:26:38.283839+0000","last_peered":"2024-09-15T12:26:38.283839+0000","last_clean":"2024-09-15T12:26:38.283839+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:26:38.283839+0000","last_undegraded":"2024-09-15T12:26:38.283839+0000","last_fullsized":"2024-09-15T12:26:38.283839+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":230,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.911586+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:28:39.911586+0000","last_peered":"2024-09-15T12:28:39.911586+0000","last_clean":"2024-09-15T12:28:39.911586+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:28:39.911586+0000","last_undegraded":"2024-09-15T12:28:39.911586+0000","last_fullsized":"2024-09-15T12:28:39.911586+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:28:37.878584+0000","last_change":"2024-09-15T12:28:37.878584+0000","last_active":"2024-09-15T12:28:37.878584+0000","last_peered":"2024-09-15T12:28:37.878584+0000","last_clean":"2024-09-15T12:28:37.878584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:28:37.878584+0000","last_undegraded":"2024-09-15T12:28:37.878584+0000","last_fullsized":"2024-09-15T12:28:37.878584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.910978+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:28:39.910978+0000","last_peered":"2024-09-15T12:28:39.910978+0000","last_clean":"2024-09-15T12:28:39.910978+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:28:39.910978+0000","last_undegraded":"2024-09-15T12:28:39.910978+0000","last_fullsized":"2024-09-15T12:28:39.910978+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"86'12","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.546299+0000","last_change":"2024-09-15T12:28:39.025429+0000","last_active":"2024-09-15T12:28:40.546299+0000","last_peered":"2024-09-15T12:28:40.546299+0000","last_clean":"2024-09-15T12:28:40.546299+0000","last_became_active":"2024-09-15T12:28:39.007673+0000","last_became_peered":"2024-09-15T12:28:39.007673+0000","last_unstale":"2024-09-15T12:28:40.546299+0000","last_undegraded":"2024-09-15T12:28:40.546299+0000","last_fullsized":"2024-09-15T12:28:40.546299+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.905410+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:28:39.905410+0000","last_peered":"2024-09-15T12:28:39.905410+0000","last_clean":"2024-09-15T12:28:39.905410+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:28:39.905410+0000","last_undegraded":"2024-09-15T12:28:39.905410+0000","last_fullsized":"2024-09-15T12:28:39.905410+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:28:37.878584+0000","last_change":"2024-09-15T12:28:37.878584+0000","last_active":"2024-09-15T12:28:37.878584+0000","last_peered":"2024-09-15T12:28:37.878584+0000","last_clean":"2024-09-15T12:28:37.878584+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:28:37.878584+0000","last_undegraded":"2024-09-15T12:28:37.878584+0000","last_fullsized":"2024-09-15T12:28:37.878584+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":231,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.904865+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:28:39.904865+0000","last_peered":"2024-09-15T12:28:39.904865+0000","last_clean":"2024-09-15T12:28:39.904865+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:28:39.904865+0000","last_undegraded":"2024-09-15T12:28:39.904865+0000","last_fullsized":"2024-09-15T12:28:39.904865+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"86'12","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.704708+0000","last_change":"2024-09-15T12:28:39.023135+0000","last_active":"2024-09-15T12:28:40.704708+0000","last_peered":"2024-09-15T12:28:40.704708+0000","last_clean":"2024-09-15T12:28:40.704708+0000","last_became_active":"2024-09-15T12:28:39.014305+0000","last_became_peered":"2024-09-15T12:28:39.014305+0000","last_unstale":"2024-09-15T12:28:40.704708+0000","last_undegraded":"2024-09-15T12:28:40.704708+0000","last_fullsized":"2024-09-15T12:28:40.704708+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.907958+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:28:39.907958+0000","last_peered":"2024-09-15T12:28:39.907958+0000","last_clean":"2024-09-15T12:28:39.907958+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:28:39.907958+0000","last_undegraded":"2024-09-15T12:28:39.907958+0000","last_fullsized":"2024-09-15T12:28:39.907958+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"86'11","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.637800+0000","last_change":"2024-09-15T12:28:39.054857+0000","last_active":"2024-09-15T12:28:40.637800+0000","last_peered":"2024-09-15T12:28:40.637800+0000","last_clean":"2024-09-15T12:28:40.637800+0000","last_became_active":"2024-09-15T12:28:39.046395+0000","last_became_peered":"2024-09-15T12:28:39.046395+0000","last_unstale":"2024-09-15T12:28:40.637800+0000","last_undegraded":"2024-09-15T12:28:40.637800+0000","last_fullsized":"2024-09-15T12:28:40.637800+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":205,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-15T12:26:38.285548+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:26:38.285548+0000","last_peered":"2024-09-15T12:26:38.285548+0000","last_clean":"2024-09-15T12:26:38.285548+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:26:38.285548+0000","last_undegraded":"2024-09-15T12:26:38.285548+0000","last_fullsized":"2024-09-15T12:26:38.285548+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"86'10","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.600273+0000","last_change":"2024-09-15T12:28:39.052760+0000","last_active":"2024-09-15T12:28:40.600273+0000","last_peered":"2024-09-15T12:28:40.600273+0000","last_clean":"2024-09-15T12:28:40.600273+0000","last_became_active":"2024-09-15T12:28:39.041365+0000","last_became_peered":"2024-09-15T12:28:39.041365+0000","last_unstale":"2024-09-15T12:28:40.600273+0000","last_undegraded":"2024-09-15T12:28:40.600273+0000","last_fullsized":"2024-09-15T12:28:40.600273+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.906843+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:28:39.906843+0000","last_peered":"2024-09-15T12:28:39.906843+0000","last_clean":"2024-09-15T12:28:39.906843+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:28:39.906843+0000","last_undegraded":"2024-09-15T12:28:39.906843+0000","last_fullsized":"2024-09-15T12:28:39.906843+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"86'10","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.697700+0000","last_change":"2024-09-15T12:28:39.046988+0000","last_active":"2024-09-15T12:28:40.697700+0000","last_peered":"2024-09-15T12:28:40.697700+0000","last_clean":"2024-09-15T12:28:40.697700+0000","last_became_active":"2024-09-15T12:28:39.017167+0000","last_became_peered":"2024-09-15T12:28:39.017167+0000","last_unstale":"2024-09-15T12:28:40.697700+0000","last_undegraded":"2024-09-15T12:28:40.697700+0000","last_fullsized":"2024-09-15T12:28:40.697700+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.914018+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:28:39.914018+0000","last_peered":"2024-09-15T12:28:39.914018+0000","last_clean":"2024-09-15T12:28:39.914018+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:28:39.914018+0000","last_undegraded":"2024-09-15T12:28:39.914018+0000","last_fullsized":"2024-09-15T12:28:39.914018+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":8640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1724416,"data_stored":27590656,"data_compressed":1309467,"data_compressed_allocated":1724416,"data_compressed_original":27590656,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":36,"acting":36,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673528,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":121668,"kb_used_data":10164,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94250172,"statfs":{"total":96636764160,"available":96512176128,"internally_reserved":0,"allocated":10407936,"data_stored":155891889,"data_compressed":7393024,"data_compressed_allocated":9732096,"data_compressed_original":155631616,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706262,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99900,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94271940,"statfs":{"total":96636764160,"available":96534466560,"internally_reserved":0,"allocated":897024,"data_stored":2630379,"data_compressed":113994,"data_compressed_allocated":151552,"data_compressed_original":2342912,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706262,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":112260,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94259580,"statfs":{"total":96636764160,"available":96521809920,"internally_reserved":0,"allocated":774144,"data_stored":1056971,"data_compressed":37314,"data_compressed_allocated":49152,"data_compressed_original":786432,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706262,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":104188,"kb_used_data":1004,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94267652,"statfs":{"total":96636764160,"available":96530075648,"internally_reserved":0,"allocated":1028096,"data_stored":4727531,"data_compressed":213513,"data_compressed_allocated":282624,"data_compressed_original":4440064,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":630784,"data_stored":10092544,"data_compressed":478998,"data_compressed_allocated":630784,"data_compressed_original":10092544,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":602112,"data_stored":9633792,"data_compressed":457229,"data_compressed_allocated":602112,"data_compressed_original":9633792,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":491520,"data_stored":7864320,"data_compressed":373240,"data_compressed_allocated":491520,"data_compressed_original":7864320,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:28:43.018 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 3 16 657 641 13.3532 13.375 0.0776792 0.0737468 2024-09-15T12:28:43.407 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:28:43.572 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:43.567+0000 7f08d12d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:43.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:43.575+0000 7f08d12d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:44.019 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 4 16 875 859 13.4209 13.625 0.0640275 0.0738737 2024-09-15T12:28:45.019 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 5 16 1106 1090 13.624 14.4375 0.0874783 0.0727882 2024-09-15T12:28:45.954 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:28:46.019 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 6 16 1325 1309 13.6344 13.6875 0.0676848 0.0728897 2024-09-15T12:28:46.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:46.118+0000 7f9527948640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:46.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:46.128+0000 7f9527948640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:47.019 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 7 16 1536 1520 13.5703 13.1875 0.133657 0.0730795 2024-09-15T12:28:47.195 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:28:47.195 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:28:47.195 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:28:47.195 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:28:47.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:47.341+0000 7f98d0951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:47.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:47.356+0000 7f98d0951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:47.473 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:28:47.473 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:28:47.473 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:28:47.473 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:28:47.473 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:28:47.473 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:28:47.473 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:28:47.473 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:28:47.473 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:28:47.473 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:28:47.474 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:28:47.474 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:28:47.476 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:28:47.477 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:28:47.477 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:28:47.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:47.642+0000 7fed3aefd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:47.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:47.659+0000 7fed3aefd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:47.742 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:28:47.742 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:28:47.742 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:28:47.742 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:28:47.742 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:28:47.742 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:28:47.742 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:28:47.742 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:28:47.742 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:28:47.742 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:28:47.742 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:28:47.742 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:28:47.746 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:28:47.747 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:28:47.747 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:28:47.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:47.900+0000 7fa559f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:47.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:47.916+0000 7fa559f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:47.972 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:28:47.972 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:28:47.972 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:28:47.972 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:28:47.973 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:28:47.973 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:28:47.973 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:28:47.973 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:28:47.973 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:28:47.973 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:28:47.973 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:28:47.973 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:28:47.976 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:28:47.976 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:28:47.977 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:28:48.019 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 8 16 1747 1731 13.5223 13.1875 0.0542261 0.0735737 2024-09-15T12:28:48.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:48.146+0000 7f20990fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:48.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:48.162+0000 7f20990fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:48.199 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:28:48.200 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:28:48.200 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:28:48.200 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:28:48.200 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:28:48.200 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:28:48.200 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:28:48.200 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:28:48.200 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:28:48.200 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:28:48.200 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:28:48.200 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:28:48.203 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:28:48.203 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:28:48.709 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:28:48.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:48.847+0000 7fefa2f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:48.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:48.856+0000 7fefa2f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:49.019 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 9 16 1973 1957 13.5891 14.125 0.0853803 0.0732415 2024-09-15T12:28:50.019 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 10 16 2189 2173 13.5801 13.5 0.0733704 0.0733649 2024-09-15T12:28:51.019 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 11 16 2415 2399 13.6295 14.125 0.0344907 0.0731686 2024-09-15T12:28:51.280 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:28:51.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:51.428+0000 7fb6a9f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:51.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:51.438+0000 7fb6a9f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:52.019 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 12 16 2616 2600 13.5405 12.5625 0.093446 0.0735501 2024-09-15T12:28:53.019 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 13 16 2829 2813 13.5229 13.3125 0.0865379 0.0737135 2024-09-15T12:28:53.205 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:28:53.205 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:28:53.205 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:28:53.205 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:28:53.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:53.368+0000 7f92b6f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:53.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:53.381+0000 7f92b6f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:53.430 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:28:53.430 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:28:53.431 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:28:53.431 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:28:53.431 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:28:53.431 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:28:53.431 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:28:53.431 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:28:53.431 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:28:53.431 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:28:53.431 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:28:53.431 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:28:53.435 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:28:53.435 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:28:53.436 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:28:53.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:53.596+0000 7f93dcc9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:53.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:53.612+0000 7f93dcc9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:53.752 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:28:53.753 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:28:53.753 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:28:53.753 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:28:53.753 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:28:53.753 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:28:53.753 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:28:53.753 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:28:53.753 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:28:53.753 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:28:53.753 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:28:53.753 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:28:53.756 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:28:53.757 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:28:53.757 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:28:53.811 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:28:53.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:53.914+0000 7f54978c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:53.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:53.926+0000 7f54978c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:53.958 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:28:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:28:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:28:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:28:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:28:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:28:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:28:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:28:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:28:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:28:53.961 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:28:53.961 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:28:53.969 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:28:53.969 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:28:53.970 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:28:53.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:53.990+0000 7f2365711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:54.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:54.006+0000 7f2365711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:54.019 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 14 16 3029 3013 13.4497 12.5 0.0672895 0.0741557 2024-09-15T12:28:54.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:54.133+0000 7fe36bf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:54.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:54.152+0000 7fe36bf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:54.221 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:28:54.221 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:28:54.221 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:28:54.221 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:28:54.222 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:28:54.222 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:28:54.222 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:28:54.222 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:28:54.222 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:28:54.222 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:28:54.222 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:28:54.222 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:28:54.225 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:28:54.226 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:28:55.019 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 15 16 3246 3230 13.4572 13.5625 0.0606982 0.0740908 2024-09-15T12:28:56.020 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 16 16 3461 3445 13.4559 13.4375 0.0632916 0.0741128 2024-09-15T12:28:56.555 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:28:56.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:56.714+0000 7fd7db2c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:56.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:56.722+0000 7fd7db2c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:57.020 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 17 16 3669 3653 13.429 13 0.0638706 0.0742859 2024-09-15T12:28:58.020 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 18 16 3874 3858 13.3947 12.8125 0.0639561 0.0743905 2024-09-15T12:28:59.020 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 19 16 4089 4073 13.3969 13.4375 0.112699 0.0744591 2024-09-15T12:28:59.227 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:28:59.227 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:28:59.227 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:28:59.227 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:28:59.279 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:28:59.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:59.386+0000 7f7dd226c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:59.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:59.412+0000 7f7dd226c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:59.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:59.442+0000 7fbec1f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:59.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:59.452+0000 7fbec1f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:59.543 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:28:59.543 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:28:59.543 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:28:59.543 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:28:59.543 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:28:59.543 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:28:59.543 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:28:59.543 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:28:59.543 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:28:59.543 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:28:59.543 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:28:59.543 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:28:59.547 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:28:59.547 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:28:59.547 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:28:59.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:59.696+0000 7fd0a9d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:59.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:28:59.713+0000 7fd0a9d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:28:59.906 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:28:59.906 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:28:59.906 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:28:59.907 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:28:59.907 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:28:59.907 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:28:59.907 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:28:59.907 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:28:59.907 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:28:59.907 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:28:59.907 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:28:59.907 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:28:59.911 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:28:59.912 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:28:59.912 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:29:00.020 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:2024-09-15T12:29:00.019751+0000 min lat: 0.0172728 max lat: 0.170466 avg lat: 0.0747984 2024-09-15T12:29:00.020 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-15T12:29:00.020 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 20 16 4284 4268 13.3363 12.1875 0.093204 0.0747984 2024-09-15T12:29:00.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:00.097+0000 7fd225d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:00.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:00.112+0000 7fd225d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:00.277 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:29:00.278 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:29:00.278 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:29:00.278 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:29:00.278 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:29:00.278 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:29:00.278 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:29:00.278 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:29:00.278 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:29:00.278 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:29:00.278 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:29:00.278 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:29:00.282 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:29:00.282 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:29:00.283 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:29:00.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:00.445+0000 7f2eccc46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:00.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:00.463+0000 7f2eccc46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:00.598 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:29:00.598 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:29:00.598 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:29:00.598 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:29:00.598 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:29:00.598 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:29:00.598 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:29:00.598 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:29:00.598 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:29:00.598 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:29:00.598 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:29:00.598 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:29:00.602 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:29:00.602 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:29:01.020 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 21 16 4496 4480 13.3322 13.25 0.0676811 0.074843 2024-09-15T12:29:01.896 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:29:02.020 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 22 16 4708 4692 13.3284 13.25 0.0555318 0.0747947 2024-09-15T12:29:02.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:02.047+0000 7f79bb423640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:02.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:02.057+0000 7f79bb423640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:03.020 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 23 16 4910 4894 13.2977 12.625 0.0789985 0.0750455 2024-09-15T12:29:04.020 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 24 16 5112 5096 13.2697 12.625 0.112312 0.0751997 2024-09-15T12:29:04.603 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:29:04.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:04.777+0000 7f27d8484640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:04.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:04.790+0000 7f27d8484640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:05.020 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 25 16 5327 5311 13.2763 13.4375 0.0800043 0.0751972 2024-09-15T12:29:05.603 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:29:05.603 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:29:05.603 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:29:05.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:05.769+0000 7f1228d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:05.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:05.783+0000 7f1228d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:06.020 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 26 16 5527 5511 13.2464 12.5 0.0733308 0.0753234 2024-09-15T12:29:06.142 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:29:06.143 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:29:06.166 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":391,"stamp":"2024-09-15T12:29:05.826415+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":15860275,"num_objects":237,"num_object_clones":0,"num_object_copies":711,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":314,"num_write_kb":16020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":288,"ondisk_log_size":288,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":425124,"kb_used_data":4068,"kb_used_omap":0,"kb_used_meta":420992,"kb_avail":377062236,"statfs":{"total":386547056640,"available":386111729664,"internally_reserved":0,"allocated":4165632,"data_stored":20220281,"data_compressed":914324,"data_compressed_allocated":1208320,"data_compressed_original":19087360,"omap_allocated":0,"internal_metadata":431095808},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002127"},"pg_stats":[{"pgid":"6.f","version":"86'15","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.743216+0000","last_change":"2024-09-15T12:28:39.077376+0000","last_active":"2024-09-15T12:28:40.743216+0000","last_peered":"2024-09-15T12:28:40.743216+0000","last_clean":"2024-09-15T12:28:40.743216+0000","last_became_active":"2024-09-15T12:28:39.068998+0000","last_became_peered":"2024-09-15T12:28:39.068998+0000","last_unstale":"2024-09-15T12:28:40.743216+0000","last_undegraded":"2024-09-15T12:28:40.743216+0000","last_fullsized":"2024-09-15T12:28:40.743216+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"86'14","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.715146+0000","last_change":"2024-09-15T12:28:39.087809+0000","last_active":"2024-09-15T12:28:40.715146+0000","last_peered":"2024-09-15T12:28:40.715146+0000","last_clean":"2024-09-15T12:28:40.715146+0000","last_became_active":"2024-09-15T12:28:39.074098+0000","last_became_peered":"2024-09-15T12:28:39.074098+0000","last_unstale":"2024-09-15T12:28:40.715146+0000","last_undegraded":"2024-09-15T12:28:40.715146+0000","last_fullsized":"2024-09-15T12:28:40.715146+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"86'14","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.665059+0000","last_change":"2024-09-15T12:28:39.061230+0000","last_active":"2024-09-15T12:28:40.665059+0000","last_peered":"2024-09-15T12:28:40.665059+0000","last_clean":"2024-09-15T12:28:40.665059+0000","last_became_active":"2024-09-15T12:28:39.046625+0000","last_became_peered":"2024-09-15T12:28:39.046625+0000","last_unstale":"2024-09-15T12:28:40.665059+0000","last_undegraded":"2024-09-15T12:28:40.665059+0000","last_fullsized":"2024-09-15T12:28:40.665059+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"86'19","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:41.604065+0000","last_change":"2024-09-15T12:28:39.043350+0000","last_active":"2024-09-15T12:28:41.604065+0000","last_peered":"2024-09-15T12:28:41.604065+0000","last_clean":"2024-09-15T12:28:41.604065+0000","last_became_active":"2024-09-15T12:28:39.034104+0000","last_became_peered":"2024-09-15T12:28:39.034104+0000","last_unstale":"2024-09-15T12:28:41.604065+0000","last_undegraded":"2024-09-15T12:28:41.604065+0000","last_fullsized":"2024-09-15T12:28:41.604065+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"86'5","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.512683+0000","last_change":"2024-09-15T12:28:39.083865+0000","last_active":"2024-09-15T12:28:40.512683+0000","last_peered":"2024-09-15T12:28:40.512683+0000","last_clean":"2024-09-15T12:28:40.512683+0000","last_became_active":"2024-09-15T12:28:39.075263+0000","last_became_peered":"2024-09-15T12:28:39.075263+0000","last_unstale":"2024-09-15T12:28:40.512683+0000","last_undegraded":"2024-09-15T12:28:40.512683+0000","last_fullsized":"2024-09-15T12:28:40.512683+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"86'16","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.509910+0000","last_change":"2024-09-15T12:28:39.031088+0000","last_active":"2024-09-15T12:28:40.509910+0000","last_peered":"2024-09-15T12:28:40.509910+0000","last_clean":"2024-09-15T12:28:40.509910+0000","last_became_active":"2024-09-15T12:28:39.025037+0000","last_became_peered":"2024-09-15T12:28:39.025037+0000","last_unstale":"2024-09-15T12:28:40.509910+0000","last_undegraded":"2024-09-15T12:28:40.509910+0000","last_fullsized":"2024-09-15T12:28:40.509910+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"86'26","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:41.775030+0000","last_change":"2024-09-15T12:28:39.067539+0000","last_active":"2024-09-15T12:28:41.775030+0000","last_peered":"2024-09-15T12:28:41.775030+0000","last_clean":"2024-09-15T12:28:41.775030+0000","last_became_active":"2024-09-15T12:28:39.054389+0000","last_became_peered":"2024-09-15T12:28:39.054389+0000","last_unstale":"2024-09-15T12:28:41.775030+0000","last_undegraded":"2024-09-15T12:28:41.775030+0000","last_fullsized":"2024-09-15T12:28:41.775030+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"86'7","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.700401+0000","last_change":"2024-09-15T12:28:38.993796+0000","last_active":"2024-09-15T12:28:40.700401+0000","last_peered":"2024-09-15T12:28:40.700401+0000","last_clean":"2024-09-15T12:28:40.700401+0000","last_became_active":"2024-09-15T12:28:38.987121+0000","last_became_peered":"2024-09-15T12:28:38.987121+0000","last_unstale":"2024-09-15T12:28:40.700401+0000","last_undegraded":"2024-09-15T12:28:40.700401+0000","last_fullsized":"2024-09-15T12:28:40.700401+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"86'9","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.721096+0000","last_change":"2024-09-15T12:28:39.047799+0000","last_active":"2024-09-15T12:28:40.721096+0000","last_peered":"2024-09-15T12:28:40.721096+0000","last_clean":"2024-09-15T12:28:40.721096+0000","last_became_active":"2024-09-15T12:28:39.017997+0000","last_became_peered":"2024-09-15T12:28:39.017997+0000","last_unstale":"2024-09-15T12:28:40.721096+0000","last_undegraded":"2024-09-15T12:28:40.721096+0000","last_fullsized":"2024-09-15T12:28:40.721096+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":301,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.902781+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:28:39.902781+0000","last_peered":"2024-09-15T12:28:39.902781+0000","last_clean":"2024-09-15T12:28:39.902781+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:28:39.902781+0000","last_undegraded":"2024-09-15T12:28:39.902781+0000","last_fullsized":"2024-09-15T12:28:39.902781+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":230,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.911586+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:28:39.911586+0000","last_peered":"2024-09-15T12:28:39.911586+0000","last_clean":"2024-09-15T12:28:39.911586+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:28:39.911586+0000","last_undegraded":"2024-09-15T12:28:39.911586+0000","last_fullsized":"2024-09-15T12:28:39.911586+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"86'30","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:41.720506+0000","last_change":"2024-09-15T12:28:39.071985+0000","last_active":"2024-09-15T12:28:41.720506+0000","last_peered":"2024-09-15T12:28:41.720506+0000","last_clean":"2024-09-15T12:28:41.720506+0000","last_became_active":"2024-09-15T12:28:39.061062+0000","last_became_peered":"2024-09-15T12:28:39.061062+0000","last_unstale":"2024-09-15T12:28:41.720506+0000","last_undegraded":"2024-09-15T12:28:41.720506+0000","last_fullsized":"2024-09-15T12:28:41.720506+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.910978+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:28:39.910978+0000","last_peered":"2024-09-15T12:28:39.910978+0000","last_clean":"2024-09-15T12:28:39.910978+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:28:39.910978+0000","last_undegraded":"2024-09-15T12:28:39.910978+0000","last_fullsized":"2024-09-15T12:28:39.910978+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"86'12","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.546299+0000","last_change":"2024-09-15T12:28:39.025429+0000","last_active":"2024-09-15T12:28:40.546299+0000","last_peered":"2024-09-15T12:28:40.546299+0000","last_clean":"2024-09-15T12:28:40.546299+0000","last_became_active":"2024-09-15T12:28:39.007673+0000","last_became_peered":"2024-09-15T12:28:39.007673+0000","last_unstale":"2024-09-15T12:28:40.546299+0000","last_undegraded":"2024-09-15T12:28:40.546299+0000","last_fullsized":"2024-09-15T12:28:40.546299+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.905410+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:28:39.905410+0000","last_peered":"2024-09-15T12:28:39.905410+0000","last_clean":"2024-09-15T12:28:39.905410+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:28:39.905410+0000","last_undegraded":"2024-09-15T12:28:39.905410+0000","last_fullsized":"2024-09-15T12:28:39.905410+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"86'23","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:41.680292+0000","last_change":"2024-09-15T12:28:39.029713+0000","last_active":"2024-09-15T12:28:41.680292+0000","last_peered":"2024-09-15T12:28:41.680292+0000","last_clean":"2024-09-15T12:28:41.680292+0000","last_became_active":"2024-09-15T12:28:39.020975+0000","last_became_peered":"2024-09-15T12:28:39.020975+0000","last_unstale":"2024-09-15T12:28:41.680292+0000","last_undegraded":"2024-09-15T12:28:41.680292+0000","last_fullsized":"2024-09-15T12:28:41.680292+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":231,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.904865+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:28:39.904865+0000","last_peered":"2024-09-15T12:28:39.904865+0000","last_clean":"2024-09-15T12:28:39.904865+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:28:39.904865+0000","last_undegraded":"2024-09-15T12:28:39.904865+0000","last_fullsized":"2024-09-15T12:28:39.904865+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"86'12","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.704708+0000","last_change":"2024-09-15T12:28:39.023135+0000","last_active":"2024-09-15T12:28:40.704708+0000","last_peered":"2024-09-15T12:28:40.704708+0000","last_clean":"2024-09-15T12:28:40.704708+0000","last_became_active":"2024-09-15T12:28:39.014305+0000","last_became_peered":"2024-09-15T12:28:39.014305+0000","last_unstale":"2024-09-15T12:28:40.704708+0000","last_undegraded":"2024-09-15T12:28:40.704708+0000","last_fullsized":"2024-09-15T12:28:40.704708+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.907958+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:28:39.907958+0000","last_peered":"2024-09-15T12:28:39.907958+0000","last_clean":"2024-09-15T12:28:39.907958+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:28:39.907958+0000","last_undegraded":"2024-09-15T12:28:39.907958+0000","last_fullsized":"2024-09-15T12:28:39.907958+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"86'11","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.637800+0000","last_change":"2024-09-15T12:28:39.054857+0000","last_active":"2024-09-15T12:28:40.637800+0000","last_peered":"2024-09-15T12:28:40.637800+0000","last_clean":"2024-09-15T12:28:40.637800+0000","last_became_active":"2024-09-15T12:28:39.046395+0000","last_became_peered":"2024-09-15T12:28:39.046395+0000","last_unstale":"2024-09-15T12:28:40.637800+0000","last_undegraded":"2024-09-15T12:28:40.637800+0000","last_fullsized":"2024-09-15T12:28:40.637800+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.907938+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:28:39.907938+0000","last_peered":"2024-09-15T12:28:39.907938+0000","last_clean":"2024-09-15T12:28:39.907938+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:28:39.907938+0000","last_undegraded":"2024-09-15T12:28:39.907938+0000","last_fullsized":"2024-09-15T12:28:39.907938+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"86'10","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.600273+0000","last_change":"2024-09-15T12:28:39.052760+0000","last_active":"2024-09-15T12:28:40.600273+0000","last_peered":"2024-09-15T12:28:40.600273+0000","last_clean":"2024-09-15T12:28:40.600273+0000","last_became_active":"2024-09-15T12:28:39.041365+0000","last_became_peered":"2024-09-15T12:28:39.041365+0000","last_unstale":"2024-09-15T12:28:40.600273+0000","last_undegraded":"2024-09-15T12:28:40.600273+0000","last_fullsized":"2024-09-15T12:28:40.600273+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.906843+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:28:39.906843+0000","last_peered":"2024-09-15T12:28:39.906843+0000","last_clean":"2024-09-15T12:28:39.906843+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:28:39.906843+0000","last_undegraded":"2024-09-15T12:28:39.906843+0000","last_fullsized":"2024-09-15T12:28:39.906843+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"86'10","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.697700+0000","last_change":"2024-09-15T12:28:39.046988+0000","last_active":"2024-09-15T12:28:40.697700+0000","last_peered":"2024-09-15T12:28:40.697700+0000","last_clean":"2024-09-15T12:28:40.697700+0000","last_became_active":"2024-09-15T12:28:39.017167+0000","last_became_peered":"2024-09-15T12:28:39.017167+0000","last_unstale":"2024-09-15T12:28:40.697700+0000","last_undegraded":"2024-09-15T12:28:40.697700+0000","last_fullsized":"2024-09-15T12:28:40.697700+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.914018+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:28:39.914018+0000","last_peered":"2024-09-15T12:28:39.914018+0000","last_clean":"2024-09-15T12:28:39.914018+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:28:39.914018+0000","last_undegraded":"2024-09-15T12:28:39.914018+0000","last_fullsized":"2024-09-15T12:28:39.914018+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":15269888,"num_objects":233,"num_object_clones":0,"num_object_copies":699,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":233,"num_write_kb":14912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2793472,"data_stored":44695552,"data_compressed":2121372,"data_compressed_allocated":2793472,"data_compressed_original":44695552,"omap_allocated":0,"internal_metadata":0},"log_size":233,"ondisk_log_size":233,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673558,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":108776,"kb_used_data":1432,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94263064,"statfs":{"total":96636764160,"available":96525377536,"internally_reserved":0,"allocated":1466368,"data_stored":11805400,"data_compressed":549503,"data_compressed_allocated":724992,"data_compressed_original":11517952,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706262,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99900,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94271940,"statfs":{"total":96636764160,"available":96534466560,"internally_reserved":0,"allocated":897024,"data_stored":2630379,"data_compressed":113994,"data_compressed_allocated":151552,"data_compressed_original":2342912,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706262,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":112260,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94259580,"statfs":{"total":96636764160,"available":96521809920,"internally_reserved":0,"allocated":774144,"data_stored":1056971,"data_compressed":37314,"data_compressed_allocated":49152,"data_compressed_original":786432,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706262,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":104188,"kb_used_data":1004,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94267652,"statfs":{"total":96636764160,"available":96530075648,"internally_reserved":0,"allocated":1028096,"data_stored":4727531,"data_compressed":213513,"data_compressed_allocated":282624,"data_compressed_original":4440064,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":630784,"data_stored":10092544,"data_compressed":478998,"data_compressed_allocated":630784,"data_compressed_original":10092544,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":602112,"data_stored":9633792,"data_compressed":457229,"data_compressed_allocated":602112,"data_compressed_original":9633792,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":491520,"data_stored":7864320,"data_compressed":373240,"data_compressed_allocated":491520,"data_compressed_original":7864320,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1069056,"data_stored":17104896,"data_compressed":811905,"data_compressed_allocated":1069056,"data_compressed_original":17104896,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:29:07.021 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 27 16 5736 5720 13.2396 13.0625 0.0600455 0.075399 2024-09-15T12:29:07.187 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:29:07.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:07.342+0000 7f5137711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:07.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:07.349+0000 7f5137711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:08.021 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 28 16 5933 5917 13.2064 12.3125 0.106029 0.0756158 2024-09-15T12:29:09.021 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 29 16 6126 6110 13.1669 12.0625 0.0980672 0.075839 2024-09-15T12:29:09.764 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:29:09.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:09.904+0000 7facbff91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:09.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:09.916+0000 7facbff91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:10.021 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 30 16 6340 6324 13.1738 13.375 0.106682 0.0758136 2024-09-15T12:29:11.021 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 31 16 6543 6527 13.1581 12.6875 0.0970798 0.0758602 2024-09-15T12:29:11.168 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:29:11.168 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:29:11.168 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:29:11.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:11.317+0000 7f6a67311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:11.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:11.331+0000 7f6a67311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:11.672 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:29:11.672 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:29:11.692 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":393,"stamp":"2024-09-15T12:29:09.827138+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":15860275,"num_objects":237,"num_object_clones":0,"num_object_copies":711,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":314,"num_write_kb":16020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":288,"ondisk_log_size":288,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":425124,"kb_used_data":4068,"kb_used_omap":0,"kb_used_meta":420992,"kb_avail":377062236,"statfs":{"total":386547056640,"available":386111729664,"internally_reserved":0,"allocated":4165632,"data_stored":20220281,"data_compressed":914324,"data_compressed_allocated":1208320,"data_compressed_original":19087360,"omap_allocated":0,"internal_metadata":431095808},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002082"},"pg_stats":[{"pgid":"6.f","version":"86'15","reported_seq":27,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.743216+0000","last_change":"2024-09-15T12:28:39.077376+0000","last_active":"2024-09-15T12:28:40.743216+0000","last_peered":"2024-09-15T12:28:40.743216+0000","last_clean":"2024-09-15T12:28:40.743216+0000","last_became_active":"2024-09-15T12:28:39.068998+0000","last_became_peered":"2024-09-15T12:28:39.068998+0000","last_unstale":"2024-09-15T12:28:40.743216+0000","last_undegraded":"2024-09-15T12:28:40.743216+0000","last_fullsized":"2024-09-15T12:28:40.743216+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":983040,"num_objects":15,"num_object_clones":0,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"86'14","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.715146+0000","last_change":"2024-09-15T12:28:39.087809+0000","last_active":"2024-09-15T12:28:40.715146+0000","last_peered":"2024-09-15T12:28:40.715146+0000","last_clean":"2024-09-15T12:28:40.715146+0000","last_became_active":"2024-09-15T12:28:39.074098+0000","last_became_peered":"2024-09-15T12:28:39.074098+0000","last_unstale":"2024-09-15T12:28:40.715146+0000","last_undegraded":"2024-09-15T12:28:40.715146+0000","last_fullsized":"2024-09-15T12:28:40.715146+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"86'14","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.665059+0000","last_change":"2024-09-15T12:28:39.061230+0000","last_active":"2024-09-15T12:28:40.665059+0000","last_peered":"2024-09-15T12:28:40.665059+0000","last_clean":"2024-09-15T12:28:40.665059+0000","last_became_active":"2024-09-15T12:28:39.046625+0000","last_became_peered":"2024-09-15T12:28:39.046625+0000","last_unstale":"2024-09-15T12:28:40.665059+0000","last_undegraded":"2024-09-15T12:28:40.665059+0000","last_fullsized":"2024-09-15T12:28:40.665059+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":917504,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"86'19","reported_seq":31,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:41.604065+0000","last_change":"2024-09-15T12:28:39.043350+0000","last_active":"2024-09-15T12:28:41.604065+0000","last_peered":"2024-09-15T12:28:41.604065+0000","last_clean":"2024-09-15T12:28:41.604065+0000","last_became_active":"2024-09-15T12:28:39.034104+0000","last_became_peered":"2024-09-15T12:28:39.034104+0000","last_unstale":"2024-09-15T12:28:41.604065+0000","last_undegraded":"2024-09-15T12:28:41.604065+0000","last_fullsized":"2024-09-15T12:28:41.604065+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1245184,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":1216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"86'5","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.512683+0000","last_change":"2024-09-15T12:28:39.083865+0000","last_active":"2024-09-15T12:28:40.512683+0000","last_peered":"2024-09-15T12:28:40.512683+0000","last_clean":"2024-09-15T12:28:40.512683+0000","last_became_active":"2024-09-15T12:28:39.075263+0000","last_became_peered":"2024-09-15T12:28:39.075263+0000","last_unstale":"2024-09-15T12:28:40.512683+0000","last_undegraded":"2024-09-15T12:28:40.512683+0000","last_fullsized":"2024-09-15T12:28:40.512683+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"86'16","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.509910+0000","last_change":"2024-09-15T12:28:39.031088+0000","last_active":"2024-09-15T12:28:40.509910+0000","last_peered":"2024-09-15T12:28:40.509910+0000","last_clean":"2024-09-15T12:28:40.509910+0000","last_became_active":"2024-09-15T12:28:39.025037+0000","last_became_peered":"2024-09-15T12:28:39.025037+0000","last_unstale":"2024-09-15T12:28:40.509910+0000","last_undegraded":"2024-09-15T12:28:40.509910+0000","last_fullsized":"2024-09-15T12:28:40.509910+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"86'26","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:41.775030+0000","last_change":"2024-09-15T12:28:39.067539+0000","last_active":"2024-09-15T12:28:41.775030+0000","last_peered":"2024-09-15T12:28:41.775030+0000","last_clean":"2024-09-15T12:28:41.775030+0000","last_became_active":"2024-09-15T12:28:39.054389+0000","last_became_peered":"2024-09-15T12:28:39.054389+0000","last_unstale":"2024-09-15T12:28:41.775030+0000","last_undegraded":"2024-09-15T12:28:41.775030+0000","last_fullsized":"2024-09-15T12:28:41.775030+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1703936,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"86'7","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.700401+0000","last_change":"2024-09-15T12:28:38.993796+0000","last_active":"2024-09-15T12:28:40.700401+0000","last_peered":"2024-09-15T12:28:40.700401+0000","last_clean":"2024-09-15T12:28:40.700401+0000","last_became_active":"2024-09-15T12:28:38.987121+0000","last_became_peered":"2024-09-15T12:28:38.987121+0000","last_unstale":"2024-09-15T12:28:40.700401+0000","last_undegraded":"2024-09-15T12:28:40.700401+0000","last_fullsized":"2024-09-15T12:28:40.700401+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":458752,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"86'9","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.721096+0000","last_change":"2024-09-15T12:28:39.047799+0000","last_active":"2024-09-15T12:28:40.721096+0000","last_peered":"2024-09-15T12:28:40.721096+0000","last_clean":"2024-09-15T12:28:40.721096+0000","last_became_active":"2024-09-15T12:28:39.017997+0000","last_became_peered":"2024-09-15T12:28:39.017997+0000","last_unstale":"2024-09-15T12:28:40.721096+0000","last_undegraded":"2024-09-15T12:28:40.721096+0000","last_fullsized":"2024-09-15T12:28:40.721096+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":301,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.902781+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:28:39.902781+0000","last_peered":"2024-09-15T12:28:39.902781+0000","last_clean":"2024-09-15T12:28:39.902781+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:28:39.902781+0000","last_undegraded":"2024-09-15T12:28:39.902781+0000","last_fullsized":"2024-09-15T12:28:39.902781+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":230,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.911586+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:28:39.911586+0000","last_peered":"2024-09-15T12:28:39.911586+0000","last_clean":"2024-09-15T12:28:39.911586+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:28:39.911586+0000","last_undegraded":"2024-09-15T12:28:39.911586+0000","last_fullsized":"2024-09-15T12:28:39.911586+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"86'30","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:41.720506+0000","last_change":"2024-09-15T12:28:39.071985+0000","last_active":"2024-09-15T12:28:41.720506+0000","last_peered":"2024-09-15T12:28:41.720506+0000","last_clean":"2024-09-15T12:28:41.720506+0000","last_became_active":"2024-09-15T12:28:39.061062+0000","last_became_peered":"2024-09-15T12:28:39.061062+0000","last_unstale":"2024-09-15T12:28:41.720506+0000","last_undegraded":"2024-09-15T12:28:41.720506+0000","last_fullsized":"2024-09-15T12:28:41.720506+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.910978+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:28:39.910978+0000","last_peered":"2024-09-15T12:28:39.910978+0000","last_clean":"2024-09-15T12:28:39.910978+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:28:39.910978+0000","last_undegraded":"2024-09-15T12:28:39.910978+0000","last_fullsized":"2024-09-15T12:28:39.910978+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"86'12","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.546299+0000","last_change":"2024-09-15T12:28:39.025429+0000","last_active":"2024-09-15T12:28:40.546299+0000","last_peered":"2024-09-15T12:28:40.546299+0000","last_clean":"2024-09-15T12:28:40.546299+0000","last_became_active":"2024-09-15T12:28:39.007673+0000","last_became_peered":"2024-09-15T12:28:39.007673+0000","last_unstale":"2024-09-15T12:28:40.546299+0000","last_undegraded":"2024-09-15T12:28:40.546299+0000","last_fullsized":"2024-09-15T12:28:40.546299+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.905410+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:28:39.905410+0000","last_peered":"2024-09-15T12:28:39.905410+0000","last_clean":"2024-09-15T12:28:39.905410+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:28:39.905410+0000","last_undegraded":"2024-09-15T12:28:39.905410+0000","last_fullsized":"2024-09-15T12:28:39.905410+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"86'23","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:41.680292+0000","last_change":"2024-09-15T12:28:39.029713+0000","last_active":"2024-09-15T12:28:41.680292+0000","last_peered":"2024-09-15T12:28:41.680292+0000","last_clean":"2024-09-15T12:28:41.680292+0000","last_became_active":"2024-09-15T12:28:39.020975+0000","last_became_peered":"2024-09-15T12:28:39.020975+0000","last_unstale":"2024-09-15T12:28:41.680292+0000","last_undegraded":"2024-09-15T12:28:41.680292+0000","last_fullsized":"2024-09-15T12:28:41.680292+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1507328,"num_objects":23,"num_object_clones":0,"num_object_copies":69,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":1472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":231,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.904865+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:28:39.904865+0000","last_peered":"2024-09-15T12:28:39.904865+0000","last_clean":"2024-09-15T12:28:39.904865+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:28:39.904865+0000","last_undegraded":"2024-09-15T12:28:39.904865+0000","last_fullsized":"2024-09-15T12:28:39.904865+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"86'12","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.704708+0000","last_change":"2024-09-15T12:28:39.023135+0000","last_active":"2024-09-15T12:28:40.704708+0000","last_peered":"2024-09-15T12:28:40.704708+0000","last_clean":"2024-09-15T12:28:40.704708+0000","last_became_active":"2024-09-15T12:28:39.014305+0000","last_became_peered":"2024-09-15T12:28:39.014305+0000","last_unstale":"2024-09-15T12:28:40.704708+0000","last_undegraded":"2024-09-15T12:28:40.704708+0000","last_fullsized":"2024-09-15T12:28:40.704708+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":786432,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.907958+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:28:39.907958+0000","last_peered":"2024-09-15T12:28:39.907958+0000","last_clean":"2024-09-15T12:28:39.907958+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:28:39.907958+0000","last_undegraded":"2024-09-15T12:28:39.907958+0000","last_fullsized":"2024-09-15T12:28:39.907958+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"86'11","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.637800+0000","last_change":"2024-09-15T12:28:39.054857+0000","last_active":"2024-09-15T12:28:40.637800+0000","last_peered":"2024-09-15T12:28:40.637800+0000","last_clean":"2024-09-15T12:28:40.637800+0000","last_became_active":"2024-09-15T12:28:39.046395+0000","last_became_peered":"2024-09-15T12:28:39.046395+0000","last_unstale":"2024-09-15T12:28:40.637800+0000","last_undegraded":"2024-09-15T12:28:40.637800+0000","last_fullsized":"2024-09-15T12:28:40.637800+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":720896,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.907938+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:28:39.907938+0000","last_peered":"2024-09-15T12:28:39.907938+0000","last_clean":"2024-09-15T12:28:39.907938+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:28:39.907938+0000","last_undegraded":"2024-09-15T12:28:39.907938+0000","last_fullsized":"2024-09-15T12:28:39.907938+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"86'10","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.600273+0000","last_change":"2024-09-15T12:28:39.052760+0000","last_active":"2024-09-15T12:28:40.600273+0000","last_peered":"2024-09-15T12:28:40.600273+0000","last_clean":"2024-09-15T12:28:40.600273+0000","last_became_active":"2024-09-15T12:28:39.041365+0000","last_became_peered":"2024-09-15T12:28:39.041365+0000","last_unstale":"2024-09-15T12:28:40.600273+0000","last_undegraded":"2024-09-15T12:28:40.600273+0000","last_fullsized":"2024-09-15T12:28:40.600273+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.906843+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:28:39.906843+0000","last_peered":"2024-09-15T12:28:39.906843+0000","last_clean":"2024-09-15T12:28:39.906843+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:28:39.906843+0000","last_undegraded":"2024-09-15T12:28:39.906843+0000","last_fullsized":"2024-09-15T12:28:39.906843+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"86'10","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:40.697700+0000","last_change":"2024-09-15T12:28:39.046988+0000","last_active":"2024-09-15T12:28:40.697700+0000","last_peered":"2024-09-15T12:28:40.697700+0000","last_clean":"2024-09-15T12:28:40.697700+0000","last_became_active":"2024-09-15T12:28:39.017167+0000","last_became_peered":"2024-09-15T12:28:39.017167+0000","last_unstale":"2024-09-15T12:28:40.697700+0000","last_undegraded":"2024-09-15T12:28:40.697700+0000","last_fullsized":"2024-09-15T12:28:40.697700+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":655360,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.914018+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:28:39.914018+0000","last_peered":"2024-09-15T12:28:39.914018+0000","last_clean":"2024-09-15T12:28:39.914018+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:28:39.914018+0000","last_undegraded":"2024-09-15T12:28:39.914018+0000","last_fullsized":"2024-09-15T12:28:39.914018+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":15269888,"num_objects":233,"num_object_clones":0,"num_object_copies":699,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":233,"num_write_kb":14912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2793472,"data_stored":44695552,"data_compressed":2121372,"data_compressed_allocated":2793472,"data_compressed_original":44695552,"omap_allocated":0,"internal_metadata":0},"log_size":233,"ondisk_log_size":233,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673558,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":108776,"kb_used_data":1432,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94263064,"statfs":{"total":96636764160,"available":96525377536,"internally_reserved":0,"allocated":1466368,"data_stored":11805400,"data_compressed":549503,"data_compressed_allocated":724992,"data_compressed_original":11517952,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706262,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99900,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94271940,"statfs":{"total":96636764160,"available":96534466560,"internally_reserved":0,"allocated":897024,"data_stored":2630379,"data_compressed":113994,"data_compressed_allocated":151552,"data_compressed_original":2342912,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706262,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":112260,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94259580,"statfs":{"total":96636764160,"available":96521809920,"internally_reserved":0,"allocated":774144,"data_stored":1056971,"data_compressed":37314,"data_compressed_allocated":49152,"data_compressed_original":786432,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706262,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":104188,"kb_used_data":1004,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94267652,"statfs":{"total":96636764160,"available":96530075648,"internally_reserved":0,"allocated":1028096,"data_stored":4727531,"data_compressed":213513,"data_compressed_allocated":282624,"data_compressed_original":4440064,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":630784,"data_stored":10092544,"data_compressed":478998,"data_compressed_allocated":630784,"data_compressed_original":10092544,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":602112,"data_stored":9633792,"data_compressed":457229,"data_compressed_allocated":602112,"data_compressed_original":9633792,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":491520,"data_stored":7864320,"data_compressed":373240,"data_compressed_allocated":491520,"data_compressed_original":7864320,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1069056,"data_stored":17104896,"data_compressed":811905,"data_compressed_allocated":1069056,"data_compressed_original":17104896,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:29:12.021 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 32 16 6737 6721 13.1258 12.125 0.0314458 0.076044 2024-09-15T12:29:12.429 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:29:12.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:12.582+0000 7fbc63ce3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:12.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:12.591+0000 7fbc63ce3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:13.021 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 33 16 6946 6930 13.1238 13.0625 0.0797961 0.0761284 2024-09-15T12:29:14.021 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 34 16 7142 7126 13.0981 12.25 0.0771307 0.0762276 2024-09-15T12:29:15.021 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 35 16 7361 7345 13.1149 13.6875 0.0477883 0.0761475 2024-09-15T12:29:15.133 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:29:15.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:15.308+0000 7f632ef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:15.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:15.317+0000 7f632ef91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:16.021 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 36 16 7569 7553 13.1117 13 0.0790107 0.0761648 2024-09-15T12:29:16.694 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:29:16.695 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:29:16.695 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:29:16.695 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:29:16.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:16.859+0000 7f361c791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:16.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:16.878+0000 7f361c791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:17.021 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 37 16 7778 7762 13.1103 13.0625 0.0818161 0.0761559 2024-09-15T12:29:17.062 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:29:17.062 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:29:17.062 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:29:17.062 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:29:17.062 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:29:17.062 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:29:17.062 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:29:17.062 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:29:17.062 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:29:17.062 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:29:17.063 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:29:17.063 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:29:17.067 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:29:17.067 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:29:17.067 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:29:17.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:17.221+0000 7fdb47711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:17.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:17.239+0000 7fdb47711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:17.415 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:29:17.415 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:29:17.415 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:29:17.416 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:29:17.416 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:29:17.416 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:29:17.416 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:29:17.416 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:29:17.416 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:29:17.416 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:29:17.416 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:29:17.416 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:29:17.420 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:29:17.421 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:29:17.421 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:29:17.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:17.576+0000 7efd060d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:17.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:17.591+0000 7efd060d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:17.674 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:29:17.674 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:29:17.674 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:29:17.674 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:29:17.674 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:29:17.674 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:29:17.675 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:29:17.675 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:29:17.675 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:29:17.675 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:29:17.675 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:29:17.675 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:29:17.678 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:29:17.678 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:29:17.679 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:29:17.844 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:29:17.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:17.842+0000 7fe6bc711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:17.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:17.858+0000 7fe6bc711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:17.959 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:29:17.959 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:29:17.960 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:29:17.960 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:29:17.960 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:29:17.960 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:29:17.960 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:29:17.960 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:29:17.960 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:29:17.960 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:29:17.960 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:29:17.960 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:29:17.964 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:29:17.965 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:29:18.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:18.015+0000 7fd03fb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:18.021 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 38 16 7978 7962 13.0942 12.5 0.0545014 0.0762689 2024-09-15T12:29:18.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:18.024+0000 7fd03fb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:19.022 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 39 16 8180 8164 13.0822 12.625 0.0950039 0.0763439 2024-09-15T12:29:20.022 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:2024-09-15T12:29:20.021510+0000 min lat: 0.0166562 max lat: 0.173758 avg lat: 0.0764239 2024-09-15T12:29:20.022 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-15T12:29:20.022 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 40 16 8379 8363 13.066 12.4375 0.0849183 0.0764239 2024-09-15T12:29:20.630 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:29:20.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:20.791+0000 7f01c3b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:20.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:20.800+0000 7f01c3b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:21.022 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 41 16 8582 8566 13.0568 12.6875 0.127876 0.0764848 2024-09-15T12:29:22.022 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 42 16 8772 8756 13.0286 11.875 0.0393791 0.0766268 2024-09-15T12:29:22.965 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:29:22.965 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:29:22.965 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:29:22.966 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:29:23.022 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 43 16 8969 8953 13.0119 12.3125 0.0471886 0.0767479 2024-09-15T12:29:23.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:23.112+0000 7f75a1cbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:23.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:23.131+0000 7f75a1cbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:23.260 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:29:23.260 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:29:23.261 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:29:23.261 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:29:23.261 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:29:23.261 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:29:23.261 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:29:23.261 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:29:23.261 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:29:23.261 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:29:23.261 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:29:23.261 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:29:23.264 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:29:23.265 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:29:23.265 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:29:23.377 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:29:23.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:23.428+0000 7f38f5674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:23.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:23.445+0000 7f38f5674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:23.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:23.540+0000 7f8917511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:23.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:23.548+0000 7f8917511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:23.673 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:29:23.673 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:29:23.673 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:29:23.673 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:29:23.673 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:29:23.674 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:29:23.674 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:29:23.674 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:29:23.674 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:29:23.674 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:29:23.674 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:29:23.674 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:29:23.678 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:29:23.678 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:29:23.679 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:29:23.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:23.834+0000 7f176a591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:23.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:23.851+0000 7f176a591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:23.914 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:29:23.914 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:29:23.914 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:29:23.914 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:29:23.914 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:29:23.914 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:29:23.914 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:29:23.914 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:29:23.915 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:29:23.915 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:29:23.915 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:29:23.915 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:29:23.919 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:29:23.919 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:29:23.920 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:29:24.022 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 44 16 9165 9149 12.9946 12.25 0.0836033 0.0768517 2024-09-15T12:29:24.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:24.087+0000 7f26680d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:24.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:24.102+0000 7f26680d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:24.195 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:29:24.196 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:29:24.196 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:29:24.196 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:29:24.196 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:29:24.196 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:29:24.196 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:29:24.196 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:29:24.196 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:29:24.196 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:29:24.196 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:29:24.196 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:29:24.200 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:29:24.201 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:29:25.022 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 45 16 9353 9337 12.9669 11.75 0.0551499 0.0770497 2024-09-15T12:29:26.022 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 46 16 9556 9540 12.9608 12.6875 0.0563167 0.077083 2024-09-15T12:29:26.158 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:29:26.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:26.305+0000 7f883b391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:26.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:26.315+0000 7f883b391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:27.022 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 47 16 9741 9725 12.9311 11.5625 0.0913776 0.0772345 2024-09-15T12:29:28.022 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 48 16 9929 9913 12.9064 11.75 0.0804802 0.0774117 2024-09-15T12:29:28.856 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:29:29.023 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 49 16 10127 10111 12.8955 12.375 0.0351468 0.0774715 2024-09-15T12:29:29.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:29.019+0000 7f11fc4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:29.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:29.029+0000 7f11fc4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:29.201 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:29:29.202 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:29:29.202 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:29:29.202 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:29:29.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:29.367+0000 7f291a66c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:29.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:29.385+0000 7f291a66c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:29.604 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:29:29.604 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:29:29.604 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:29:29.604 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:29:29.605 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:29:29.605 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:29:29.605 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:29:29.605 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:29:29.605 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:29:29.605 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:29:29.605 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:29:29.605 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:29:29.609 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:29:29.609 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:29:29.610 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:29:29.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:29.769+0000 7fa9ea8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:29.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:29.785+0000 7fa9ea8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:29.976 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:29:29.977 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:29:29.977 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:29:29.977 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:29:29.977 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:29:29.977 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:29:29.977 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:29:29.977 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:29:29.977 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:29:29.977 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:29:29.977 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:29:29.977 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:29:29.983 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:29:29.983 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:29:29.983 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:29:30.023 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 50 16 10321 10305 12.8801 12.125 0.0938922 0.0775505 2024-09-15T12:29:30.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:30.122+0000 7fa84eb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:30.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:30.136+0000 7fa84eb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:30.192 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:29:30.193 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:29:30.193 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:29:30.193 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:29:30.193 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:29:30.193 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:29:30.193 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:29:30.193 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:29:30.193 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:29:30.193 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:29:30.194 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:29:30.194 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:29:30.197 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:29:30.197 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:29:30.197 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:29:30.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:30.406+0000 7f8f1544f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:30.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:30.424+0000 7f8f1544f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:30.571 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:29:30.571 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:29:30.572 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:29:30.572 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:29:30.572 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:29:30.572 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:29:30.572 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:29:30.572 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:29:30.572 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:29:30.572 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:29:30.572 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:29:30.572 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:29:30.576 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:29:30.577 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:29:31.023 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 51 16 10522 10506 12.8738 12.5625 0.0568383 0.0776112 2024-09-15T12:29:31.695 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:29:31.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:31.852+0000 7f4070711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:31.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:31.864+0000 7f4070711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:32.023 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 52 16 10720 10704 12.8642 12.375 0.140723 0.0776436 2024-09-15T12:29:33.023 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 53 16 10917 10901 12.8538 12.3125 0.0510351 0.0777112 2024-09-15T12:29:34.023 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 54 16 11119 11103 12.8495 12.625 0.0510561 0.0777624 2024-09-15T12:29:34.522 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:29:34.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:34.673+0000 7f279c991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:34.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:34.681+0000 7f279c991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:35.023 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 55 16 11315 11299 12.8386 12.25 0.0805368 0.077815 2024-09-15T12:29:35.578 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:29:35.578 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:29:35.578 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:29:35.578 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:29:35.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:35.727+0000 7f226e8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:35.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:35.738+0000 7f226e8d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:35.818 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:29:35.818 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:29:35.818 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:29:35.818 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:29:35.818 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:29:35.818 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:29:35.818 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:29:35.818 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:29:35.818 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:29:35.819 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:29:35.819 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:29:35.819 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:29:35.823 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:29:35.823 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:29:35.823 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:29:35.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:35.968+0000 7f09d2951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:35.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:35.981+0000 7f09d2951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:36.023 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 56 16 11502 11486 12.818 11.6875 0.0958179 0.0779568 2024-09-15T12:29:36.046 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:29:36.046 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:29:36.046 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:29:36.046 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:29:36.046 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:29:36.047 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:29:36.047 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:29:36.047 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:29:36.047 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:29:36.047 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:29:36.047 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:29:36.047 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:29:36.051 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:29:36.051 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:29:36.052 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:29:36.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:36.214+0000 7f5c8e111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:36.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:36.233+0000 7f5c8e111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:36.272 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:29:36.272 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:29:36.272 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:29:36.273 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:29:36.273 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:29:36.273 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:29:36.273 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:29:36.273 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:29:36.273 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:29:36.273 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:29:36.273 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:29:36.273 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:29:36.277 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:29:36.277 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:29:36.277 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:29:36.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:36.435+0000 7f4ad1991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:36.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:36.446+0000 7f4ad1991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:36.473 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:29:36.473 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:29:36.473 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:29:36.473 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:29:36.473 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:29:36.473 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:29:36.473 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:29:36.473 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:29:36.473 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:29:36.474 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:29:36.474 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:29:36.474 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:29:36.478 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:29:36.478 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:29:37.023 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 57 16 11695 11679 12.8048 12.0625 0.0622262 0.0780319 2024-09-15T12:29:37.309 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:29:37.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:37.464+0000 7f6b91ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:37.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:37.471+0000 7f6b91ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:38.023 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 58 16 11884 11868 12.7876 11.8125 0.113699 0.0781218 2024-09-15T12:29:39.024 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 59 16 12079 12063 12.7775 12.1875 0.106318 0.0781988 2024-09-15T12:29:39.854 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:29:40.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:40.003+0000 7f2f5c85c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:40.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:40.011+0000 7f2f5c85c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:40.024 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:2024-09-15T12:29:40.023393+0000 min lat: 0.0166562 max lat: 0.201919 avg lat: 0.0783067 2024-09-15T12:29:40.024 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-15T12:29:40.024 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 60 16 12265 12249 12.7582 11.625 0.123352 0.0783067 2024-09-15T12:29:41.024 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 61 16 12455 12439 12.7437 11.875 0.0556951 0.078407 2024-09-15T12:29:41.478 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:29:41.479 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:29:41.479 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:29:41.479 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:29:41.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:41.614+0000 7f2000b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:41.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:41.630+0000 7f2000b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:41.793 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:29:41.793 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:29:41.793 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:29:41.793 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:29:41.793 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:29:41.793 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:29:41.794 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:29:41.794 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:29:41.794 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:29:41.794 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:29:41.794 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:29:41.794 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:29:41.798 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:29:41.798 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:29:41.798 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:29:41.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:41.935+0000 7f90e0591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:41.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:41.949+0000 7f90e0591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:42.024 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 62 16 12641 12625 12.7257 11.625 0.0863104 0.0784942 2024-09-15T12:29:42.146 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:29:42.146 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:29:42.147 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:29:42.147 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:29:42.147 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:29:42.147 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:29:42.147 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:29:42.147 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:29:42.147 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:29:42.147 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:29:42.147 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:29:42.147 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:29:42.151 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:29:42.152 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:29:42.152 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:29:42.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:42.300+0000 7f1872d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:42.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:42.315+0000 7f1872d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:42.470 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:29:42.470 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:29:42.470 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:29:42.470 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:29:42.470 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:29:42.470 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:29:42.470 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:29:42.470 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:29:42.470 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:29:42.470 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:29:42.470 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:29:42.470 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:29:42.473 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:29:42.474 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:29:42.474 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:29:42.483 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:29:42.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:42.644+0000 7f59872c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:42.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:42.661+0000 7f59872c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:42.701 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:29:42.701 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:29:42.701 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:29:42.701 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:29:42.701 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:29:42.701 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:29:42.701 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:29:42.701 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:29:42.701 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:29:42.701 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:29:42.702 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:29:42.702 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:29:42.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:42.697+0000 7f7f25951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:42.706 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:29:42.707 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:29:42.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:42.708+0000 7f7f25951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:43.024 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 63 16 12826 12810 12.7072 11.5625 0.10292 0.0786176 2024-09-15T12:29:44.024 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 64 16 13017 13001 12.6951 11.9375 0.0736008 0.0786842 2024-09-15T12:29:45.024 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 65 16 13211 13195 12.6864 12.125 0.098762 0.0787699 2024-09-15T12:29:45.333 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:29:45.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:45.499+0000 7ff792311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:45.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:45.509+0000 7ff792311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:46.024 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 66 16 13397 13381 12.6703 11.625 0.106598 0.0788539 2024-09-15T12:29:47.024 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 67 16 13594 13578 12.6649 12.3125 0.070799 0.0789041 2024-09-15T12:29:47.708 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:29:47.708 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:29:47.708 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:29:47.708 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:29:47.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:47.867+0000 7fd902ac8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:47.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:47.883+0000 7fd902ac8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:48.024 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 68 16 13789 13773 12.6579 12.1875 0.0868289 0.078947 2024-09-15T12:29:48.073 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:29:48.074 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:29:48.074 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:29:48.074 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:29:48.074 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:29:48.074 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:29:48.074 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:29:48.074 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:29:48.074 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:29:48.074 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:29:48.074 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:29:48.074 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:29:48.078 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:29:48.078 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:29:48.078 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:29:48.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:48.240+0000 7f7568d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:48.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:48.256+0000 7f7568d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:48.283 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:29:48.350 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:29:48.350 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:29:48.351 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:29:48.351 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:29:48.352 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:29:48.353 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:29:48.353 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:29:48.353 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:29:48.353 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:29:48.353 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:29:48.353 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:29:48.353 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:29:48.358 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:29:48.359 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:29:48.359 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:29:48.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:48.448+0000 7f37ea29c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:48.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:48.460+0000 7f37ea29c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:48.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:48.516+0000 7f3093b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:48.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:48.531+0000 7f3093b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:48.625 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:29:48.625 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:29:48.625 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:29:48.626 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:29:48.626 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:29:48.626 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:29:48.626 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:29:48.626 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:29:48.626 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:29:48.626 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:29:48.626 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:29:48.626 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:29:48.629 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:29:48.629 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:29:48.630 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:29:48.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:48.778+0000 7fc334aac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:48.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:48.797+0000 7fc334aac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:48.928 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:29:48.928 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:29:48.928 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:29:48.928 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:29:48.928 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:29:48.928 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:29:48.928 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:29:48.928 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:29:48.928 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:29:48.928 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:29:48.928 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:29:48.928 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:29:48.931 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:29:48.932 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:29:49.024 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 69 16 13966 13950 12.6347 11.0625 0.0879582 0.0790742 2024-09-15T12:29:50.025 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 70 16 14156 14140 12.6239 11.875 0.0841969 0.0791593 2024-09-15T12:29:51.025 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 71 16 14329 14313 12.5983 10.8125 0.0878027 0.0793205 2024-09-15T12:29:51.035 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:29:51.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:51.205+0000 7f5229991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:51.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:51.216+0000 7f5229991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:52.025 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 72 16 14507 14491 12.5779 11.125 0.129448 0.0794393 2024-09-15T12:29:53.025 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 73 16 14698 14682 12.5691 11.9375 0.102572 0.0795074 2024-09-15T12:29:53.782 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:29:53.933 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:29:53.933 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:29:53.933 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:29:53.933 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:29:53.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:53.928+0000 7fb53cf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:53.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:53.939+0000 7fb53cf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:54.025 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 74 16 14883 14867 12.5554 11.5625 0.062248 0.0795979 2024-09-15T12:29:54.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:54.098+0000 7f6cf3551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:54.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:54.114+0000 7f6cf3551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:54.242 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:29:54.243 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:29:54.243 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:29:54.243 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:29:54.243 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:29:54.243 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:29:54.243 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:29:54.243 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:29:54.243 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:29:54.243 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:29:54.244 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:29:54.244 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:29:54.246 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:29:54.247 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:29:54.247 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:29:54.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:54.447+0000 7f8f07d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:54.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:54.465+0000 7f8f07d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:54.561 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:29:54.561 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:29:54.561 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:29:54.561 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:29:54.561 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:29:54.561 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:29:54.561 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:29:54.562 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:29:54.562 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:29:54.562 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:29:54.562 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:29:54.562 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:29:54.565 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:29:54.566 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:29:54.566 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:29:54.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:54.726+0000 7f1d57551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:54.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:54.743+0000 7f1d57551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:54.784 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:29:54.784 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:29:54.784 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:29:54.784 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:29:54.784 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:29:54.784 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:29:54.784 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:29:54.784 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:29:54.784 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:29:54.784 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:29:54.785 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:29:54.785 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:29:54.788 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:29:54.788 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:29:54.789 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:29:54.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:54.926+0000 7f5d46151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:54.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:54.946+0000 7f5d46151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:55.003 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:29:55.003 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:29:55.003 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:29:55.003 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:29:55.003 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:29:55.004 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:29:55.004 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:29:55.004 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:29:55.004 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:29:55.004 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:29:55.004 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:29:55.004 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:29:55.008 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:29:55.008 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:29:55.025 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 75 16 15056 15040 12.5322 10.8125 0.075433 0.0797512 2024-09-15T12:29:56.025 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 76 16 15249 15233 12.526 12.0625 0.0451975 0.0797919 2024-09-15T12:29:56.369 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:29:56.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:56.538+0000 7f6340afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:56.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:56.549+0000 7f6340afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:57.025 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 77 16 15429 15413 12.5094 11.25 0.0726249 0.0798737 2024-09-15T12:29:58.026 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 78 16 15609 15593 12.4933 11.25 0.0457739 0.0799882 2024-09-15T12:29:59.026 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 79 16 15794 15778 12.4815 11.5625 0.104631 0.0800381 2024-09-15T12:29:59.132 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:29:59.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:59.288+0000 7f67bb191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:29:59.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:29:59.298+0000 7f67bb191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:00.008 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:30:00.009 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:30:00.009 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:30:00.009 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:30:00.026 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:2024-09-15T12:30:00.025314+0000 min lat: 0.0166562 max lat: 0.21975 avg lat: 0.0801487 2024-09-15T12:30:00.026 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-15T12:30:00.026 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 80 16 15976 15960 12.4676 11.375 0.113209 0.0801487 2024-09-15T12:30:00.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:00.162+0000 7f49d9d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:00.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:00.179+0000 7f49d9d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:00.393 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:30:00.394 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:30:00.394 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:30:00.394 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:30:00.394 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:30:00.394 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:30:00.394 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:30:00.394 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:30:00.394 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:30:00.394 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:30:00.394 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:30:00.394 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:30:00.398 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:30:00.398 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:30:00.399 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:30:00.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:00.591+0000 7fc9fb751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:00.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:00.611+0000 7fc9fb751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:00.730 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:30:00.730 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:30:00.730 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:30:00.730 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:30:00.730 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:30:00.730 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:30:00.730 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:30:00.730 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:30:00.731 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:30:00.731 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:30:00.731 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:30:00.731 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:30:00.734 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:30:00.735 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:30:00.735 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:30:00.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:00.876+0000 7f2171f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:00.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:00.891+0000 7f2171f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:00.975 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:30:00.975 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:30:00.975 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:30:00.976 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:30:00.976 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:30:00.976 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:30:00.976 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:30:00.977 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:30:00.977 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:30:00.977 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:30:00.977 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:30:00.977 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:30:00.979 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:30:00.980 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:30:00.980 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:30:01.026 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 81 16 16150 16134 12.4479 10.875 0.124502 0.080274 2024-09-15T12:30:01.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:01.122+0000 7f6be1b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:01.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:01.138+0000 7f6be1b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:01.209 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:30:01.209 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:30:01.209 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:30:01.209 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:30:01.209 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:30:01.209 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:30:01.209 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:30:01.209 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:30:01.209 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:30:01.210 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:30:01.210 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:30:01.210 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:30:01.213 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:30:01.213 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:30:01.881 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:30:02.026 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 82 16 16335 16319 12.4371 11.5625 0.0450613 0.0803638 2024-09-15T12:30:02.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:02.033+0000 7fa6e7b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:02.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:02.045+0000 7fa6e7b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:03.026 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 83 16 16515 16499 12.4228 11.25 0.056216 0.0804422 2024-09-15T12:30:04.026 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 84 16 16702 16686 12.414 11.6875 0.0586022 0.0805091 2024-09-15T12:30:04.665 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:30:04.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:04.807+0000 7fdbed29c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:04.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:04.817+0000 7fdbed29c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:05.026 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 85 16 16886 16870 12.4033 11.5 0.0626266 0.0805563 2024-09-15T12:30:06.026 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 86 16 17060 17044 12.3855 10.875 0.0335585 0.0806865 2024-09-15T12:30:06.214 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:30:06.214 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:30:06.215 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:30:06.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:06.388+0000 7fe923391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:06.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:06.403+0000 7fe923391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:06.783 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:30:06.784 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:30:06.808 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":421,"stamp":"2024-09-15T12:30:05.837942+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":817103411,"num_objects":12463,"num_object_clones":0,"num_object_copies":37389,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":12540,"num_write_kb":798484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12514,"ondisk_log_size":12514,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":564084,"kb_used_data":151344,"kb_used_omap":0,"kb_used_meta":412672,"kb_avail":376923276,"statfs":{"total":386547056640,"available":385969434624,"internally_reserved":0,"allocated":154976256,"data_stored":2433190265,"data_compressed":115492171,"data_compressed_allocated":152018944,"data_compressed_original":2432057344,"omap_allocated":0,"internal_metadata":422576128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002254"},"pg_stats":[{"pgid":"6.f","version":"86'779","reported_seq":791,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:29:40.693923+0000","last_change":"2024-09-15T12:28:39.077376+0000","last_active":"2024-09-15T12:29:40.693923+0000","last_peered":"2024-09-15T12:29:40.693923+0000","last_clean":"2024-09-15T12:29:40.693923+0000","last_became_active":"2024-09-15T12:28:39.068998+0000","last_became_peered":"2024-09-15T12:28:39.068998+0000","last_unstale":"2024-09-15T12:29:40.693923+0000","last_undegraded":"2024-09-15T12:29:40.693923+0000","last_fullsized":"2024-09-15T12:29:40.693923+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51052544,"num_objects":779,"num_object_clones":0,"num_object_copies":2337,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":779,"num_write_kb":49856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"86'761","reported_seq":773,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:29:40.598421+0000","last_change":"2024-09-15T12:28:39.087809+0000","last_active":"2024-09-15T12:29:40.598421+0000","last_peered":"2024-09-15T12:29:40.598421+0000","last_clean":"2024-09-15T12:29:40.598421+0000","last_became_active":"2024-09-15T12:28:39.074098+0000","last_became_peered":"2024-09-15T12:28:39.074098+0000","last_unstale":"2024-09-15T12:29:40.598421+0000","last_undegraded":"2024-09-15T12:29:40.598421+0000","last_fullsized":"2024-09-15T12:29:40.598421+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":761,"log_dups_size":0,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49872896,"num_objects":761,"num_object_clones":0,"num_object_copies":2283,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":761,"num_write_kb":48704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"86'799","reported_seq":811,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:29:40.750965+0000","last_change":"2024-09-15T12:28:39.061230+0000","last_active":"2024-09-15T12:29:40.750965+0000","last_peered":"2024-09-15T12:29:40.750965+0000","last_clean":"2024-09-15T12:29:40.750965+0000","last_became_active":"2024-09-15T12:28:39.046625+0000","last_became_peered":"2024-09-15T12:28:39.046625+0000","last_unstale":"2024-09-15T12:29:40.750965+0000","last_undegraded":"2024-09-15T12:29:40.750965+0000","last_fullsized":"2024-09-15T12:29:40.750965+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52363264,"num_objects":799,"num_object_clones":0,"num_object_copies":2397,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":799,"num_write_kb":51136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"86'759","reported_seq":771,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:29:41.647501+0000","last_change":"2024-09-15T12:28:39.043350+0000","last_active":"2024-09-15T12:29:41.647501+0000","last_peered":"2024-09-15T12:29:41.647501+0000","last_clean":"2024-09-15T12:29:41.647501+0000","last_became_active":"2024-09-15T12:28:39.034104+0000","last_became_peered":"2024-09-15T12:28:39.034104+0000","last_unstale":"2024-09-15T12:29:41.647501+0000","last_undegraded":"2024-09-15T12:29:41.647501+0000","last_fullsized":"2024-09-15T12:29:41.647501+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":759,"log_dups_size":0,"ondisk_log_size":759,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49741824,"num_objects":759,"num_object_clones":0,"num_object_copies":2277,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":759,"num_write_kb":48576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"86'808","reported_seq":820,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:29:40.674279+0000","last_change":"2024-09-15T12:28:39.083865+0000","last_active":"2024-09-15T12:29:40.674279+0000","last_peered":"2024-09-15T12:29:40.674279+0000","last_clean":"2024-09-15T12:29:40.674279+0000","last_became_active":"2024-09-15T12:28:39.075263+0000","last_became_peered":"2024-09-15T12:28:39.075263+0000","last_unstale":"2024-09-15T12:29:40.674279+0000","last_undegraded":"2024-09-15T12:29:40.674279+0000","last_fullsized":"2024-09-15T12:29:40.674279+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52953088,"num_objects":808,"num_object_clones":0,"num_object_copies":2424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":808,"num_write_kb":51712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"86'739","reported_seq":751,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:29:40.714884+0000","last_change":"2024-09-15T12:28:39.031088+0000","last_active":"2024-09-15T12:29:40.714884+0000","last_peered":"2024-09-15T12:29:40.714884+0000","last_clean":"2024-09-15T12:29:40.714884+0000","last_became_active":"2024-09-15T12:28:39.025037+0000","last_became_peered":"2024-09-15T12:28:39.025037+0000","last_unstale":"2024-09-15T12:29:40.714884+0000","last_undegraded":"2024-09-15T12:29:40.714884+0000","last_fullsized":"2024-09-15T12:29:40.714884+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":739,"log_dups_size":0,"ondisk_log_size":739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48431104,"num_objects":739,"num_object_clones":0,"num_object_copies":2217,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":739,"num_write_kb":47296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"86'798","reported_seq":810,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:29:41.760131+0000","last_change":"2024-09-15T12:28:39.067539+0000","last_active":"2024-09-15T12:29:41.760131+0000","last_peered":"2024-09-15T12:29:41.760131+0000","last_clean":"2024-09-15T12:29:41.760131+0000","last_became_active":"2024-09-15T12:28:39.054389+0000","last_became_peered":"2024-09-15T12:28:39.054389+0000","last_unstale":"2024-09-15T12:29:41.760131+0000","last_undegraded":"2024-09-15T12:29:41.760131+0000","last_fullsized":"2024-09-15T12:29:41.760131+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52297728,"num_objects":798,"num_object_clones":0,"num_object_copies":2394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":798,"num_write_kb":51072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"86'756","reported_seq":768,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:29:40.744495+0000","last_change":"2024-09-15T12:28:38.993796+0000","last_active":"2024-09-15T12:29:40.744495+0000","last_peered":"2024-09-15T12:29:40.744495+0000","last_clean":"2024-09-15T12:29:40.744495+0000","last_became_active":"2024-09-15T12:28:38.987121+0000","last_became_peered":"2024-09-15T12:28:38.987121+0000","last_unstale":"2024-09-15T12:29:40.744495+0000","last_undegraded":"2024-09-15T12:29:40.744495+0000","last_fullsized":"2024-09-15T12:29:40.744495+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":756,"log_dups_size":0,"ondisk_log_size":756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49545216,"num_objects":756,"num_object_clones":0,"num_object_copies":2268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":756,"num_write_kb":48384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"86'761","reported_seq":773,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:29:40.550135+0000","last_change":"2024-09-15T12:28:39.047799+0000","last_active":"2024-09-15T12:29:40.550135+0000","last_peered":"2024-09-15T12:29:40.550135+0000","last_clean":"2024-09-15T12:29:40.550135+0000","last_became_active":"2024-09-15T12:28:39.017997+0000","last_became_peered":"2024-09-15T12:28:39.017997+0000","last_unstale":"2024-09-15T12:29:40.550135+0000","last_undegraded":"2024-09-15T12:29:40.550135+0000","last_fullsized":"2024-09-15T12:29:40.550135+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":761,"log_dups_size":0,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49872896,"num_objects":761,"num_object_clones":0,"num_object_copies":2283,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":761,"num_write_kb":48704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":301,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.902781+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:28:39.902781+0000","last_peered":"2024-09-15T12:28:39.902781+0000","last_clean":"2024-09-15T12:28:39.902781+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:28:39.902781+0000","last_undegraded":"2024-09-15T12:28:39.902781+0000","last_fullsized":"2024-09-15T12:28:39.902781+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":230,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.911586+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:28:39.911586+0000","last_peered":"2024-09-15T12:28:39.911586+0000","last_clean":"2024-09-15T12:28:39.911586+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:28:39.911586+0000","last_undegraded":"2024-09-15T12:28:39.911586+0000","last_fullsized":"2024-09-15T12:28:39.911586+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"86'777","reported_seq":789,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:29:41.751681+0000","last_change":"2024-09-15T12:28:39.071985+0000","last_active":"2024-09-15T12:29:41.751681+0000","last_peered":"2024-09-15T12:29:41.751681+0000","last_clean":"2024-09-15T12:29:41.751681+0000","last_became_active":"2024-09-15T12:28:39.061062+0000","last_became_peered":"2024-09-15T12:28:39.061062+0000","last_unstale":"2024-09-15T12:29:41.751681+0000","last_undegraded":"2024-09-15T12:29:41.751681+0000","last_fullsized":"2024-09-15T12:29:41.751681+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50921472,"num_objects":777,"num_object_clones":0,"num_object_copies":2331,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":777,"num_write_kb":49728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.910978+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:28:39.910978+0000","last_peered":"2024-09-15T12:28:39.910978+0000","last_clean":"2024-09-15T12:28:39.910978+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:28:39.910978+0000","last_undegraded":"2024-09-15T12:28:39.910978+0000","last_fullsized":"2024-09-15T12:28:39.910978+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"86'785","reported_seq":797,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:29:40.714420+0000","last_change":"2024-09-15T12:28:39.025429+0000","last_active":"2024-09-15T12:29:40.714420+0000","last_peered":"2024-09-15T12:29:40.714420+0000","last_clean":"2024-09-15T12:29:40.714420+0000","last_became_active":"2024-09-15T12:28:39.007673+0000","last_became_peered":"2024-09-15T12:28:39.007673+0000","last_unstale":"2024-09-15T12:29:40.714420+0000","last_undegraded":"2024-09-15T12:29:40.714420+0000","last_fullsized":"2024-09-15T12:29:40.714420+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51445760,"num_objects":785,"num_object_clones":0,"num_object_copies":2355,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":785,"num_write_kb":50240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.905410+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:28:39.905410+0000","last_peered":"2024-09-15T12:28:39.905410+0000","last_clean":"2024-09-15T12:28:39.905410+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:28:39.905410+0000","last_undegraded":"2024-09-15T12:28:39.905410+0000","last_fullsized":"2024-09-15T12:28:39.905410+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"86'780","reported_seq":792,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:29:41.780226+0000","last_change":"2024-09-15T12:28:39.029713+0000","last_active":"2024-09-15T12:29:41.780226+0000","last_peered":"2024-09-15T12:29:41.780226+0000","last_clean":"2024-09-15T12:29:41.780226+0000","last_became_active":"2024-09-15T12:28:39.020975+0000","last_became_peered":"2024-09-15T12:28:39.020975+0000","last_unstale":"2024-09-15T12:29:41.780226+0000","last_undegraded":"2024-09-15T12:29:41.780226+0000","last_fullsized":"2024-09-15T12:29:41.780226+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51118080,"num_objects":780,"num_object_clones":0,"num_object_copies":2340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":780,"num_write_kb":49920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":231,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.904865+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:28:39.904865+0000","last_peered":"2024-09-15T12:28:39.904865+0000","last_clean":"2024-09-15T12:28:39.904865+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:28:39.904865+0000","last_undegraded":"2024-09-15T12:28:39.904865+0000","last_fullsized":"2024-09-15T12:28:39.904865+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"86'766","reported_seq":778,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:29:40.549965+0000","last_change":"2024-09-15T12:28:39.023135+0000","last_active":"2024-09-15T12:29:40.549965+0000","last_peered":"2024-09-15T12:29:40.549965+0000","last_clean":"2024-09-15T12:29:40.549965+0000","last_became_active":"2024-09-15T12:28:39.014305+0000","last_became_peered":"2024-09-15T12:28:39.014305+0000","last_unstale":"2024-09-15T12:29:40.549965+0000","last_undegraded":"2024-09-15T12:29:40.549965+0000","last_fullsized":"2024-09-15T12:29:40.549965+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":766,"log_dups_size":0,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50200576,"num_objects":766,"num_object_clones":0,"num_object_copies":2298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":766,"num_write_kb":49024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.907958+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:28:39.907958+0000","last_peered":"2024-09-15T12:28:39.907958+0000","last_clean":"2024-09-15T12:28:39.907958+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:28:39.907958+0000","last_undegraded":"2024-09-15T12:28:39.907958+0000","last_fullsized":"2024-09-15T12:28:39.907958+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"86'824","reported_seq":836,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:29:40.722506+0000","last_change":"2024-09-15T12:28:39.054857+0000","last_active":"2024-09-15T12:29:40.722506+0000","last_peered":"2024-09-15T12:29:40.722506+0000","last_clean":"2024-09-15T12:29:40.722506+0000","last_became_active":"2024-09-15T12:28:39.046395+0000","last_became_peered":"2024-09-15T12:28:39.046395+0000","last_unstale":"2024-09-15T12:29:40.722506+0000","last_undegraded":"2024-09-15T12:29:40.722506+0000","last_fullsized":"2024-09-15T12:29:40.722506+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54001664,"num_objects":824,"num_object_clones":0,"num_object_copies":2472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":824,"num_write_kb":52736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.907938+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:28:39.907938+0000","last_peered":"2024-09-15T12:28:39.907938+0000","last_clean":"2024-09-15T12:28:39.907938+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:28:39.907938+0000","last_undegraded":"2024-09-15T12:28:39.907938+0000","last_fullsized":"2024-09-15T12:28:39.907938+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"86'821","reported_seq":833,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:29:40.562815+0000","last_change":"2024-09-15T12:28:39.052760+0000","last_active":"2024-09-15T12:29:40.562815+0000","last_peered":"2024-09-15T12:29:40.562815+0000","last_clean":"2024-09-15T12:29:40.562815+0000","last_became_active":"2024-09-15T12:28:39.041365+0000","last_became_peered":"2024-09-15T12:28:39.041365+0000","last_unstale":"2024-09-15T12:29:40.562815+0000","last_undegraded":"2024-09-15T12:29:40.562815+0000","last_fullsized":"2024-09-15T12:29:40.562815+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53805056,"num_objects":821,"num_object_clones":0,"num_object_copies":2463,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":821,"num_write_kb":52544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.906843+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:28:39.906843+0000","last_peered":"2024-09-15T12:28:39.906843+0000","last_clean":"2024-09-15T12:28:39.906843+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:28:39.906843+0000","last_undegraded":"2024-09-15T12:28:39.906843+0000","last_fullsized":"2024-09-15T12:28:39.906843+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"86'746","reported_seq":758,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:29:40.712418+0000","last_change":"2024-09-15T12:28:39.046988+0000","last_active":"2024-09-15T12:29:40.712418+0000","last_peered":"2024-09-15T12:29:40.712418+0000","last_clean":"2024-09-15T12:29:40.712418+0000","last_became_active":"2024-09-15T12:28:39.017167+0000","last_became_peered":"2024-09-15T12:28:39.017167+0000","last_unstale":"2024-09-15T12:29:40.712418+0000","last_undegraded":"2024-09-15T12:29:40.712418+0000","last_fullsized":"2024-09-15T12:29:40.712418+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":746,"log_dups_size":0,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48889856,"num_objects":746,"num_object_clones":0,"num_object_copies":2238,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":746,"num_write_kb":47744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.914018+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:28:39.914018+0000","last_peered":"2024-09-15T12:28:39.914018+0000","last_clean":"2024-09-15T12:28:39.914018+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:28:39.914018+0000","last_undegraded":"2024-09-15T12:28:39.914018+0000","last_fullsized":"2024-09-15T12:28:39.914018+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":816513024,"num_objects":12459,"num_object_clones":0,"num_object_copies":37377,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12459,"num_write_kb":797376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":152981504,"data_stored":2447704064,"data_compressed":116226755,"data_compressed_allocated":152981504,"data_compressed_original":2447704064,"omap_allocated":0,"internal_metadata":0},"log_size":12459,"ondisk_log_size":12459,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673618,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":142308,"kb_used_data":34960,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94229532,"statfs":{"total":96636764160,"available":96491040768,"internally_reserved":0,"allocated":35799040,"data_stored":561128152,"data_compressed":26633794,"data_compressed_allocated":35057664,"data_compressed_original":560840704,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706322,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":133820,"kb_used_data":34796,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94238020,"statfs":{"total":96636764160,"available":96499732480,"internally_reserved":0,"allocated":35631104,"data_stored":558375659,"data_compressed":26503040,"data_compressed_allocated":34885632,"data_compressed_original":558088192,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706322,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":139792,"kb_used_data":40768,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94232048,"statfs":{"total":96636764160,"available":96493617152,"internally_reserved":0,"allocated":41746432,"data_stored":656613579,"data_compressed":31165778,"data_compressed_allocated":41021440,"data_compressed_original":656343040,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706322,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":148164,"kb_used_data":40820,"kb_used_omap":0,"kb_used_meta":107328,"kb_avail":94223676,"statfs":{"total":96636764160,"available":96485044224,"internally_reserved":0,"allocated":41799680,"data_stored":657072875,"data_compressed":31189559,"data_compressed_allocated":41054208,"data_compressed_original":656785408,"omap_allocated":0,"internal_metadata":109903872},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41222144,"data_stored":659554304,"data_compressed":31318239,"data_compressed_allocated":41222144,"data_compressed_original":659554304,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41361408,"data_stored":661782528,"data_compressed":31424074,"data_compressed_allocated":41361408,"data_compressed_original":661782528,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":35123200,"data_stored":561971200,"data_compressed":26684624,"data_compressed_allocated":35123200,"data_compressed_original":561971200,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35274752,"data_stored":564396032,"data_compressed":26799818,"data_compressed_allocated":35274752,"data_compressed_original":564396032,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:30:07.026 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 87 16 17244 17228 12.3753 11.5 0.0836577 0.0807594 2024-09-15T12:30:07.517 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:30:07.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:07.667+0000 7fe4e1791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:07.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:07.677+0000 7fe4e1791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:08.026 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 88 16 17422 17406 12.3611 11.125 0.0739448 0.0808388 2024-09-15T12:30:09.027 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 89 16 17603 17587 12.3493 11.3125 0.051271 0.0809379 2024-09-15T12:30:10.026 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 90 15 17775 17760 12.3322 10.8125 0.0614573 0.081027 2024-09-15T12:30:10.101 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:30:10.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:10.203+0000 7f4e67893640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:10.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:10.209+0000 7f4e67893640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:11.027 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Total time run: 90.0681 2024-09-15T12:30:11.027 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Total writes made: 17775 2024-09-15T12:30:11.027 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Write size: 65536 2024-09-15T12:30:11.027 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Object size: 65536 2024-09-15T12:30:11.027 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Bandwidth (MB/sec): 12.3344 2024-09-15T12:30:11.027 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Stddev Bandwidth: 0.854546 2024-09-15T12:30:11.027 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Max bandwidth (MB/sec): 14.4375 2024-09-15T12:30:11.027 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Min bandwidth (MB/sec): 10.8125 2024-09-15T12:30:11.027 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Average IOPS: 197 2024-09-15T12:30:11.027 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Stddev IOPS: 13.6727 2024-09-15T12:30:11.027 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Max IOPS: 231 2024-09-15T12:30:11.028 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Min IOPS: 173 2024-09-15T12:30:11.028 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Average Latency(s): 0.0810477 2024-09-15T12:30:11.028 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Stddev Latency(s): 0.0268628 2024-09-15T12:30:11.028 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Max latency(s): 0.21975 2024-09-15T12:30:11.028 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Min latency(s): 0.0166562 2024-09-15T12:30:11.055 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Cleaning up (deleting benchmark objects) 2024-09-15T12:30:11.811 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:30:11.811 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:30:11.811 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:30:11.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:11.975+0000 7fdf75d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:11.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:11.986+0000 7fdf75d11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:12.239 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:30:12.239 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:30:12.256 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":424,"stamp":"2024-09-15T12:30:11.839034+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1162805811,"num_objects":17738,"num_object_clones":0,"num_object_copies":53214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":17897,"num_write_kb":1138708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17871,"ondisk_log_size":17871,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":681616,"kb_used_data":216144,"kb_used_omap":0,"kb_used_meta":465408,"kb_avail":376805744,"statfs":{"total":386547056640,"available":385849081856,"internally_reserved":0,"allocated":221331456,"data_stored":3494807953,"data_compressed":165903550,"data_compressed_allocated":218370048,"data_compressed_original":3493675008,"omap_allocated":0,"internal_metadata":476577792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":345702400,"num_objects":5275,"num_object_clones":0,"num_object_copies":15825,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5357,"num_write_kb":340224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002294"},"pg_stats":[{"pgid":"6.f","version":"86'1118","reported_seq":1130,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.701703+0000","last_change":"2024-09-15T12:28:39.077376+0000","last_active":"2024-09-15T12:30:09.701703+0000","last_peered":"2024-09-15T12:30:09.701703+0000","last_clean":"2024-09-15T12:30:09.701703+0000","last_became_active":"2024-09-15T12:28:39.068998+0000","last_became_peered":"2024-09-15T12:28:39.068998+0000","last_unstale":"2024-09-15T12:30:09.701703+0000","last_undegraded":"2024-09-15T12:30:09.701703+0000","last_fullsized":"2024-09-15T12:30:09.701703+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1118,"log_dups_size":0,"ondisk_log_size":1118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73269248,"num_objects":1118,"num_object_clones":0,"num_object_copies":3354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1118,"num_write_kb":71552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"86'1121","reported_seq":1133,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.899034+0000","last_change":"2024-09-15T12:28:39.087809+0000","last_active":"2024-09-15T12:30:09.899034+0000","last_peered":"2024-09-15T12:30:09.899034+0000","last_clean":"2024-09-15T12:30:09.899034+0000","last_became_active":"2024-09-15T12:28:39.074098+0000","last_became_peered":"2024-09-15T12:28:39.074098+0000","last_unstale":"2024-09-15T12:30:09.899034+0000","last_undegraded":"2024-09-15T12:30:09.899034+0000","last_fullsized":"2024-09-15T12:30:09.899034+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1121,"log_dups_size":0,"ondisk_log_size":1121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73465856,"num_objects":1121,"num_object_clones":0,"num_object_copies":3363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1121,"num_write_kb":71744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"86'1145","reported_seq":1157,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.948179+0000","last_change":"2024-09-15T12:28:39.061230+0000","last_active":"2024-09-15T12:30:09.948179+0000","last_peered":"2024-09-15T12:30:09.948179+0000","last_clean":"2024-09-15T12:30:09.948179+0000","last_became_active":"2024-09-15T12:28:39.046625+0000","last_became_peered":"2024-09-15T12:28:39.046625+0000","last_unstale":"2024-09-15T12:30:09.948179+0000","last_undegraded":"2024-09-15T12:30:09.948179+0000","last_fullsized":"2024-09-15T12:30:09.948179+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1145,"log_dups_size":0,"ondisk_log_size":1145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75038720,"num_objects":1145,"num_object_clones":0,"num_object_copies":3435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1145,"num_write_kb":73280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"86'1097","reported_seq":1109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:11.728321+0000","last_change":"2024-09-15T12:28:39.043350+0000","last_active":"2024-09-15T12:30:11.728321+0000","last_peered":"2024-09-15T12:30:11.728321+0000","last_clean":"2024-09-15T12:30:11.728321+0000","last_became_active":"2024-09-15T12:28:39.034104+0000","last_became_peered":"2024-09-15T12:28:39.034104+0000","last_unstale":"2024-09-15T12:30:11.728321+0000","last_undegraded":"2024-09-15T12:30:11.728321+0000","last_fullsized":"2024-09-15T12:30:11.728321+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1097,"log_dups_size":0,"ondisk_log_size":1097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70713344,"num_objects":1079,"num_object_clones":0,"num_object_copies":3237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1097,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"86'1151","reported_seq":1163,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.833571+0000","last_change":"2024-09-15T12:28:39.083865+0000","last_active":"2024-09-15T12:30:09.833571+0000","last_peered":"2024-09-15T12:30:09.833571+0000","last_clean":"2024-09-15T12:30:09.833571+0000","last_became_active":"2024-09-15T12:28:39.075263+0000","last_became_peered":"2024-09-15T12:28:39.075263+0000","last_unstale":"2024-09-15T12:30:09.833571+0000","last_undegraded":"2024-09-15T12:30:09.833571+0000","last_fullsized":"2024-09-15T12:30:09.833571+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1151,"log_dups_size":0,"ondisk_log_size":1151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75431936,"num_objects":1151,"num_object_clones":0,"num_object_copies":3453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":73664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"86'1071","reported_seq":1083,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.570714+0000","last_change":"2024-09-15T12:28:39.031088+0000","last_active":"2024-09-15T12:30:09.570714+0000","last_peered":"2024-09-15T12:30:09.570714+0000","last_clean":"2024-09-15T12:30:09.570714+0000","last_became_active":"2024-09-15T12:28:39.025037+0000","last_became_peered":"2024-09-15T12:28:39.025037+0000","last_unstale":"2024-09-15T12:30:09.570714+0000","last_undegraded":"2024-09-15T12:30:09.570714+0000","last_fullsized":"2024-09-15T12:30:09.570714+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1071,"log_dups_size":0,"ondisk_log_size":1071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70189056,"num_objects":1071,"num_object_clones":0,"num_object_copies":3213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1071,"num_write_kb":68544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"86'1125","reported_seq":1137,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:11.679756+0000","last_change":"2024-09-15T12:28:39.067539+0000","last_active":"2024-09-15T12:30:11.679756+0000","last_peered":"2024-09-15T12:30:11.679756+0000","last_clean":"2024-09-15T12:30:11.679756+0000","last_became_active":"2024-09-15T12:28:39.054389+0000","last_became_peered":"2024-09-15T12:28:39.054389+0000","last_unstale":"2024-09-15T12:30:11.679756+0000","last_undegraded":"2024-09-15T12:30:11.679756+0000","last_fullsized":"2024-09-15T12:30:11.679756+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1125,"log_dups_size":0,"ondisk_log_size":1125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72286208,"num_objects":1103,"num_object_clones":0,"num_object_copies":3309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1125,"num_write_kb":71296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"86'1090","reported_seq":1102,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.912891+0000","last_change":"2024-09-15T12:28:38.993796+0000","last_active":"2024-09-15T12:30:09.912891+0000","last_peered":"2024-09-15T12:30:09.912891+0000","last_clean":"2024-09-15T12:30:09.912891+0000","last_became_active":"2024-09-15T12:28:38.987121+0000","last_became_peered":"2024-09-15T12:28:38.987121+0000","last_unstale":"2024-09-15T12:30:09.912891+0000","last_undegraded":"2024-09-15T12:30:09.912891+0000","last_fullsized":"2024-09-15T12:30:09.912891+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1090,"log_dups_size":0,"ondisk_log_size":1090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71434240,"num_objects":1090,"num_object_clones":0,"num_object_copies":3270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1090,"num_write_kb":69760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"86'1109","reported_seq":1121,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.883911+0000","last_change":"2024-09-15T12:28:39.047799+0000","last_active":"2024-09-15T12:30:09.883911+0000","last_peered":"2024-09-15T12:30:09.883911+0000","last_clean":"2024-09-15T12:30:09.883911+0000","last_became_active":"2024-09-15T12:28:39.017997+0000","last_became_peered":"2024-09-15T12:28:39.017997+0000","last_unstale":"2024-09-15T12:30:09.883911+0000","last_undegraded":"2024-09-15T12:30:09.883911+0000","last_fullsized":"2024-09-15T12:30:09.883911+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1109,"log_dups_size":0,"ondisk_log_size":1109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72679424,"num_objects":1109,"num_object_clones":0,"num_object_copies":3327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1109,"num_write_kb":70976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":301,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.902781+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:28:39.902781+0000","last_peered":"2024-09-15T12:28:39.902781+0000","last_clean":"2024-09-15T12:28:39.902781+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:28:39.902781+0000","last_undegraded":"2024-09-15T12:28:39.902781+0000","last_fullsized":"2024-09-15T12:28:39.902781+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":230,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.911586+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:28:39.911586+0000","last_peered":"2024-09-15T12:28:39.911586+0000","last_clean":"2024-09-15T12:28:39.911586+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:28:39.911586+0000","last_undegraded":"2024-09-15T12:28:39.911586+0000","last_fullsized":"2024-09-15T12:28:39.911586+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"86'1102","reported_seq":1114,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:11.798472+0000","last_change":"2024-09-15T12:28:39.071985+0000","last_active":"2024-09-15T12:30:11.798472+0000","last_peered":"2024-09-15T12:30:11.798472+0000","last_clean":"2024-09-15T12:30:11.798472+0000","last_became_active":"2024-09-15T12:28:39.061062+0000","last_became_peered":"2024-09-15T12:28:39.061062+0000","last_unstale":"2024-09-15T12:30:11.798472+0000","last_undegraded":"2024-09-15T12:30:11.798472+0000","last_fullsized":"2024-09-15T12:30:11.798472+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1102,"log_dups_size":0,"ondisk_log_size":1102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70516736,"num_objects":1076,"num_object_clones":0,"num_object_copies":3228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1102,"num_write_kb":69696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.910978+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:28:39.910978+0000","last_peered":"2024-09-15T12:28:39.910978+0000","last_clean":"2024-09-15T12:28:39.910978+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:28:39.910978+0000","last_undegraded":"2024-09-15T12:28:39.910978+0000","last_fullsized":"2024-09-15T12:28:39.910978+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"86'1124","reported_seq":1136,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.702283+0000","last_change":"2024-09-15T12:28:39.025429+0000","last_active":"2024-09-15T12:30:09.702283+0000","last_peered":"2024-09-15T12:30:09.702283+0000","last_clean":"2024-09-15T12:30:09.702283+0000","last_became_active":"2024-09-15T12:28:39.007673+0000","last_became_peered":"2024-09-15T12:28:39.007673+0000","last_unstale":"2024-09-15T12:30:09.702283+0000","last_undegraded":"2024-09-15T12:30:09.702283+0000","last_fullsized":"2024-09-15T12:30:09.702283+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1124,"log_dups_size":0,"ondisk_log_size":1124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73662464,"num_objects":1124,"num_object_clones":0,"num_object_copies":3372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1124,"num_write_kb":71936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.905410+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:28:39.905410+0000","last_peered":"2024-09-15T12:28:39.905410+0000","last_clean":"2024-09-15T12:28:39.905410+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:28:39.905410+0000","last_undegraded":"2024-09-15T12:28:39.905410+0000","last_fullsized":"2024-09-15T12:28:39.905410+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"86'1115","reported_seq":1127,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:11.663289+0000","last_change":"2024-09-15T12:28:39.029713+0000","last_active":"2024-09-15T12:30:11.663289+0000","last_peered":"2024-09-15T12:30:11.663289+0000","last_clean":"2024-09-15T12:30:11.663289+0000","last_became_active":"2024-09-15T12:28:39.020975+0000","last_became_peered":"2024-09-15T12:28:39.020975+0000","last_unstale":"2024-09-15T12:30:11.663289+0000","last_undegraded":"2024-09-15T12:30:11.663289+0000","last_fullsized":"2024-09-15T12:30:11.663289+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1115,"log_dups_size":0,"ondisk_log_size":1115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72024064,"num_objects":1099,"num_object_clones":0,"num_object_copies":3297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1115,"num_write_kb":70848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":231,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.904865+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:28:39.904865+0000","last_peered":"2024-09-15T12:28:39.904865+0000","last_clean":"2024-09-15T12:28:39.904865+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:28:39.904865+0000","last_undegraded":"2024-09-15T12:28:39.904865+0000","last_fullsized":"2024-09-15T12:28:39.904865+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"86'1085","reported_seq":1097,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.969950+0000","last_change":"2024-09-15T12:28:39.023135+0000","last_active":"2024-09-15T12:30:09.969950+0000","last_peered":"2024-09-15T12:30:09.969950+0000","last_clean":"2024-09-15T12:30:09.969950+0000","last_became_active":"2024-09-15T12:28:39.014305+0000","last_became_peered":"2024-09-15T12:28:39.014305+0000","last_unstale":"2024-09-15T12:30:09.969950+0000","last_undegraded":"2024-09-15T12:30:09.969950+0000","last_fullsized":"2024-09-15T12:30:09.969950+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1085,"log_dups_size":0,"ondisk_log_size":1085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71106560,"num_objects":1085,"num_object_clones":0,"num_object_copies":3255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1085,"num_write_kb":69440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.907958+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:28:39.907958+0000","last_peered":"2024-09-15T12:28:39.907958+0000","last_clean":"2024-09-15T12:28:39.907958+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:28:39.907958+0000","last_undegraded":"2024-09-15T12:28:39.907958+0000","last_fullsized":"2024-09-15T12:28:39.907958+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"86'1165","reported_seq":1177,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.813115+0000","last_change":"2024-09-15T12:28:39.054857+0000","last_active":"2024-09-15T12:30:09.813115+0000","last_peered":"2024-09-15T12:30:09.813115+0000","last_clean":"2024-09-15T12:30:09.813115+0000","last_became_active":"2024-09-15T12:28:39.046395+0000","last_became_peered":"2024-09-15T12:28:39.046395+0000","last_unstale":"2024-09-15T12:30:09.813115+0000","last_undegraded":"2024-09-15T12:30:09.813115+0000","last_fullsized":"2024-09-15T12:30:09.813115+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1165,"log_dups_size":0,"ondisk_log_size":1165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76349440,"num_objects":1165,"num_object_clones":0,"num_object_copies":3495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1165,"num_write_kb":74560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.907938+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:28:39.907938+0000","last_peered":"2024-09-15T12:28:39.907938+0000","last_clean":"2024-09-15T12:28:39.907938+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:28:39.907938+0000","last_undegraded":"2024-09-15T12:28:39.907938+0000","last_fullsized":"2024-09-15T12:28:39.907938+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"86'1156","reported_seq":1168,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.732716+0000","last_change":"2024-09-15T12:28:39.052760+0000","last_active":"2024-09-15T12:30:09.732716+0000","last_peered":"2024-09-15T12:30:09.732716+0000","last_clean":"2024-09-15T12:30:09.732716+0000","last_became_active":"2024-09-15T12:28:39.041365+0000","last_became_peered":"2024-09-15T12:28:39.041365+0000","last_unstale":"2024-09-15T12:30:09.732716+0000","last_undegraded":"2024-09-15T12:30:09.732716+0000","last_fullsized":"2024-09-15T12:30:09.732716+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1156,"log_dups_size":0,"ondisk_log_size":1156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75759616,"num_objects":1156,"num_object_clones":0,"num_object_copies":3468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":73984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.906843+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:28:39.906843+0000","last_peered":"2024-09-15T12:28:39.906843+0000","last_clean":"2024-09-15T12:28:39.906843+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:28:39.906843+0000","last_undegraded":"2024-09-15T12:28:39.906843+0000","last_fullsized":"2024-09-15T12:28:39.906843+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"86'1042","reported_seq":1054,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.944858+0000","last_change":"2024-09-15T12:28:39.046988+0000","last_active":"2024-09-15T12:30:09.944858+0000","last_peered":"2024-09-15T12:30:09.944858+0000","last_clean":"2024-09-15T12:30:09.944858+0000","last_became_active":"2024-09-15T12:28:39.017167+0000","last_became_peered":"2024-09-15T12:28:39.017167+0000","last_unstale":"2024-09-15T12:30:09.944858+0000","last_undegraded":"2024-09-15T12:30:09.944858+0000","last_fullsized":"2024-09-15T12:30:09.944858+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1042,"log_dups_size":0,"ondisk_log_size":1042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68288512,"num_objects":1042,"num_object_clones":0,"num_object_copies":3126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1042,"num_write_kb":66688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.914018+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:28:39.914018+0000","last_peered":"2024-09-15T12:28:39.914018+0000","last_clean":"2024-09-15T12:28:39.914018+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:28:39.914018+0000","last_undegraded":"2024-09-15T12:28:39.914018+0000","last_fullsized":"2024-09-15T12:28:39.914018+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":1162215424,"num_objects":17734,"num_object_clones":0,"num_object_copies":53202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17816,"num_write_kb":1137600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":218001408,"data_stored":3487957016,"data_compressed":165623700,"data_compressed_allocated":217997312,"data_compressed_original":3487956992,"omap_allocated":0,"internal_metadata":0},"log_size":17816,"ondisk_log_size":17816,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673648,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":174568,"kb_used_data":49176,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94197272,"statfs":{"total":96636764160,"available":96458006528,"internally_reserved":0,"allocated":50356224,"data_stored":793977584,"data_compressed":37690821,"data_compressed_allocated":49610752,"data_compressed_original":793690112,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706352,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":165564,"kb_used_data":49900,"kb_used_omap":0,"kb_used_meta":115648,"kb_avail":94206276,"statfs":{"total":96636764160,"available":96467226624,"internally_reserved":0,"allocated":51097600,"data_stored":805839595,"data_compressed":38253952,"data_compressed_allocated":50352128,"data_compressed_original":805552128,"omap_allocated":0,"internal_metadata":118423552},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706352,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":157636,"kb_used_data":58612,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94214204,"statfs":{"total":96636764160,"available":96475344896,"internally_reserved":0,"allocated":60018688,"data_stored":948969675,"data_compressed":45048410,"data_compressed_allocated":59293696,"data_compressed_original":948699136,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706352,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":183848,"kb_used_data":58456,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94187992,"statfs":{"total":96636764160,"available":96448503808,"internally_reserved":0,"allocated":59858944,"data_stored":946021099,"data_compressed":44910367,"data_compressed_allocated":59113472,"data_compressed_original":945733632,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":59072512,"data_stored":945160192,"data_compressed":44880335,"data_compressed_allocated":59072512,"data_compressed_original":945160192,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":59293696,"data_stored":948699136,"data_compressed":45048410,"data_compressed_allocated":59293696,"data_compressed_original":948699136,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":50311168,"data_stored":804978688,"data_compressed":38223920,"data_compressed_allocated":50311168,"data_compressed_original":804978688,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49324032,"data_stored":789119000,"data_compressed":37471035,"data_compressed_allocated":49319936,"data_compressed_original":789118976,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:30:12.312 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:30:12.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:12.448+0000 7fcdd9b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:12.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:12.457+0000 7fcdd9b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:15.187 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:30:15.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:15.339+0000 7f04dcf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:15.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:15.346+0000 7f04dcf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:17.258 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:30:17.259 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:30:17.259 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:30:17.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:17.428+0000 7f8ed6f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:17.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:17.447+0000 7f8ed6f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:17.821 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:30:17.821 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:30:17.844 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":426,"stamp":"2024-09-15T12:30:15.839981+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1162805811,"num_objects":17738,"num_object_clones":0,"num_object_copies":53214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":17897,"num_write_kb":1138708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17871,"ondisk_log_size":17871,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":681616,"kb_used_data":216144,"kb_used_omap":0,"kb_used_meta":465408,"kb_avail":376805744,"statfs":{"total":386547056640,"available":385849081856,"internally_reserved":0,"allocated":221331456,"data_stored":3494807953,"data_compressed":165903550,"data_compressed_allocated":218370048,"data_compressed_original":3493675008,"omap_allocated":0,"internal_metadata":476577792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":345702400,"num_objects":5275,"num_object_clones":0,"num_object_copies":15825,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5357,"num_write_kb":340224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002466"},"pg_stats":[{"pgid":"6.f","version":"86'1118","reported_seq":1130,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.701703+0000","last_change":"2024-09-15T12:28:39.077376+0000","last_active":"2024-09-15T12:30:09.701703+0000","last_peered":"2024-09-15T12:30:09.701703+0000","last_clean":"2024-09-15T12:30:09.701703+0000","last_became_active":"2024-09-15T12:28:39.068998+0000","last_became_peered":"2024-09-15T12:28:39.068998+0000","last_unstale":"2024-09-15T12:30:09.701703+0000","last_undegraded":"2024-09-15T12:30:09.701703+0000","last_fullsized":"2024-09-15T12:30:09.701703+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1118,"log_dups_size":0,"ondisk_log_size":1118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73269248,"num_objects":1118,"num_object_clones":0,"num_object_copies":3354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1118,"num_write_kb":71552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"86'1121","reported_seq":1133,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.899034+0000","last_change":"2024-09-15T12:28:39.087809+0000","last_active":"2024-09-15T12:30:09.899034+0000","last_peered":"2024-09-15T12:30:09.899034+0000","last_clean":"2024-09-15T12:30:09.899034+0000","last_became_active":"2024-09-15T12:28:39.074098+0000","last_became_peered":"2024-09-15T12:28:39.074098+0000","last_unstale":"2024-09-15T12:30:09.899034+0000","last_undegraded":"2024-09-15T12:30:09.899034+0000","last_fullsized":"2024-09-15T12:30:09.899034+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1121,"log_dups_size":0,"ondisk_log_size":1121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73465856,"num_objects":1121,"num_object_clones":0,"num_object_copies":3363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1121,"num_write_kb":71744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"86'1145","reported_seq":1157,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.948179+0000","last_change":"2024-09-15T12:28:39.061230+0000","last_active":"2024-09-15T12:30:09.948179+0000","last_peered":"2024-09-15T12:30:09.948179+0000","last_clean":"2024-09-15T12:30:09.948179+0000","last_became_active":"2024-09-15T12:28:39.046625+0000","last_became_peered":"2024-09-15T12:28:39.046625+0000","last_unstale":"2024-09-15T12:30:09.948179+0000","last_undegraded":"2024-09-15T12:30:09.948179+0000","last_fullsized":"2024-09-15T12:30:09.948179+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1145,"log_dups_size":0,"ondisk_log_size":1145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75038720,"num_objects":1145,"num_object_clones":0,"num_object_copies":3435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1145,"num_write_kb":73280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"86'1097","reported_seq":1109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:11.728321+0000","last_change":"2024-09-15T12:28:39.043350+0000","last_active":"2024-09-15T12:30:11.728321+0000","last_peered":"2024-09-15T12:30:11.728321+0000","last_clean":"2024-09-15T12:30:11.728321+0000","last_became_active":"2024-09-15T12:28:39.034104+0000","last_became_peered":"2024-09-15T12:28:39.034104+0000","last_unstale":"2024-09-15T12:30:11.728321+0000","last_undegraded":"2024-09-15T12:30:11.728321+0000","last_fullsized":"2024-09-15T12:30:11.728321+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1097,"log_dups_size":0,"ondisk_log_size":1097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70713344,"num_objects":1079,"num_object_clones":0,"num_object_copies":3237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1097,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"86'1151","reported_seq":1163,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.833571+0000","last_change":"2024-09-15T12:28:39.083865+0000","last_active":"2024-09-15T12:30:09.833571+0000","last_peered":"2024-09-15T12:30:09.833571+0000","last_clean":"2024-09-15T12:30:09.833571+0000","last_became_active":"2024-09-15T12:28:39.075263+0000","last_became_peered":"2024-09-15T12:28:39.075263+0000","last_unstale":"2024-09-15T12:30:09.833571+0000","last_undegraded":"2024-09-15T12:30:09.833571+0000","last_fullsized":"2024-09-15T12:30:09.833571+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1151,"log_dups_size":0,"ondisk_log_size":1151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75431936,"num_objects":1151,"num_object_clones":0,"num_object_copies":3453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":73664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"86'1071","reported_seq":1083,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.570714+0000","last_change":"2024-09-15T12:28:39.031088+0000","last_active":"2024-09-15T12:30:09.570714+0000","last_peered":"2024-09-15T12:30:09.570714+0000","last_clean":"2024-09-15T12:30:09.570714+0000","last_became_active":"2024-09-15T12:28:39.025037+0000","last_became_peered":"2024-09-15T12:28:39.025037+0000","last_unstale":"2024-09-15T12:30:09.570714+0000","last_undegraded":"2024-09-15T12:30:09.570714+0000","last_fullsized":"2024-09-15T12:30:09.570714+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1071,"log_dups_size":0,"ondisk_log_size":1071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70189056,"num_objects":1071,"num_object_clones":0,"num_object_copies":3213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1071,"num_write_kb":68544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"86'1125","reported_seq":1137,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:11.679756+0000","last_change":"2024-09-15T12:28:39.067539+0000","last_active":"2024-09-15T12:30:11.679756+0000","last_peered":"2024-09-15T12:30:11.679756+0000","last_clean":"2024-09-15T12:30:11.679756+0000","last_became_active":"2024-09-15T12:28:39.054389+0000","last_became_peered":"2024-09-15T12:28:39.054389+0000","last_unstale":"2024-09-15T12:30:11.679756+0000","last_undegraded":"2024-09-15T12:30:11.679756+0000","last_fullsized":"2024-09-15T12:30:11.679756+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1125,"log_dups_size":0,"ondisk_log_size":1125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72286208,"num_objects":1103,"num_object_clones":0,"num_object_copies":3309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1125,"num_write_kb":71296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"86'1090","reported_seq":1102,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.912891+0000","last_change":"2024-09-15T12:28:38.993796+0000","last_active":"2024-09-15T12:30:09.912891+0000","last_peered":"2024-09-15T12:30:09.912891+0000","last_clean":"2024-09-15T12:30:09.912891+0000","last_became_active":"2024-09-15T12:28:38.987121+0000","last_became_peered":"2024-09-15T12:28:38.987121+0000","last_unstale":"2024-09-15T12:30:09.912891+0000","last_undegraded":"2024-09-15T12:30:09.912891+0000","last_fullsized":"2024-09-15T12:30:09.912891+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1090,"log_dups_size":0,"ondisk_log_size":1090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71434240,"num_objects":1090,"num_object_clones":0,"num_object_copies":3270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1090,"num_write_kb":69760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"86'1109","reported_seq":1121,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.883911+0000","last_change":"2024-09-15T12:28:39.047799+0000","last_active":"2024-09-15T12:30:09.883911+0000","last_peered":"2024-09-15T12:30:09.883911+0000","last_clean":"2024-09-15T12:30:09.883911+0000","last_became_active":"2024-09-15T12:28:39.017997+0000","last_became_peered":"2024-09-15T12:28:39.017997+0000","last_unstale":"2024-09-15T12:30:09.883911+0000","last_undegraded":"2024-09-15T12:30:09.883911+0000","last_fullsized":"2024-09-15T12:30:09.883911+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1109,"log_dups_size":0,"ondisk_log_size":1109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72679424,"num_objects":1109,"num_object_clones":0,"num_object_copies":3327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1109,"num_write_kb":70976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":301,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.902781+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:28:39.902781+0000","last_peered":"2024-09-15T12:28:39.902781+0000","last_clean":"2024-09-15T12:28:39.902781+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:28:39.902781+0000","last_undegraded":"2024-09-15T12:28:39.902781+0000","last_fullsized":"2024-09-15T12:28:39.902781+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":230,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.911586+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:28:39.911586+0000","last_peered":"2024-09-15T12:28:39.911586+0000","last_clean":"2024-09-15T12:28:39.911586+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:28:39.911586+0000","last_undegraded":"2024-09-15T12:28:39.911586+0000","last_fullsized":"2024-09-15T12:28:39.911586+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"86'1102","reported_seq":1114,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:11.798472+0000","last_change":"2024-09-15T12:28:39.071985+0000","last_active":"2024-09-15T12:30:11.798472+0000","last_peered":"2024-09-15T12:30:11.798472+0000","last_clean":"2024-09-15T12:30:11.798472+0000","last_became_active":"2024-09-15T12:28:39.061062+0000","last_became_peered":"2024-09-15T12:28:39.061062+0000","last_unstale":"2024-09-15T12:30:11.798472+0000","last_undegraded":"2024-09-15T12:30:11.798472+0000","last_fullsized":"2024-09-15T12:30:11.798472+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1102,"log_dups_size":0,"ondisk_log_size":1102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70516736,"num_objects":1076,"num_object_clones":0,"num_object_copies":3228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1102,"num_write_kb":69696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.910978+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:28:39.910978+0000","last_peered":"2024-09-15T12:28:39.910978+0000","last_clean":"2024-09-15T12:28:39.910978+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:28:39.910978+0000","last_undegraded":"2024-09-15T12:28:39.910978+0000","last_fullsized":"2024-09-15T12:28:39.910978+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"86'1124","reported_seq":1136,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.702283+0000","last_change":"2024-09-15T12:28:39.025429+0000","last_active":"2024-09-15T12:30:09.702283+0000","last_peered":"2024-09-15T12:30:09.702283+0000","last_clean":"2024-09-15T12:30:09.702283+0000","last_became_active":"2024-09-15T12:28:39.007673+0000","last_became_peered":"2024-09-15T12:28:39.007673+0000","last_unstale":"2024-09-15T12:30:09.702283+0000","last_undegraded":"2024-09-15T12:30:09.702283+0000","last_fullsized":"2024-09-15T12:30:09.702283+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1124,"log_dups_size":0,"ondisk_log_size":1124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73662464,"num_objects":1124,"num_object_clones":0,"num_object_copies":3372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1124,"num_write_kb":71936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.905410+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:28:39.905410+0000","last_peered":"2024-09-15T12:28:39.905410+0000","last_clean":"2024-09-15T12:28:39.905410+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:28:39.905410+0000","last_undegraded":"2024-09-15T12:28:39.905410+0000","last_fullsized":"2024-09-15T12:28:39.905410+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"86'1115","reported_seq":1127,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:11.663289+0000","last_change":"2024-09-15T12:28:39.029713+0000","last_active":"2024-09-15T12:30:11.663289+0000","last_peered":"2024-09-15T12:30:11.663289+0000","last_clean":"2024-09-15T12:30:11.663289+0000","last_became_active":"2024-09-15T12:28:39.020975+0000","last_became_peered":"2024-09-15T12:28:39.020975+0000","last_unstale":"2024-09-15T12:30:11.663289+0000","last_undegraded":"2024-09-15T12:30:11.663289+0000","last_fullsized":"2024-09-15T12:30:11.663289+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1115,"log_dups_size":0,"ondisk_log_size":1115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72024064,"num_objects":1099,"num_object_clones":0,"num_object_copies":3297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1115,"num_write_kb":70848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":231,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.904865+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:28:39.904865+0000","last_peered":"2024-09-15T12:28:39.904865+0000","last_clean":"2024-09-15T12:28:39.904865+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:28:39.904865+0000","last_undegraded":"2024-09-15T12:28:39.904865+0000","last_fullsized":"2024-09-15T12:28:39.904865+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"86'1085","reported_seq":1097,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.969950+0000","last_change":"2024-09-15T12:28:39.023135+0000","last_active":"2024-09-15T12:30:09.969950+0000","last_peered":"2024-09-15T12:30:09.969950+0000","last_clean":"2024-09-15T12:30:09.969950+0000","last_became_active":"2024-09-15T12:28:39.014305+0000","last_became_peered":"2024-09-15T12:28:39.014305+0000","last_unstale":"2024-09-15T12:30:09.969950+0000","last_undegraded":"2024-09-15T12:30:09.969950+0000","last_fullsized":"2024-09-15T12:30:09.969950+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1085,"log_dups_size":0,"ondisk_log_size":1085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71106560,"num_objects":1085,"num_object_clones":0,"num_object_copies":3255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1085,"num_write_kb":69440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.907958+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:28:39.907958+0000","last_peered":"2024-09-15T12:28:39.907958+0000","last_clean":"2024-09-15T12:28:39.907958+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:28:39.907958+0000","last_undegraded":"2024-09-15T12:28:39.907958+0000","last_fullsized":"2024-09-15T12:28:39.907958+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"86'1165","reported_seq":1177,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.813115+0000","last_change":"2024-09-15T12:28:39.054857+0000","last_active":"2024-09-15T12:30:09.813115+0000","last_peered":"2024-09-15T12:30:09.813115+0000","last_clean":"2024-09-15T12:30:09.813115+0000","last_became_active":"2024-09-15T12:28:39.046395+0000","last_became_peered":"2024-09-15T12:28:39.046395+0000","last_unstale":"2024-09-15T12:30:09.813115+0000","last_undegraded":"2024-09-15T12:30:09.813115+0000","last_fullsized":"2024-09-15T12:30:09.813115+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1165,"log_dups_size":0,"ondisk_log_size":1165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76349440,"num_objects":1165,"num_object_clones":0,"num_object_copies":3495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1165,"num_write_kb":74560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.907938+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:28:39.907938+0000","last_peered":"2024-09-15T12:28:39.907938+0000","last_clean":"2024-09-15T12:28:39.907938+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:28:39.907938+0000","last_undegraded":"2024-09-15T12:28:39.907938+0000","last_fullsized":"2024-09-15T12:28:39.907938+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"86'1156","reported_seq":1168,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.732716+0000","last_change":"2024-09-15T12:28:39.052760+0000","last_active":"2024-09-15T12:30:09.732716+0000","last_peered":"2024-09-15T12:30:09.732716+0000","last_clean":"2024-09-15T12:30:09.732716+0000","last_became_active":"2024-09-15T12:28:39.041365+0000","last_became_peered":"2024-09-15T12:28:39.041365+0000","last_unstale":"2024-09-15T12:30:09.732716+0000","last_undegraded":"2024-09-15T12:30:09.732716+0000","last_fullsized":"2024-09-15T12:30:09.732716+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1156,"log_dups_size":0,"ondisk_log_size":1156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75759616,"num_objects":1156,"num_object_clones":0,"num_object_copies":3468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":73984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.906843+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:28:39.906843+0000","last_peered":"2024-09-15T12:28:39.906843+0000","last_clean":"2024-09-15T12:28:39.906843+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:28:39.906843+0000","last_undegraded":"2024-09-15T12:28:39.906843+0000","last_fullsized":"2024-09-15T12:28:39.906843+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"86'1042","reported_seq":1054,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.944858+0000","last_change":"2024-09-15T12:28:39.046988+0000","last_active":"2024-09-15T12:30:09.944858+0000","last_peered":"2024-09-15T12:30:09.944858+0000","last_clean":"2024-09-15T12:30:09.944858+0000","last_became_active":"2024-09-15T12:28:39.017167+0000","last_became_peered":"2024-09-15T12:28:39.017167+0000","last_unstale":"2024-09-15T12:30:09.944858+0000","last_undegraded":"2024-09-15T12:30:09.944858+0000","last_fullsized":"2024-09-15T12:30:09.944858+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1042,"log_dups_size":0,"ondisk_log_size":1042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68288512,"num_objects":1042,"num_object_clones":0,"num_object_copies":3126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1042,"num_write_kb":66688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.914018+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:28:39.914018+0000","last_peered":"2024-09-15T12:28:39.914018+0000","last_clean":"2024-09-15T12:28:39.914018+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:28:39.914018+0000","last_undegraded":"2024-09-15T12:28:39.914018+0000","last_fullsized":"2024-09-15T12:28:39.914018+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":1162215424,"num_objects":17734,"num_object_clones":0,"num_object_copies":53202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17816,"num_write_kb":1137600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":218001408,"data_stored":3487957016,"data_compressed":165623700,"data_compressed_allocated":217997312,"data_compressed_original":3487956992,"omap_allocated":0,"internal_metadata":0},"log_size":17816,"ondisk_log_size":17816,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673648,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":174568,"kb_used_data":49176,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94197272,"statfs":{"total":96636764160,"available":96458006528,"internally_reserved":0,"allocated":50356224,"data_stored":793977584,"data_compressed":37690821,"data_compressed_allocated":49610752,"data_compressed_original":793690112,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706352,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":165564,"kb_used_data":49900,"kb_used_omap":0,"kb_used_meta":115648,"kb_avail":94206276,"statfs":{"total":96636764160,"available":96467226624,"internally_reserved":0,"allocated":51097600,"data_stored":805839595,"data_compressed":38253952,"data_compressed_allocated":50352128,"data_compressed_original":805552128,"omap_allocated":0,"internal_metadata":118423552},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706352,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":157636,"kb_used_data":58612,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94214204,"statfs":{"total":96636764160,"available":96475344896,"internally_reserved":0,"allocated":60018688,"data_stored":948969675,"data_compressed":45048410,"data_compressed_allocated":59293696,"data_compressed_original":948699136,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706352,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":183848,"kb_used_data":58456,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94187992,"statfs":{"total":96636764160,"available":96448503808,"internally_reserved":0,"allocated":59858944,"data_stored":946021099,"data_compressed":44910367,"data_compressed_allocated":59113472,"data_compressed_original":945733632,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":59072512,"data_stored":945160192,"data_compressed":44880335,"data_compressed_allocated":59072512,"data_compressed_original":945160192,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":59293696,"data_stored":948699136,"data_compressed":45048410,"data_compressed_allocated":59293696,"data_compressed_original":948699136,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":50311168,"data_stored":804978688,"data_compressed":38223920,"data_compressed_allocated":50311168,"data_compressed_original":804978688,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49324032,"data_stored":789119000,"data_compressed":37471035,"data_compressed_allocated":49319936,"data_compressed_original":789118976,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:30:17.976 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:30:18.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:18.131+0000 7fa072cbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:18.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:18.139+0000 7fa072cbd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:20.693 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:30:20.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:20.863+0000 7fcef4391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:20.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:20.875+0000 7fcef4391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:22.846 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:30:22.846 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:30:22.846 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:30:22.847 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:30:23.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:23.003+0000 7f608c391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:23.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:23.018+0000 7f608c391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:23.225 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:30:23.226 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:30:23.226 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:30:23.226 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:30:23.226 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:30:23.226 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:30:23.226 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:30:23.226 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:30:23.226 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:30:23.226 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:30:23.226 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:30:23.226 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:30:23.229 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:30:23.230 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:30:23.230 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:30:23.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:23.386+0000 7fba32cc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:23.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:23.404+0000 7fba32cc8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:23.419 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:30:23.529 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:30:23.529 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:30:23.529 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:30:23.529 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:30:23.529 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:30:23.529 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:30:23.529 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:30:23.529 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:30:23.529 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:30:23.529 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:30:23.530 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:30:23.530 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:30:23.534 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:30:23.534 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:30:23.535 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:30:23.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:23.574+0000 7f882e711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:23.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:23.591+0000 7f882e711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:23.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:23.680+0000 7f4d76f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:23.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:23.695+0000 7f4d76f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:23.808 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:30:23.809 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:30:23.809 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:30:23.809 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:30:23.809 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:30:23.809 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:30:23.809 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:30:23.809 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:30:23.809 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:30:23.809 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:30:23.809 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:30:23.809 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:30:23.813 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:30:23.814 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:30:23.814 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:30:23.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:23.953+0000 7f4ed5cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:23.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:23.970+0000 7f4ed5cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:24.146 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:30:24.146 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:30:24.146 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:30:24.146 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:30:24.146 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:30:24.146 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:30:24.146 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:30:24.146 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:30:24.147 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:30:24.147 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:30:24.147 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:30:24.147 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:30:24.150 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:30:24.151 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:30:26.415 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:30:26.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:26.574+0000 7fd4fbf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:26.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:26.584+0000 7fd4fbf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:29.151 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:30:29.152 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:30:29.152 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:30:29.226 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:30:29.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:29.314+0000 7fa9e2751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:29.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:29.330+0000 7fa9e2751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:29.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:29.376+0000 7f3ceed91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:29.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:29.386+0000 7f3ceed91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:29.624 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:30:29.625 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:30:29.645 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":432,"stamp":"2024-09-15T12:30:27.842435+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1162805811,"num_objects":17738,"num_object_clones":0,"num_object_copies":53214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":17897,"num_write_kb":1138708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17871,"ondisk_log_size":17871,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":681616,"kb_used_data":216144,"kb_used_omap":0,"kb_used_meta":465408,"kb_avail":376805744,"statfs":{"total":386547056640,"available":385849081856,"internally_reserved":0,"allocated":221331456,"data_stored":3494807953,"data_compressed":165903550,"data_compressed_allocated":218370048,"data_compressed_original":3493675008,"omap_allocated":0,"internal_metadata":476577792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002454"},"pg_stats":[{"pgid":"6.f","version":"86'1118","reported_seq":1130,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.701703+0000","last_change":"2024-09-15T12:28:39.077376+0000","last_active":"2024-09-15T12:30:09.701703+0000","last_peered":"2024-09-15T12:30:09.701703+0000","last_clean":"2024-09-15T12:30:09.701703+0000","last_became_active":"2024-09-15T12:28:39.068998+0000","last_became_peered":"2024-09-15T12:28:39.068998+0000","last_unstale":"2024-09-15T12:30:09.701703+0000","last_undegraded":"2024-09-15T12:30:09.701703+0000","last_fullsized":"2024-09-15T12:30:09.701703+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1118,"log_dups_size":0,"ondisk_log_size":1118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73269248,"num_objects":1118,"num_object_clones":0,"num_object_copies":3354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1118,"num_write_kb":71552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"86'1121","reported_seq":1133,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.899034+0000","last_change":"2024-09-15T12:28:39.087809+0000","last_active":"2024-09-15T12:30:09.899034+0000","last_peered":"2024-09-15T12:30:09.899034+0000","last_clean":"2024-09-15T12:30:09.899034+0000","last_became_active":"2024-09-15T12:28:39.074098+0000","last_became_peered":"2024-09-15T12:28:39.074098+0000","last_unstale":"2024-09-15T12:30:09.899034+0000","last_undegraded":"2024-09-15T12:30:09.899034+0000","last_fullsized":"2024-09-15T12:30:09.899034+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1121,"log_dups_size":0,"ondisk_log_size":1121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73465856,"num_objects":1121,"num_object_clones":0,"num_object_copies":3363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1121,"num_write_kb":71744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"86'1145","reported_seq":1157,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.948179+0000","last_change":"2024-09-15T12:28:39.061230+0000","last_active":"2024-09-15T12:30:09.948179+0000","last_peered":"2024-09-15T12:30:09.948179+0000","last_clean":"2024-09-15T12:30:09.948179+0000","last_became_active":"2024-09-15T12:28:39.046625+0000","last_became_peered":"2024-09-15T12:28:39.046625+0000","last_unstale":"2024-09-15T12:30:09.948179+0000","last_undegraded":"2024-09-15T12:30:09.948179+0000","last_fullsized":"2024-09-15T12:30:09.948179+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1145,"log_dups_size":0,"ondisk_log_size":1145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75038720,"num_objects":1145,"num_object_clones":0,"num_object_copies":3435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1145,"num_write_kb":73280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"86'1097","reported_seq":1109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:11.728321+0000","last_change":"2024-09-15T12:28:39.043350+0000","last_active":"2024-09-15T12:30:11.728321+0000","last_peered":"2024-09-15T12:30:11.728321+0000","last_clean":"2024-09-15T12:30:11.728321+0000","last_became_active":"2024-09-15T12:28:39.034104+0000","last_became_peered":"2024-09-15T12:28:39.034104+0000","last_unstale":"2024-09-15T12:30:11.728321+0000","last_undegraded":"2024-09-15T12:30:11.728321+0000","last_fullsized":"2024-09-15T12:30:11.728321+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1097,"log_dups_size":0,"ondisk_log_size":1097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70713344,"num_objects":1079,"num_object_clones":0,"num_object_copies":3237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1097,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"86'1151","reported_seq":1163,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.833571+0000","last_change":"2024-09-15T12:28:39.083865+0000","last_active":"2024-09-15T12:30:09.833571+0000","last_peered":"2024-09-15T12:30:09.833571+0000","last_clean":"2024-09-15T12:30:09.833571+0000","last_became_active":"2024-09-15T12:28:39.075263+0000","last_became_peered":"2024-09-15T12:28:39.075263+0000","last_unstale":"2024-09-15T12:30:09.833571+0000","last_undegraded":"2024-09-15T12:30:09.833571+0000","last_fullsized":"2024-09-15T12:30:09.833571+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1151,"log_dups_size":0,"ondisk_log_size":1151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75431936,"num_objects":1151,"num_object_clones":0,"num_object_copies":3453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":73664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"86'1071","reported_seq":1083,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.570714+0000","last_change":"2024-09-15T12:28:39.031088+0000","last_active":"2024-09-15T12:30:09.570714+0000","last_peered":"2024-09-15T12:30:09.570714+0000","last_clean":"2024-09-15T12:30:09.570714+0000","last_became_active":"2024-09-15T12:28:39.025037+0000","last_became_peered":"2024-09-15T12:28:39.025037+0000","last_unstale":"2024-09-15T12:30:09.570714+0000","last_undegraded":"2024-09-15T12:30:09.570714+0000","last_fullsized":"2024-09-15T12:30:09.570714+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1071,"log_dups_size":0,"ondisk_log_size":1071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70189056,"num_objects":1071,"num_object_clones":0,"num_object_copies":3213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1071,"num_write_kb":68544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"86'1125","reported_seq":1137,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:11.679756+0000","last_change":"2024-09-15T12:28:39.067539+0000","last_active":"2024-09-15T12:30:11.679756+0000","last_peered":"2024-09-15T12:30:11.679756+0000","last_clean":"2024-09-15T12:30:11.679756+0000","last_became_active":"2024-09-15T12:28:39.054389+0000","last_became_peered":"2024-09-15T12:28:39.054389+0000","last_unstale":"2024-09-15T12:30:11.679756+0000","last_undegraded":"2024-09-15T12:30:11.679756+0000","last_fullsized":"2024-09-15T12:30:11.679756+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1125,"log_dups_size":0,"ondisk_log_size":1125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72286208,"num_objects":1103,"num_object_clones":0,"num_object_copies":3309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1125,"num_write_kb":71296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"86'1090","reported_seq":1102,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.912891+0000","last_change":"2024-09-15T12:28:38.993796+0000","last_active":"2024-09-15T12:30:09.912891+0000","last_peered":"2024-09-15T12:30:09.912891+0000","last_clean":"2024-09-15T12:30:09.912891+0000","last_became_active":"2024-09-15T12:28:38.987121+0000","last_became_peered":"2024-09-15T12:28:38.987121+0000","last_unstale":"2024-09-15T12:30:09.912891+0000","last_undegraded":"2024-09-15T12:30:09.912891+0000","last_fullsized":"2024-09-15T12:30:09.912891+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1090,"log_dups_size":0,"ondisk_log_size":1090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71434240,"num_objects":1090,"num_object_clones":0,"num_object_copies":3270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1090,"num_write_kb":69760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"86'1109","reported_seq":1121,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.883911+0000","last_change":"2024-09-15T12:28:39.047799+0000","last_active":"2024-09-15T12:30:09.883911+0000","last_peered":"2024-09-15T12:30:09.883911+0000","last_clean":"2024-09-15T12:30:09.883911+0000","last_became_active":"2024-09-15T12:28:39.017997+0000","last_became_peered":"2024-09-15T12:28:39.017997+0000","last_unstale":"2024-09-15T12:30:09.883911+0000","last_undegraded":"2024-09-15T12:30:09.883911+0000","last_fullsized":"2024-09-15T12:30:09.883911+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1109,"log_dups_size":0,"ondisk_log_size":1109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72679424,"num_objects":1109,"num_object_clones":0,"num_object_copies":3327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1109,"num_write_kb":70976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":301,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.902781+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:28:39.902781+0000","last_peered":"2024-09-15T12:28:39.902781+0000","last_clean":"2024-09-15T12:28:39.902781+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:28:39.902781+0000","last_undegraded":"2024-09-15T12:28:39.902781+0000","last_fullsized":"2024-09-15T12:28:39.902781+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":230,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.911586+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:28:39.911586+0000","last_peered":"2024-09-15T12:28:39.911586+0000","last_clean":"2024-09-15T12:28:39.911586+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:28:39.911586+0000","last_undegraded":"2024-09-15T12:28:39.911586+0000","last_fullsized":"2024-09-15T12:28:39.911586+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"86'1102","reported_seq":1114,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:11.798472+0000","last_change":"2024-09-15T12:28:39.071985+0000","last_active":"2024-09-15T12:30:11.798472+0000","last_peered":"2024-09-15T12:30:11.798472+0000","last_clean":"2024-09-15T12:30:11.798472+0000","last_became_active":"2024-09-15T12:28:39.061062+0000","last_became_peered":"2024-09-15T12:28:39.061062+0000","last_unstale":"2024-09-15T12:30:11.798472+0000","last_undegraded":"2024-09-15T12:30:11.798472+0000","last_fullsized":"2024-09-15T12:30:11.798472+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1102,"log_dups_size":0,"ondisk_log_size":1102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70516736,"num_objects":1076,"num_object_clones":0,"num_object_copies":3228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1102,"num_write_kb":69696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.910978+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:28:39.910978+0000","last_peered":"2024-09-15T12:28:39.910978+0000","last_clean":"2024-09-15T12:28:39.910978+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:28:39.910978+0000","last_undegraded":"2024-09-15T12:28:39.910978+0000","last_fullsized":"2024-09-15T12:28:39.910978+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"86'1124","reported_seq":1136,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.702283+0000","last_change":"2024-09-15T12:28:39.025429+0000","last_active":"2024-09-15T12:30:09.702283+0000","last_peered":"2024-09-15T12:30:09.702283+0000","last_clean":"2024-09-15T12:30:09.702283+0000","last_became_active":"2024-09-15T12:28:39.007673+0000","last_became_peered":"2024-09-15T12:28:39.007673+0000","last_unstale":"2024-09-15T12:30:09.702283+0000","last_undegraded":"2024-09-15T12:30:09.702283+0000","last_fullsized":"2024-09-15T12:30:09.702283+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1124,"log_dups_size":0,"ondisk_log_size":1124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73662464,"num_objects":1124,"num_object_clones":0,"num_object_copies":3372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1124,"num_write_kb":71936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.905410+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:28:39.905410+0000","last_peered":"2024-09-15T12:28:39.905410+0000","last_clean":"2024-09-15T12:28:39.905410+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:28:39.905410+0000","last_undegraded":"2024-09-15T12:28:39.905410+0000","last_fullsized":"2024-09-15T12:28:39.905410+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"86'1115","reported_seq":1127,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:11.663289+0000","last_change":"2024-09-15T12:28:39.029713+0000","last_active":"2024-09-15T12:30:11.663289+0000","last_peered":"2024-09-15T12:30:11.663289+0000","last_clean":"2024-09-15T12:30:11.663289+0000","last_became_active":"2024-09-15T12:28:39.020975+0000","last_became_peered":"2024-09-15T12:28:39.020975+0000","last_unstale":"2024-09-15T12:30:11.663289+0000","last_undegraded":"2024-09-15T12:30:11.663289+0000","last_fullsized":"2024-09-15T12:30:11.663289+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1115,"log_dups_size":0,"ondisk_log_size":1115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72024064,"num_objects":1099,"num_object_clones":0,"num_object_copies":3297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1115,"num_write_kb":70848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":231,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.904865+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:28:39.904865+0000","last_peered":"2024-09-15T12:28:39.904865+0000","last_clean":"2024-09-15T12:28:39.904865+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:28:39.904865+0000","last_undegraded":"2024-09-15T12:28:39.904865+0000","last_fullsized":"2024-09-15T12:28:39.904865+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"86'1085","reported_seq":1097,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.969950+0000","last_change":"2024-09-15T12:28:39.023135+0000","last_active":"2024-09-15T12:30:09.969950+0000","last_peered":"2024-09-15T12:30:09.969950+0000","last_clean":"2024-09-15T12:30:09.969950+0000","last_became_active":"2024-09-15T12:28:39.014305+0000","last_became_peered":"2024-09-15T12:28:39.014305+0000","last_unstale":"2024-09-15T12:30:09.969950+0000","last_undegraded":"2024-09-15T12:30:09.969950+0000","last_fullsized":"2024-09-15T12:30:09.969950+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1085,"log_dups_size":0,"ondisk_log_size":1085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71106560,"num_objects":1085,"num_object_clones":0,"num_object_copies":3255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1085,"num_write_kb":69440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.907958+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:28:39.907958+0000","last_peered":"2024-09-15T12:28:39.907958+0000","last_clean":"2024-09-15T12:28:39.907958+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:28:39.907958+0000","last_undegraded":"2024-09-15T12:28:39.907958+0000","last_fullsized":"2024-09-15T12:28:39.907958+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"86'1165","reported_seq":1177,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.813115+0000","last_change":"2024-09-15T12:28:39.054857+0000","last_active":"2024-09-15T12:30:09.813115+0000","last_peered":"2024-09-15T12:30:09.813115+0000","last_clean":"2024-09-15T12:30:09.813115+0000","last_became_active":"2024-09-15T12:28:39.046395+0000","last_became_peered":"2024-09-15T12:28:39.046395+0000","last_unstale":"2024-09-15T12:30:09.813115+0000","last_undegraded":"2024-09-15T12:30:09.813115+0000","last_fullsized":"2024-09-15T12:30:09.813115+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1165,"log_dups_size":0,"ondisk_log_size":1165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76349440,"num_objects":1165,"num_object_clones":0,"num_object_copies":3495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1165,"num_write_kb":74560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.907938+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:28:39.907938+0000","last_peered":"2024-09-15T12:28:39.907938+0000","last_clean":"2024-09-15T12:28:39.907938+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:28:39.907938+0000","last_undegraded":"2024-09-15T12:28:39.907938+0000","last_fullsized":"2024-09-15T12:28:39.907938+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"86'1156","reported_seq":1168,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.732716+0000","last_change":"2024-09-15T12:28:39.052760+0000","last_active":"2024-09-15T12:30:09.732716+0000","last_peered":"2024-09-15T12:30:09.732716+0000","last_clean":"2024-09-15T12:30:09.732716+0000","last_became_active":"2024-09-15T12:28:39.041365+0000","last_became_peered":"2024-09-15T12:28:39.041365+0000","last_unstale":"2024-09-15T12:30:09.732716+0000","last_undegraded":"2024-09-15T12:30:09.732716+0000","last_fullsized":"2024-09-15T12:30:09.732716+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1156,"log_dups_size":0,"ondisk_log_size":1156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75759616,"num_objects":1156,"num_object_clones":0,"num_object_copies":3468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":73984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.906843+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:28:39.906843+0000","last_peered":"2024-09-15T12:28:39.906843+0000","last_clean":"2024-09-15T12:28:39.906843+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:28:39.906843+0000","last_undegraded":"2024-09-15T12:28:39.906843+0000","last_fullsized":"2024-09-15T12:28:39.906843+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"86'1042","reported_seq":1054,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.944858+0000","last_change":"2024-09-15T12:28:39.046988+0000","last_active":"2024-09-15T12:30:09.944858+0000","last_peered":"2024-09-15T12:30:09.944858+0000","last_clean":"2024-09-15T12:30:09.944858+0000","last_became_active":"2024-09-15T12:28:39.017167+0000","last_became_peered":"2024-09-15T12:28:39.017167+0000","last_unstale":"2024-09-15T12:30:09.944858+0000","last_undegraded":"2024-09-15T12:30:09.944858+0000","last_fullsized":"2024-09-15T12:30:09.944858+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1042,"log_dups_size":0,"ondisk_log_size":1042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68288512,"num_objects":1042,"num_object_clones":0,"num_object_copies":3126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1042,"num_write_kb":66688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.914018+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:28:39.914018+0000","last_peered":"2024-09-15T12:28:39.914018+0000","last_clean":"2024-09-15T12:28:39.914018+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:28:39.914018+0000","last_undegraded":"2024-09-15T12:28:39.914018+0000","last_fullsized":"2024-09-15T12:28:39.914018+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":1162215424,"num_objects":17734,"num_object_clones":0,"num_object_copies":53202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17816,"num_write_kb":1137600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":218001408,"data_stored":3487957016,"data_compressed":165623700,"data_compressed_allocated":217997312,"data_compressed_original":3487956992,"omap_allocated":0,"internal_metadata":0},"log_size":17816,"ondisk_log_size":17816,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673648,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":174568,"kb_used_data":49176,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94197272,"statfs":{"total":96636764160,"available":96458006528,"internally_reserved":0,"allocated":50356224,"data_stored":793977584,"data_compressed":37690821,"data_compressed_allocated":49610752,"data_compressed_original":793690112,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706352,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":165564,"kb_used_data":49900,"kb_used_omap":0,"kb_used_meta":115648,"kb_avail":94206276,"statfs":{"total":96636764160,"available":96467226624,"internally_reserved":0,"allocated":51097600,"data_stored":805839595,"data_compressed":38253952,"data_compressed_allocated":50352128,"data_compressed_original":805552128,"omap_allocated":0,"internal_metadata":118423552},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706352,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":157636,"kb_used_data":58612,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94214204,"statfs":{"total":96636764160,"available":96475344896,"internally_reserved":0,"allocated":60018688,"data_stored":948969675,"data_compressed":45048410,"data_compressed_allocated":59293696,"data_compressed_original":948699136,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706352,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":183848,"kb_used_data":58456,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94187992,"statfs":{"total":96636764160,"available":96448503808,"internally_reserved":0,"allocated":59858944,"data_stored":946021099,"data_compressed":44910367,"data_compressed_allocated":59113472,"data_compressed_original":945733632,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":59072512,"data_stored":945160192,"data_compressed":44880335,"data_compressed_allocated":59072512,"data_compressed_original":945160192,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":59293696,"data_stored":948699136,"data_compressed":45048410,"data_compressed_allocated":59293696,"data_compressed_original":948699136,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":50311168,"data_stored":804978688,"data_compressed":38223920,"data_compressed_allocated":50311168,"data_compressed_original":804978688,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49324032,"data_stored":789119000,"data_compressed":37471035,"data_compressed_allocated":49319936,"data_compressed_original":789118976,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:30:32.136 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:30:32.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:32.276+0000 7fcee147f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:32.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:32.284+0000 7fcee147f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:34.647 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:30:34.647 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:30:34.647 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:30:34.647 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:30:34.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:34.808+0000 7f42556c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:34.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:34.819+0000 7f42556c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:34.900 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:30:34.968 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:30:34.969 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:30:34.969 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:30:34.969 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:30:34.969 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:30:34.969 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:30:34.969 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:30:34.969 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:30:34.969 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:30:34.969 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:30:34.969 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:30:34.969 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:30:34.972 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:30:34.973 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:30:34.973 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:30:35.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:35.074+0000 7ff43a791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:35.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:35.084+0000 7ff43a791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:35.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:35.143+0000 7efc5c751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:35.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:35.161+0000 7efc5c751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:35.335 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:30:35.335 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:30:35.335 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:30:35.335 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:30:35.335 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:30:35.335 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:30:35.335 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:30:35.335 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:30:35.335 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:30:35.335 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:30:35.335 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:30:35.335 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:30:35.340 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:30:35.340 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:30:35.340 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:30:35.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:35.508+0000 7f1d91b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:35.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:35.523+0000 7f1d91b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:35.786 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:30:35.786 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:30:35.786 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:30:35.786 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:30:35.786 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:30:35.787 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:30:35.787 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:30:35.787 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:30:35.787 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:30:35.787 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:30:35.787 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:30:35.787 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:30:35.791 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:30:35.791 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:30:35.791 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:30:35.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:35.943+0000 7f57ea6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:35.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:35.961+0000 7f57ea6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:36.057 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:30:36.057 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:30:36.057 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:30:36.057 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:30:36.058 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:30:36.058 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:30:36.058 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:30:36.058 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:30:36.058 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:30:36.058 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:30:36.058 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:30:36.058 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:30:36.061 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:30:36.061 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:30:37.568 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:30:37.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:37.713+0000 7f628aed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:37.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:37.722+0000 7f628aed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:40.199 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:30:40.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:40.340+0000 7fe39f284640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:40.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:40.348+0000 7fe39f284640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:41.062 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:30:41.062 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:30:41.063 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:30:41.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:41.211+0000 7fc55d0c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:41.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:41.221+0000 7fc55d0c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:41.516 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:30:41.517 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:30:41.532 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":438,"stamp":"2024-09-15T12:30:39.844791+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1162805811,"num_objects":17738,"num_object_clones":0,"num_object_copies":53214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":17897,"num_write_kb":1138708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17871,"ondisk_log_size":17871,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":681616,"kb_used_data":216144,"kb_used_omap":0,"kb_used_meta":465408,"kb_avail":376805744,"statfs":{"total":386547056640,"available":385849081856,"internally_reserved":0,"allocated":221331456,"data_stored":3494807953,"data_compressed":165903550,"data_compressed_allocated":218370048,"data_compressed_original":3493675008,"omap_allocated":0,"internal_metadata":476577792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002355"},"pg_stats":[{"pgid":"6.f","version":"86'1118","reported_seq":1130,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.701703+0000","last_change":"2024-09-15T12:28:39.077376+0000","last_active":"2024-09-15T12:30:09.701703+0000","last_peered":"2024-09-15T12:30:09.701703+0000","last_clean":"2024-09-15T12:30:09.701703+0000","last_became_active":"2024-09-15T12:28:39.068998+0000","last_became_peered":"2024-09-15T12:28:39.068998+0000","last_unstale":"2024-09-15T12:30:09.701703+0000","last_undegraded":"2024-09-15T12:30:09.701703+0000","last_fullsized":"2024-09-15T12:30:09.701703+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1118,"log_dups_size":0,"ondisk_log_size":1118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73269248,"num_objects":1118,"num_object_clones":0,"num_object_copies":3354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1118,"num_write_kb":71552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"86'1121","reported_seq":1133,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.899034+0000","last_change":"2024-09-15T12:28:39.087809+0000","last_active":"2024-09-15T12:30:09.899034+0000","last_peered":"2024-09-15T12:30:09.899034+0000","last_clean":"2024-09-15T12:30:09.899034+0000","last_became_active":"2024-09-15T12:28:39.074098+0000","last_became_peered":"2024-09-15T12:28:39.074098+0000","last_unstale":"2024-09-15T12:30:09.899034+0000","last_undegraded":"2024-09-15T12:30:09.899034+0000","last_fullsized":"2024-09-15T12:30:09.899034+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1121,"log_dups_size":0,"ondisk_log_size":1121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73465856,"num_objects":1121,"num_object_clones":0,"num_object_copies":3363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1121,"num_write_kb":71744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"86'1145","reported_seq":1157,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.948179+0000","last_change":"2024-09-15T12:28:39.061230+0000","last_active":"2024-09-15T12:30:09.948179+0000","last_peered":"2024-09-15T12:30:09.948179+0000","last_clean":"2024-09-15T12:30:09.948179+0000","last_became_active":"2024-09-15T12:28:39.046625+0000","last_became_peered":"2024-09-15T12:28:39.046625+0000","last_unstale":"2024-09-15T12:30:09.948179+0000","last_undegraded":"2024-09-15T12:30:09.948179+0000","last_fullsized":"2024-09-15T12:30:09.948179+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1145,"log_dups_size":0,"ondisk_log_size":1145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75038720,"num_objects":1145,"num_object_clones":0,"num_object_copies":3435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1145,"num_write_kb":73280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"86'1097","reported_seq":1109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:11.728321+0000","last_change":"2024-09-15T12:28:39.043350+0000","last_active":"2024-09-15T12:30:11.728321+0000","last_peered":"2024-09-15T12:30:11.728321+0000","last_clean":"2024-09-15T12:30:11.728321+0000","last_became_active":"2024-09-15T12:28:39.034104+0000","last_became_peered":"2024-09-15T12:28:39.034104+0000","last_unstale":"2024-09-15T12:30:11.728321+0000","last_undegraded":"2024-09-15T12:30:11.728321+0000","last_fullsized":"2024-09-15T12:30:11.728321+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1097,"log_dups_size":0,"ondisk_log_size":1097,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70713344,"num_objects":1079,"num_object_clones":0,"num_object_copies":3237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1097,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"86'1151","reported_seq":1163,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.833571+0000","last_change":"2024-09-15T12:28:39.083865+0000","last_active":"2024-09-15T12:30:09.833571+0000","last_peered":"2024-09-15T12:30:09.833571+0000","last_clean":"2024-09-15T12:30:09.833571+0000","last_became_active":"2024-09-15T12:28:39.075263+0000","last_became_peered":"2024-09-15T12:28:39.075263+0000","last_unstale":"2024-09-15T12:30:09.833571+0000","last_undegraded":"2024-09-15T12:30:09.833571+0000","last_fullsized":"2024-09-15T12:30:09.833571+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1151,"log_dups_size":0,"ondisk_log_size":1151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75431936,"num_objects":1151,"num_object_clones":0,"num_object_copies":3453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":73664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"86'1071","reported_seq":1083,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.570714+0000","last_change":"2024-09-15T12:28:39.031088+0000","last_active":"2024-09-15T12:30:09.570714+0000","last_peered":"2024-09-15T12:30:09.570714+0000","last_clean":"2024-09-15T12:30:09.570714+0000","last_became_active":"2024-09-15T12:28:39.025037+0000","last_became_peered":"2024-09-15T12:28:39.025037+0000","last_unstale":"2024-09-15T12:30:09.570714+0000","last_undegraded":"2024-09-15T12:30:09.570714+0000","last_fullsized":"2024-09-15T12:30:09.570714+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1071,"log_dups_size":0,"ondisk_log_size":1071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70189056,"num_objects":1071,"num_object_clones":0,"num_object_copies":3213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1071,"num_write_kb":68544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"86'1125","reported_seq":1137,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:11.679756+0000","last_change":"2024-09-15T12:28:39.067539+0000","last_active":"2024-09-15T12:30:11.679756+0000","last_peered":"2024-09-15T12:30:11.679756+0000","last_clean":"2024-09-15T12:30:11.679756+0000","last_became_active":"2024-09-15T12:28:39.054389+0000","last_became_peered":"2024-09-15T12:28:39.054389+0000","last_unstale":"2024-09-15T12:30:11.679756+0000","last_undegraded":"2024-09-15T12:30:11.679756+0000","last_fullsized":"2024-09-15T12:30:11.679756+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1125,"log_dups_size":0,"ondisk_log_size":1125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72286208,"num_objects":1103,"num_object_clones":0,"num_object_copies":3309,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1125,"num_write_kb":71296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"86'1090","reported_seq":1102,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.912891+0000","last_change":"2024-09-15T12:28:38.993796+0000","last_active":"2024-09-15T12:30:09.912891+0000","last_peered":"2024-09-15T12:30:09.912891+0000","last_clean":"2024-09-15T12:30:09.912891+0000","last_became_active":"2024-09-15T12:28:38.987121+0000","last_became_peered":"2024-09-15T12:28:38.987121+0000","last_unstale":"2024-09-15T12:30:09.912891+0000","last_undegraded":"2024-09-15T12:30:09.912891+0000","last_fullsized":"2024-09-15T12:30:09.912891+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1090,"log_dups_size":0,"ondisk_log_size":1090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71434240,"num_objects":1090,"num_object_clones":0,"num_object_copies":3270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1090,"num_write_kb":69760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"86'1109","reported_seq":1121,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.883911+0000","last_change":"2024-09-15T12:28:39.047799+0000","last_active":"2024-09-15T12:30:09.883911+0000","last_peered":"2024-09-15T12:30:09.883911+0000","last_clean":"2024-09-15T12:30:09.883911+0000","last_became_active":"2024-09-15T12:28:39.017997+0000","last_became_peered":"2024-09-15T12:28:39.017997+0000","last_unstale":"2024-09-15T12:30:09.883911+0000","last_undegraded":"2024-09-15T12:30:09.883911+0000","last_fullsized":"2024-09-15T12:30:09.883911+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1109,"log_dups_size":0,"ondisk_log_size":1109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72679424,"num_objects":1109,"num_object_clones":0,"num_object_copies":3327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1109,"num_write_kb":70976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":301,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.902781+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:28:39.902781+0000","last_peered":"2024-09-15T12:28:39.902781+0000","last_clean":"2024-09-15T12:28:39.902781+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:28:39.902781+0000","last_undegraded":"2024-09-15T12:28:39.902781+0000","last_fullsized":"2024-09-15T12:28:39.902781+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":230,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.911586+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:28:39.911586+0000","last_peered":"2024-09-15T12:28:39.911586+0000","last_clean":"2024-09-15T12:28:39.911586+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:28:39.911586+0000","last_undegraded":"2024-09-15T12:28:39.911586+0000","last_fullsized":"2024-09-15T12:28:39.911586+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"86'1102","reported_seq":1114,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:11.798472+0000","last_change":"2024-09-15T12:28:39.071985+0000","last_active":"2024-09-15T12:30:11.798472+0000","last_peered":"2024-09-15T12:30:11.798472+0000","last_clean":"2024-09-15T12:30:11.798472+0000","last_became_active":"2024-09-15T12:28:39.061062+0000","last_became_peered":"2024-09-15T12:28:39.061062+0000","last_unstale":"2024-09-15T12:30:11.798472+0000","last_undegraded":"2024-09-15T12:30:11.798472+0000","last_fullsized":"2024-09-15T12:30:11.798472+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1102,"log_dups_size":0,"ondisk_log_size":1102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70516736,"num_objects":1076,"num_object_clones":0,"num_object_copies":3228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1102,"num_write_kb":69696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.910978+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:28:39.910978+0000","last_peered":"2024-09-15T12:28:39.910978+0000","last_clean":"2024-09-15T12:28:39.910978+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:28:39.910978+0000","last_undegraded":"2024-09-15T12:28:39.910978+0000","last_fullsized":"2024-09-15T12:28:39.910978+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"86'1124","reported_seq":1136,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.702283+0000","last_change":"2024-09-15T12:28:39.025429+0000","last_active":"2024-09-15T12:30:09.702283+0000","last_peered":"2024-09-15T12:30:09.702283+0000","last_clean":"2024-09-15T12:30:09.702283+0000","last_became_active":"2024-09-15T12:28:39.007673+0000","last_became_peered":"2024-09-15T12:28:39.007673+0000","last_unstale":"2024-09-15T12:30:09.702283+0000","last_undegraded":"2024-09-15T12:30:09.702283+0000","last_fullsized":"2024-09-15T12:30:09.702283+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1124,"log_dups_size":0,"ondisk_log_size":1124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73662464,"num_objects":1124,"num_object_clones":0,"num_object_copies":3372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1124,"num_write_kb":71936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.905410+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:28:39.905410+0000","last_peered":"2024-09-15T12:28:39.905410+0000","last_clean":"2024-09-15T12:28:39.905410+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:28:39.905410+0000","last_undegraded":"2024-09-15T12:28:39.905410+0000","last_fullsized":"2024-09-15T12:28:39.905410+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"86'1115","reported_seq":1127,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:11.663289+0000","last_change":"2024-09-15T12:28:39.029713+0000","last_active":"2024-09-15T12:30:11.663289+0000","last_peered":"2024-09-15T12:30:11.663289+0000","last_clean":"2024-09-15T12:30:11.663289+0000","last_became_active":"2024-09-15T12:28:39.020975+0000","last_became_peered":"2024-09-15T12:28:39.020975+0000","last_unstale":"2024-09-15T12:30:11.663289+0000","last_undegraded":"2024-09-15T12:30:11.663289+0000","last_fullsized":"2024-09-15T12:30:11.663289+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1115,"log_dups_size":0,"ondisk_log_size":1115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72024064,"num_objects":1099,"num_object_clones":0,"num_object_copies":3297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1115,"num_write_kb":70848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":231,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.904865+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:28:39.904865+0000","last_peered":"2024-09-15T12:28:39.904865+0000","last_clean":"2024-09-15T12:28:39.904865+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:28:39.904865+0000","last_undegraded":"2024-09-15T12:28:39.904865+0000","last_fullsized":"2024-09-15T12:28:39.904865+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"86'1085","reported_seq":1097,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.969950+0000","last_change":"2024-09-15T12:28:39.023135+0000","last_active":"2024-09-15T12:30:09.969950+0000","last_peered":"2024-09-15T12:30:09.969950+0000","last_clean":"2024-09-15T12:30:09.969950+0000","last_became_active":"2024-09-15T12:28:39.014305+0000","last_became_peered":"2024-09-15T12:28:39.014305+0000","last_unstale":"2024-09-15T12:30:09.969950+0000","last_undegraded":"2024-09-15T12:30:09.969950+0000","last_fullsized":"2024-09-15T12:30:09.969950+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1085,"log_dups_size":0,"ondisk_log_size":1085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71106560,"num_objects":1085,"num_object_clones":0,"num_object_copies":3255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1085,"num_write_kb":69440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.907958+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:28:39.907958+0000","last_peered":"2024-09-15T12:28:39.907958+0000","last_clean":"2024-09-15T12:28:39.907958+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:28:39.907958+0000","last_undegraded":"2024-09-15T12:28:39.907958+0000","last_fullsized":"2024-09-15T12:28:39.907958+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"86'1165","reported_seq":1177,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.813115+0000","last_change":"2024-09-15T12:28:39.054857+0000","last_active":"2024-09-15T12:30:09.813115+0000","last_peered":"2024-09-15T12:30:09.813115+0000","last_clean":"2024-09-15T12:30:09.813115+0000","last_became_active":"2024-09-15T12:28:39.046395+0000","last_became_peered":"2024-09-15T12:28:39.046395+0000","last_unstale":"2024-09-15T12:30:09.813115+0000","last_undegraded":"2024-09-15T12:30:09.813115+0000","last_fullsized":"2024-09-15T12:30:09.813115+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1165,"log_dups_size":0,"ondisk_log_size":1165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76349440,"num_objects":1165,"num_object_clones":0,"num_object_copies":3495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1165,"num_write_kb":74560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.907938+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:28:39.907938+0000","last_peered":"2024-09-15T12:28:39.907938+0000","last_clean":"2024-09-15T12:28:39.907938+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:28:39.907938+0000","last_undegraded":"2024-09-15T12:28:39.907938+0000","last_fullsized":"2024-09-15T12:28:39.907938+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"86'1156","reported_seq":1168,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.732716+0000","last_change":"2024-09-15T12:28:39.052760+0000","last_active":"2024-09-15T12:30:09.732716+0000","last_peered":"2024-09-15T12:30:09.732716+0000","last_clean":"2024-09-15T12:30:09.732716+0000","last_became_active":"2024-09-15T12:28:39.041365+0000","last_became_peered":"2024-09-15T12:28:39.041365+0000","last_unstale":"2024-09-15T12:30:09.732716+0000","last_undegraded":"2024-09-15T12:30:09.732716+0000","last_fullsized":"2024-09-15T12:30:09.732716+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1156,"log_dups_size":0,"ondisk_log_size":1156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75759616,"num_objects":1156,"num_object_clones":0,"num_object_copies":3468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1156,"num_write_kb":73984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.906843+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:28:39.906843+0000","last_peered":"2024-09-15T12:28:39.906843+0000","last_clean":"2024-09-15T12:28:39.906843+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:28:39.906843+0000","last_undegraded":"2024-09-15T12:28:39.906843+0000","last_fullsized":"2024-09-15T12:28:39.906843+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"86'1042","reported_seq":1054,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:09.944858+0000","last_change":"2024-09-15T12:28:39.046988+0000","last_active":"2024-09-15T12:30:09.944858+0000","last_peered":"2024-09-15T12:30:09.944858+0000","last_clean":"2024-09-15T12:30:09.944858+0000","last_became_active":"2024-09-15T12:28:39.017167+0000","last_became_peered":"2024-09-15T12:28:39.017167+0000","last_unstale":"2024-09-15T12:30:09.944858+0000","last_undegraded":"2024-09-15T12:30:09.944858+0000","last_fullsized":"2024-09-15T12:30:09.944858+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1042,"log_dups_size":0,"ondisk_log_size":1042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68288512,"num_objects":1042,"num_object_clones":0,"num_object_copies":3126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1042,"num_write_kb":66688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.914018+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:28:39.914018+0000","last_peered":"2024-09-15T12:28:39.914018+0000","last_clean":"2024-09-15T12:28:39.914018+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:28:39.914018+0000","last_undegraded":"2024-09-15T12:28:39.914018+0000","last_fullsized":"2024-09-15T12:28:39.914018+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":1162215424,"num_objects":17734,"num_object_clones":0,"num_object_copies":53202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17816,"num_write_kb":1137600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":218001408,"data_stored":3487957016,"data_compressed":165623700,"data_compressed_allocated":217997312,"data_compressed_original":3487956992,"omap_allocated":0,"internal_metadata":0},"log_size":17816,"ondisk_log_size":17816,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673648,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":174568,"kb_used_data":49176,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94197272,"statfs":{"total":96636764160,"available":96458006528,"internally_reserved":0,"allocated":50356224,"data_stored":793977584,"data_compressed":37690821,"data_compressed_allocated":49610752,"data_compressed_original":793690112,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706352,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":165564,"kb_used_data":49900,"kb_used_omap":0,"kb_used_meta":115648,"kb_avail":94206276,"statfs":{"total":96636764160,"available":96467226624,"internally_reserved":0,"allocated":51097600,"data_stored":805839595,"data_compressed":38253952,"data_compressed_allocated":50352128,"data_compressed_original":805552128,"omap_allocated":0,"internal_metadata":118423552},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706352,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":157636,"kb_used_data":58612,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94214204,"statfs":{"total":96636764160,"available":96475344896,"internally_reserved":0,"allocated":60018688,"data_stored":948969675,"data_compressed":45048410,"data_compressed_allocated":59293696,"data_compressed_original":948699136,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706352,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":183848,"kb_used_data":58456,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94187992,"statfs":{"total":96636764160,"available":96448503808,"internally_reserved":0,"allocated":59858944,"data_stored":946021099,"data_compressed":44910367,"data_compressed_allocated":59113472,"data_compressed_original":945733632,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":59072512,"data_stored":945160192,"data_compressed":44880335,"data_compressed_allocated":59072512,"data_compressed_original":945160192,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":59293696,"data_stored":948699136,"data_compressed":45048410,"data_compressed_allocated":59293696,"data_compressed_original":948699136,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":50311168,"data_stored":804978688,"data_compressed":38223920,"data_compressed_allocated":50311168,"data_compressed_original":804978688,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49324032,"data_stored":789119000,"data_compressed":37471035,"data_compressed_allocated":49319936,"data_compressed_original":789118976,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:30:42.844 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:30:42.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:42.988+0000 7fe523c4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:42.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:42.998+0000 7fe523c4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:45.404 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:30:45.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:45.563+0000 7fb26c311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:45.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:45.571+0000 7fb26c311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:46.534 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:30:46.535 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:30:46.535 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:30:46.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:46.697+0000 7efc43191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:46.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:46.710+0000 7efc43191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:47.049 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:30:47.049 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:30:47.066 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":441,"stamp":"2024-09-15T12:30:45.846109+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":776667723,"num_objects":11847,"num_object_clones":0,"num_object_copies":35541,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":23790,"num_write_kb":1138709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23764,"ondisk_log_size":23764,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":633608,"kb_used_data":145924,"kb_used_omap":0,"kb_used_meta":487616,"kb_avail":376853752,"statfs":{"total":386547056640,"available":385898242048,"internally_reserved":0,"allocated":149426176,"data_stored":2344192449,"data_compressed":111269405,"data_compressed_allocated":146456576,"data_compressed_original":2343059456,"omap_allocated":0,"internal_metadata":499318784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-386138088,"num_objects":-5891,"num_object_clones":0,"num_object_copies":-17673,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5893,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002423"},"pg_stats":[{"pgid":"6.f","version":"86'1499","reported_seq":1511,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.656363+0000","last_change":"2024-09-15T12:28:39.077376+0000","last_active":"2024-09-15T12:30:40.656363+0000","last_peered":"2024-09-15T12:30:40.656363+0000","last_clean":"2024-09-15T12:30:40.656363+0000","last_became_active":"2024-09-15T12:28:39.068998+0000","last_became_peered":"2024-09-15T12:28:39.068998+0000","last_unstale":"2024-09-15T12:30:40.656363+0000","last_undegraded":"2024-09-15T12:30:40.656363+0000","last_fullsized":"2024-09-15T12:30:40.656363+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1499,"log_dups_size":0,"ondisk_log_size":1499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48300032,"num_objects":737,"num_object_clones":0,"num_object_copies":2211,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1499,"num_write_kb":71552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"86'1506","reported_seq":1518,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.631402+0000","last_change":"2024-09-15T12:28:39.087809+0000","last_active":"2024-09-15T12:30:40.631402+0000","last_peered":"2024-09-15T12:30:40.631402+0000","last_clean":"2024-09-15T12:30:40.631402+0000","last_became_active":"2024-09-15T12:28:39.074098+0000","last_became_peered":"2024-09-15T12:28:39.074098+0000","last_unstale":"2024-09-15T12:30:40.631402+0000","last_undegraded":"2024-09-15T12:30:40.631402+0000","last_fullsized":"2024-09-15T12:30:40.631402+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1506,"log_dups_size":0,"ondisk_log_size":1506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":736,"num_object_clones":0,"num_object_copies":2208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1506,"num_write_kb":71744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"86'1499","reported_seq":1512,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.384829+0000","last_change":"2024-09-15T12:28:39.061230+0000","last_active":"2024-09-15T12:30:40.384829+0000","last_peered":"2024-09-15T12:30:40.384829+0000","last_clean":"2024-09-15T12:30:40.384829+0000","last_became_active":"2024-09-15T12:28:39.046625+0000","last_became_peered":"2024-09-15T12:28:39.046625+0000","last_unstale":"2024-09-15T12:30:40.384829+0000","last_undegraded":"2024-09-15T12:30:40.384829+0000","last_fullsized":"2024-09-15T12:30:40.384829+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1499,"log_dups_size":0,"ondisk_log_size":1499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51904536,"num_objects":793,"num_object_clones":0,"num_object_copies":2379,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1499,"num_write_kb":73281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"86'1450","reported_seq":1462,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:41.706215+0000","last_change":"2024-09-15T12:28:39.043350+0000","last_active":"2024-09-15T12:30:41.706215+0000","last_peered":"2024-09-15T12:30:41.706215+0000","last_clean":"2024-09-15T12:30:41.706215+0000","last_became_active":"2024-09-15T12:28:39.034104+0000","last_became_peered":"2024-09-15T12:28:39.034104+0000","last_unstale":"2024-09-15T12:30:41.706215+0000","last_undegraded":"2024-09-15T12:30:41.706215+0000","last_fullsized":"2024-09-15T12:30:41.706215+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1450,"log_dups_size":0,"ondisk_log_size":1450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47579136,"num_objects":726,"num_object_clones":0,"num_object_copies":2178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1450,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"86'1546","reported_seq":1558,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.603492+0000","last_change":"2024-09-15T12:28:39.083865+0000","last_active":"2024-09-15T12:30:40.603492+0000","last_peered":"2024-09-15T12:30:40.603492+0000","last_clean":"2024-09-15T12:30:40.603492+0000","last_became_active":"2024-09-15T12:28:39.075263+0000","last_became_peered":"2024-09-15T12:28:39.075263+0000","last_unstale":"2024-09-15T12:30:40.603492+0000","last_undegraded":"2024-09-15T12:30:40.603492+0000","last_fullsized":"2024-09-15T12:30:40.603492+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1546,"log_dups_size":0,"ondisk_log_size":1546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49545216,"num_objects":756,"num_object_clones":0,"num_object_copies":2268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1546,"num_write_kb":73664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"86'1409","reported_seq":1421,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.687401+0000","last_change":"2024-09-15T12:28:39.031088+0000","last_active":"2024-09-15T12:30:40.687401+0000","last_peered":"2024-09-15T12:30:40.687401+0000","last_clean":"2024-09-15T12:30:40.687401+0000","last_became_active":"2024-09-15T12:28:39.025037+0000","last_became_peered":"2024-09-15T12:28:39.025037+0000","last_unstale":"2024-09-15T12:30:40.687401+0000","last_undegraded":"2024-09-15T12:30:40.687401+0000","last_fullsized":"2024-09-15T12:30:40.687401+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1409,"log_dups_size":0,"ondisk_log_size":1409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48037888,"num_objects":733,"num_object_clones":0,"num_object_copies":2199,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1409,"num_write_kb":68544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"86'1495","reported_seq":1507,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:41.691265+0000","last_change":"2024-09-15T12:28:39.067539+0000","last_active":"2024-09-15T12:30:41.691265+0000","last_peered":"2024-09-15T12:30:41.691265+0000","last_clean":"2024-09-15T12:30:41.691265+0000","last_became_active":"2024-09-15T12:28:39.054389+0000","last_became_peered":"2024-09-15T12:28:39.054389+0000","last_unstale":"2024-09-15T12:30:41.691265+0000","last_undegraded":"2024-09-15T12:30:41.691265+0000","last_fullsized":"2024-09-15T12:30:41.691265+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1495,"log_dups_size":0,"ondisk_log_size":1495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48037888,"num_objects":733,"num_object_clones":0,"num_object_copies":2199,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1495,"num_write_kb":71296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"86'1432","reported_seq":1444,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.716060+0000","last_change":"2024-09-15T12:28:38.993796+0000","last_active":"2024-09-15T12:30:40.716060+0000","last_peered":"2024-09-15T12:30:40.716060+0000","last_clean":"2024-09-15T12:30:40.716060+0000","last_became_active":"2024-09-15T12:28:38.987121+0000","last_became_peered":"2024-09-15T12:28:38.987121+0000","last_unstale":"2024-09-15T12:30:40.716060+0000","last_undegraded":"2024-09-15T12:30:40.716060+0000","last_fullsized":"2024-09-15T12:30:40.716060+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1432,"log_dups_size":0,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49020928,"num_objects":748,"num_object_clones":0,"num_object_copies":2244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1432,"num_write_kb":69760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"86'1465","reported_seq":1477,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.760154+0000","last_change":"2024-09-15T12:28:39.047799+0000","last_active":"2024-09-15T12:30:40.760154+0000","last_peered":"2024-09-15T12:30:40.760154+0000","last_clean":"2024-09-15T12:30:40.760154+0000","last_became_active":"2024-09-15T12:28:39.017997+0000","last_became_peered":"2024-09-15T12:28:39.017997+0000","last_unstale":"2024-09-15T12:30:40.760154+0000","last_undegraded":"2024-09-15T12:30:40.760154+0000","last_fullsized":"2024-09-15T12:30:40.760154+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1465,"log_dups_size":0,"ondisk_log_size":1465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49348608,"num_objects":753,"num_object_clones":0,"num_object_copies":2259,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1465,"num_write_kb":70976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":301,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.902781+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:28:39.902781+0000","last_peered":"2024-09-15T12:28:39.902781+0000","last_clean":"2024-09-15T12:28:39.902781+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:28:39.902781+0000","last_undegraded":"2024-09-15T12:28:39.902781+0000","last_fullsized":"2024-09-15T12:28:39.902781+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":230,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.911586+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:28:39.911586+0000","last_peered":"2024-09-15T12:28:39.911586+0000","last_clean":"2024-09-15T12:28:39.911586+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:28:39.911586+0000","last_undegraded":"2024-09-15T12:28:39.911586+0000","last_fullsized":"2024-09-15T12:28:39.911586+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"86'1452","reported_seq":1464,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:41.622342+0000","last_change":"2024-09-15T12:28:39.071985+0000","last_active":"2024-09-15T12:30:41.622342+0000","last_peered":"2024-09-15T12:30:41.622342+0000","last_clean":"2024-09-15T12:30:41.622342+0000","last_became_active":"2024-09-15T12:28:39.061062+0000","last_became_peered":"2024-09-15T12:28:39.061062+0000","last_unstale":"2024-09-15T12:30:41.622342+0000","last_undegraded":"2024-09-15T12:30:41.622342+0000","last_fullsized":"2024-09-15T12:30:41.622342+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1452,"log_dups_size":0,"ondisk_log_size":1452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47579136,"num_objects":726,"num_object_clones":0,"num_object_copies":2178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1452,"num_write_kb":69696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.910978+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:28:39.910978+0000","last_peered":"2024-09-15T12:28:39.910978+0000","last_clean":"2024-09-15T12:28:39.910978+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:28:39.910978+0000","last_undegraded":"2024-09-15T12:28:39.910978+0000","last_fullsized":"2024-09-15T12:28:39.910978+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"86'1503","reported_seq":1515,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.597165+0000","last_change":"2024-09-15T12:28:39.025429+0000","last_active":"2024-09-15T12:30:40.597165+0000","last_peered":"2024-09-15T12:30:40.597165+0000","last_clean":"2024-09-15T12:30:40.597165+0000","last_became_active":"2024-09-15T12:28:39.007673+0000","last_became_peered":"2024-09-15T12:28:39.007673+0000","last_unstale":"2024-09-15T12:30:40.597165+0000","last_undegraded":"2024-09-15T12:30:40.597165+0000","last_fullsized":"2024-09-15T12:30:40.597165+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1503,"log_dups_size":0,"ondisk_log_size":1503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48824320,"num_objects":745,"num_object_clones":0,"num_object_copies":2235,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1503,"num_write_kb":71936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.905410+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:28:39.905410+0000","last_peered":"2024-09-15T12:28:39.905410+0000","last_clean":"2024-09-15T12:28:39.905410+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:28:39.905410+0000","last_undegraded":"2024-09-15T12:28:39.905410+0000","last_fullsized":"2024-09-15T12:28:39.905410+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"86'1487","reported_seq":1499,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:41.770963+0000","last_change":"2024-09-15T12:28:39.029713+0000","last_active":"2024-09-15T12:30:41.770963+0000","last_peered":"2024-09-15T12:30:41.770963+0000","last_clean":"2024-09-15T12:30:41.770963+0000","last_became_active":"2024-09-15T12:28:39.020975+0000","last_became_peered":"2024-09-15T12:28:39.020975+0000","last_unstale":"2024-09-15T12:30:41.770963+0000","last_undegraded":"2024-09-15T12:30:41.770963+0000","last_fullsized":"2024-09-15T12:30:41.770963+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1487,"log_dups_size":0,"ondisk_log_size":1487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47644672,"num_objects":727,"num_object_clones":0,"num_object_copies":2181,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1487,"num_write_kb":70848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":231,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.904865+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:28:39.904865+0000","last_peered":"2024-09-15T12:28:39.904865+0000","last_clean":"2024-09-15T12:28:39.904865+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:28:39.904865+0000","last_undegraded":"2024-09-15T12:28:39.904865+0000","last_fullsized":"2024-09-15T12:28:39.904865+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"86'1434","reported_seq":1446,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.617091+0000","last_change":"2024-09-15T12:28:39.023135+0000","last_active":"2024-09-15T12:30:40.617091+0000","last_peered":"2024-09-15T12:30:40.617091+0000","last_clean":"2024-09-15T12:30:40.617091+0000","last_became_active":"2024-09-15T12:28:39.014305+0000","last_became_peered":"2024-09-15T12:28:39.014305+0000","last_unstale":"2024-09-15T12:30:40.617091+0000","last_undegraded":"2024-09-15T12:30:40.617091+0000","last_fullsized":"2024-09-15T12:30:40.617091+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1434,"log_dups_size":0,"ondisk_log_size":1434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":736,"num_object_clones":0,"num_object_copies":2208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1434,"num_write_kb":69440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.907958+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:28:39.907958+0000","last_peered":"2024-09-15T12:28:39.907958+0000","last_clean":"2024-09-15T12:28:39.907958+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:28:39.907958+0000","last_undegraded":"2024-09-15T12:28:39.907958+0000","last_fullsized":"2024-09-15T12:28:39.907958+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"86'1558","reported_seq":1570,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.638804+0000","last_change":"2024-09-15T12:28:39.054857+0000","last_active":"2024-09-15T12:30:40.638804+0000","last_peered":"2024-09-15T12:30:40.638804+0000","last_clean":"2024-09-15T12:30:40.638804+0000","last_became_active":"2024-09-15T12:28:39.046395+0000","last_became_peered":"2024-09-15T12:28:39.046395+0000","last_unstale":"2024-09-15T12:30:40.638804+0000","last_undegraded":"2024-09-15T12:30:40.638804+0000","last_fullsized":"2024-09-15T12:30:40.638804+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1558,"log_dups_size":0,"ondisk_log_size":1558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50593792,"num_objects":772,"num_object_clones":0,"num_object_copies":2316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1558,"num_write_kb":74560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.907938+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:28:39.907938+0000","last_peered":"2024-09-15T12:28:39.907938+0000","last_clean":"2024-09-15T12:28:39.907938+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:28:39.907938+0000","last_undegraded":"2024-09-15T12:28:39.907938+0000","last_fullsized":"2024-09-15T12:28:39.907938+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"86'1571","reported_seq":1583,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.459354+0000","last_change":"2024-09-15T12:28:39.052760+0000","last_active":"2024-09-15T12:30:40.459354+0000","last_peered":"2024-09-15T12:30:40.459354+0000","last_clean":"2024-09-15T12:30:40.459354+0000","last_became_active":"2024-09-15T12:28:39.041365+0000","last_became_peered":"2024-09-15T12:28:39.041365+0000","last_unstale":"2024-09-15T12:30:40.459354+0000","last_undegraded":"2024-09-15T12:30:40.459354+0000","last_fullsized":"2024-09-15T12:30:40.459354+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1571,"log_dups_size":0,"ondisk_log_size":1571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48562176,"num_objects":741,"num_object_clones":0,"num_object_copies":2223,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1571,"num_write_kb":73984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.906843+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:28:39.906843+0000","last_peered":"2024-09-15T12:28:39.906843+0000","last_clean":"2024-09-15T12:28:39.906843+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:28:39.906843+0000","last_undegraded":"2024-09-15T12:28:39.906843+0000","last_fullsized":"2024-09-15T12:28:39.906843+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"86'1403","reported_seq":1415,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.783716+0000","last_change":"2024-09-15T12:28:39.046988+0000","last_active":"2024-09-15T12:30:40.783716+0000","last_peered":"2024-09-15T12:30:40.783716+0000","last_clean":"2024-09-15T12:30:40.783716+0000","last_became_active":"2024-09-15T12:28:39.017167+0000","last_became_peered":"2024-09-15T12:28:39.017167+0000","last_unstale":"2024-09-15T12:30:40.783716+0000","last_undegraded":"2024-09-15T12:30:40.783716+0000","last_fullsized":"2024-09-15T12:30:40.783716+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1403,"log_dups_size":0,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44630016,"num_objects":681,"num_object_clones":0,"num_object_copies":2043,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1403,"num_write_kb":66688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.914018+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:28:39.914018+0000","last_peered":"2024-09-15T12:28:39.914018+0000","last_clean":"2024-09-15T12:28:39.914018+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:28:39.914018+0000","last_undegraded":"2024-09-15T12:28:39.914018+0000","last_fullsized":"2024-09-15T12:28:39.914018+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":776077336,"num_objects":11843,"num_object_clones":0,"num_object_copies":35529,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":23709,"num_write_kb":1137601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":145666048,"data_stored":2330460232,"data_compressed":110662717,"data_compressed_allocated":145653760,"data_compressed_original":2330460160,"omap_allocated":0,"internal_metadata":0},"log_size":23709,"ondisk_log_size":23709,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673678,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":154340,"kb_used_data":33108,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94217500,"statfs":{"total":96636764160,"available":96478720000,"internally_reserved":0,"allocated":33902592,"data_stored":530719472,"data_compressed":25190551,"data_compressed_allocated":33157120,"data_compressed_original":530432000,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":149360,"kb_used_data":33696,"kb_used_omap":0,"kb_used_meta":115648,"kb_avail":94222480,"statfs":{"total":96636764160,"available":96483819520,"internally_reserved":0,"allocated":34504704,"data_stored":540353259,"data_compressed":25648016,"data_compressed_allocated":33759232,"data_compressed_original":540065792,"omap_allocated":0,"internal_metadata":118423552},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":160848,"kb_used_data":39616,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94210992,"statfs":{"total":96636764160,"available":96472055808,"internally_reserved":0,"allocated":40566784,"data_stored":637673699,"data_compressed":30267311,"data_compressed_allocated":39837696,"data_compressed_original":637403136,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":169060,"kb_used_data":39504,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94202780,"statfs":{"total":96636764160,"available":96463646720,"internally_reserved":0,"allocated":40452096,"data_stored":635446019,"data_compressed":30163527,"data_compressed_allocated":39702528,"data_compressed_original":635158528,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":39546880,"data_stored":632684568,"data_compressed":30043247,"data_compressed_allocated":39542784,"data_compressed_original":632684544,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":39632896,"data_stored":634060824,"data_compressed":30108599,"data_compressed_allocated":39628800,"data_compressed_original":634060800,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":536870912,"data_compressed":25493504,"data_compressed_allocated":33554432,"data_compressed_original":536870912,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32931840,"data_stored":526843928,"data_compressed":25017367,"data_compressed_allocated":32927744,"data_compressed_original":526843904,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:30:48.335 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:30:48.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:48.496+0000 7f58b5991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:48.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:48.504+0000 7f58b5991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:51.019 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:30:51.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:51.181+0000 7f4335ca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:51.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:51.188+0000 7f4335ca3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:52.068 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:30:52.069 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-15T12:30:52.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:52.231+0000 7f32982bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:52.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:52.249+0000 7f32982bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:52.908 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.0 to 1 (10000) 2024-09-15T12:30:52.933 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-15T12:30:53.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:53.078+0000 7f5ae1191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:53.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:53.098+0000 7f5ae1191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:53.751 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:30:53.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:53.904+0000 7f1724d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:53.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:53.911+0000 7f1724d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:54.305 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.1 to 1 (10000) 2024-09-15T12:30:54.324 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-15T12:30:54.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:54.485+0000 7f90e5391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:54.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:54.506+0000 7f90dffff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:55.312 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.2 to 1 (10000) 2024-09-15T12:30:55.330 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-15T12:30:55.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:55.462+0000 7ff6fced1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:55.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:55.477+0000 7ff6fced1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:56.313 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.3 to 1 (10000) 2024-09-15T12:30:56.336 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-15T12:30:56.336 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:30:56.403 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:30:56.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:56.476+0000 7fc200046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:56.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:56.488+0000 7fc200046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:56.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:56.563+0000 7f69f0791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:56.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:56.575+0000 7f69ef52f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:56.754 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:30:56.754 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:30:56.774 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":451,"stamp":"2024-09-15T12:30:56.314833+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":776667723,"num_objects":11847,"num_object_clones":0,"num_object_copies":35541,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":23790,"num_write_kb":1138709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23764,"ondisk_log_size":23764,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":633608,"kb_used_data":145924,"kb_used_omap":0,"kb_used_meta":487616,"kb_avail":376853752,"statfs":{"total":386547056640,"available":385898242048,"internally_reserved":0,"allocated":149426176,"data_stored":2344192449,"data_compressed":111269405,"data_compressed_allocated":146456576,"data_compressed_original":2343059456,"omap_allocated":0,"internal_metadata":499318784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.405184"},"pg_stats":[{"pgid":"6.f","version":"86'1499","reported_seq":1511,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.656363+0000","last_change":"2024-09-15T12:28:39.077376+0000","last_active":"2024-09-15T12:30:40.656363+0000","last_peered":"2024-09-15T12:30:40.656363+0000","last_clean":"2024-09-15T12:30:40.656363+0000","last_became_active":"2024-09-15T12:28:39.068998+0000","last_became_peered":"2024-09-15T12:28:39.068998+0000","last_unstale":"2024-09-15T12:30:40.656363+0000","last_undegraded":"2024-09-15T12:30:40.656363+0000","last_fullsized":"2024-09-15T12:30:40.656363+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1499,"log_dups_size":0,"ondisk_log_size":1499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48300032,"num_objects":737,"num_object_clones":0,"num_object_copies":2211,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1499,"num_write_kb":71552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"86'1506","reported_seq":1518,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.631402+0000","last_change":"2024-09-15T12:28:39.087809+0000","last_active":"2024-09-15T12:30:40.631402+0000","last_peered":"2024-09-15T12:30:40.631402+0000","last_clean":"2024-09-15T12:30:40.631402+0000","last_became_active":"2024-09-15T12:28:39.074098+0000","last_became_peered":"2024-09-15T12:28:39.074098+0000","last_unstale":"2024-09-15T12:30:40.631402+0000","last_undegraded":"2024-09-15T12:30:40.631402+0000","last_fullsized":"2024-09-15T12:30:40.631402+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1506,"log_dups_size":0,"ondisk_log_size":1506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":736,"num_object_clones":0,"num_object_copies":2208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1506,"num_write_kb":71744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"86'1499","reported_seq":1512,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.384829+0000","last_change":"2024-09-15T12:28:39.061230+0000","last_active":"2024-09-15T12:30:40.384829+0000","last_peered":"2024-09-15T12:30:40.384829+0000","last_clean":"2024-09-15T12:30:40.384829+0000","last_became_active":"2024-09-15T12:28:39.046625+0000","last_became_peered":"2024-09-15T12:28:39.046625+0000","last_unstale":"2024-09-15T12:30:40.384829+0000","last_undegraded":"2024-09-15T12:30:40.384829+0000","last_fullsized":"2024-09-15T12:30:40.384829+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1499,"log_dups_size":0,"ondisk_log_size":1499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51904536,"num_objects":793,"num_object_clones":0,"num_object_copies":2379,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1499,"num_write_kb":73281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"86'1450","reported_seq":1462,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:41.706215+0000","last_change":"2024-09-15T12:28:39.043350+0000","last_active":"2024-09-15T12:30:41.706215+0000","last_peered":"2024-09-15T12:30:41.706215+0000","last_clean":"2024-09-15T12:30:41.706215+0000","last_became_active":"2024-09-15T12:28:39.034104+0000","last_became_peered":"2024-09-15T12:28:39.034104+0000","last_unstale":"2024-09-15T12:30:41.706215+0000","last_undegraded":"2024-09-15T12:30:41.706215+0000","last_fullsized":"2024-09-15T12:30:41.706215+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1450,"log_dups_size":0,"ondisk_log_size":1450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47579136,"num_objects":726,"num_object_clones":0,"num_object_copies":2178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1450,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"86'1546","reported_seq":1558,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.603492+0000","last_change":"2024-09-15T12:28:39.083865+0000","last_active":"2024-09-15T12:30:40.603492+0000","last_peered":"2024-09-15T12:30:40.603492+0000","last_clean":"2024-09-15T12:30:40.603492+0000","last_became_active":"2024-09-15T12:28:39.075263+0000","last_became_peered":"2024-09-15T12:28:39.075263+0000","last_unstale":"2024-09-15T12:30:40.603492+0000","last_undegraded":"2024-09-15T12:30:40.603492+0000","last_fullsized":"2024-09-15T12:30:40.603492+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1546,"log_dups_size":0,"ondisk_log_size":1546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49545216,"num_objects":756,"num_object_clones":0,"num_object_copies":2268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1546,"num_write_kb":73664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"86'1409","reported_seq":1421,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.687401+0000","last_change":"2024-09-15T12:28:39.031088+0000","last_active":"2024-09-15T12:30:40.687401+0000","last_peered":"2024-09-15T12:30:40.687401+0000","last_clean":"2024-09-15T12:30:40.687401+0000","last_became_active":"2024-09-15T12:28:39.025037+0000","last_became_peered":"2024-09-15T12:28:39.025037+0000","last_unstale":"2024-09-15T12:30:40.687401+0000","last_undegraded":"2024-09-15T12:30:40.687401+0000","last_fullsized":"2024-09-15T12:30:40.687401+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1409,"log_dups_size":0,"ondisk_log_size":1409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48037888,"num_objects":733,"num_object_clones":0,"num_object_copies":2199,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1409,"num_write_kb":68544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"86'1495","reported_seq":1507,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:41.691265+0000","last_change":"2024-09-15T12:28:39.067539+0000","last_active":"2024-09-15T12:30:41.691265+0000","last_peered":"2024-09-15T12:30:41.691265+0000","last_clean":"2024-09-15T12:30:41.691265+0000","last_became_active":"2024-09-15T12:28:39.054389+0000","last_became_peered":"2024-09-15T12:28:39.054389+0000","last_unstale":"2024-09-15T12:30:41.691265+0000","last_undegraded":"2024-09-15T12:30:41.691265+0000","last_fullsized":"2024-09-15T12:30:41.691265+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1495,"log_dups_size":0,"ondisk_log_size":1495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48037888,"num_objects":733,"num_object_clones":0,"num_object_copies":2199,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1495,"num_write_kb":71296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"86'1432","reported_seq":1444,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.716060+0000","last_change":"2024-09-15T12:28:38.993796+0000","last_active":"2024-09-15T12:30:40.716060+0000","last_peered":"2024-09-15T12:30:40.716060+0000","last_clean":"2024-09-15T12:30:40.716060+0000","last_became_active":"2024-09-15T12:28:38.987121+0000","last_became_peered":"2024-09-15T12:28:38.987121+0000","last_unstale":"2024-09-15T12:30:40.716060+0000","last_undegraded":"2024-09-15T12:30:40.716060+0000","last_fullsized":"2024-09-15T12:30:40.716060+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1432,"log_dups_size":0,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49020928,"num_objects":748,"num_object_clones":0,"num_object_copies":2244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1432,"num_write_kb":69760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"86'1465","reported_seq":1477,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.760154+0000","last_change":"2024-09-15T12:28:39.047799+0000","last_active":"2024-09-15T12:30:40.760154+0000","last_peered":"2024-09-15T12:30:40.760154+0000","last_clean":"2024-09-15T12:30:40.760154+0000","last_became_active":"2024-09-15T12:28:39.017997+0000","last_became_peered":"2024-09-15T12:28:39.017997+0000","last_unstale":"2024-09-15T12:30:40.760154+0000","last_undegraded":"2024-09-15T12:30:40.760154+0000","last_fullsized":"2024-09-15T12:30:40.760154+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1465,"log_dups_size":0,"ondisk_log_size":1465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49348608,"num_objects":753,"num_object_clones":0,"num_object_copies":2259,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1465,"num_write_kb":70976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":301,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.902781+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:28:39.902781+0000","last_peered":"2024-09-15T12:28:39.902781+0000","last_clean":"2024-09-15T12:28:39.902781+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:28:39.902781+0000","last_undegraded":"2024-09-15T12:28:39.902781+0000","last_fullsized":"2024-09-15T12:28:39.902781+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":230,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.911586+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:28:39.911586+0000","last_peered":"2024-09-15T12:28:39.911586+0000","last_clean":"2024-09-15T12:28:39.911586+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:28:39.911586+0000","last_undegraded":"2024-09-15T12:28:39.911586+0000","last_fullsized":"2024-09-15T12:28:39.911586+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"86'1452","reported_seq":1464,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:41.622342+0000","last_change":"2024-09-15T12:28:39.071985+0000","last_active":"2024-09-15T12:30:41.622342+0000","last_peered":"2024-09-15T12:30:41.622342+0000","last_clean":"2024-09-15T12:30:41.622342+0000","last_became_active":"2024-09-15T12:28:39.061062+0000","last_became_peered":"2024-09-15T12:28:39.061062+0000","last_unstale":"2024-09-15T12:30:41.622342+0000","last_undegraded":"2024-09-15T12:30:41.622342+0000","last_fullsized":"2024-09-15T12:30:41.622342+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1452,"log_dups_size":0,"ondisk_log_size":1452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47579136,"num_objects":726,"num_object_clones":0,"num_object_copies":2178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1452,"num_write_kb":69696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.910978+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:28:39.910978+0000","last_peered":"2024-09-15T12:28:39.910978+0000","last_clean":"2024-09-15T12:28:39.910978+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:28:39.910978+0000","last_undegraded":"2024-09-15T12:28:39.910978+0000","last_fullsized":"2024-09-15T12:28:39.910978+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"86'1503","reported_seq":1515,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.597165+0000","last_change":"2024-09-15T12:28:39.025429+0000","last_active":"2024-09-15T12:30:40.597165+0000","last_peered":"2024-09-15T12:30:40.597165+0000","last_clean":"2024-09-15T12:30:40.597165+0000","last_became_active":"2024-09-15T12:28:39.007673+0000","last_became_peered":"2024-09-15T12:28:39.007673+0000","last_unstale":"2024-09-15T12:30:40.597165+0000","last_undegraded":"2024-09-15T12:30:40.597165+0000","last_fullsized":"2024-09-15T12:30:40.597165+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1503,"log_dups_size":0,"ondisk_log_size":1503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48824320,"num_objects":745,"num_object_clones":0,"num_object_copies":2235,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1503,"num_write_kb":71936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.905410+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:28:39.905410+0000","last_peered":"2024-09-15T12:28:39.905410+0000","last_clean":"2024-09-15T12:28:39.905410+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:28:39.905410+0000","last_undegraded":"2024-09-15T12:28:39.905410+0000","last_fullsized":"2024-09-15T12:28:39.905410+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"86'1487","reported_seq":1499,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:41.770963+0000","last_change":"2024-09-15T12:28:39.029713+0000","last_active":"2024-09-15T12:30:41.770963+0000","last_peered":"2024-09-15T12:30:41.770963+0000","last_clean":"2024-09-15T12:30:41.770963+0000","last_became_active":"2024-09-15T12:28:39.020975+0000","last_became_peered":"2024-09-15T12:28:39.020975+0000","last_unstale":"2024-09-15T12:30:41.770963+0000","last_undegraded":"2024-09-15T12:30:41.770963+0000","last_fullsized":"2024-09-15T12:30:41.770963+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1487,"log_dups_size":0,"ondisk_log_size":1487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47644672,"num_objects":727,"num_object_clones":0,"num_object_copies":2181,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1487,"num_write_kb":70848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":231,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.904865+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:28:39.904865+0000","last_peered":"2024-09-15T12:28:39.904865+0000","last_clean":"2024-09-15T12:28:39.904865+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:28:39.904865+0000","last_undegraded":"2024-09-15T12:28:39.904865+0000","last_fullsized":"2024-09-15T12:28:39.904865+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"86'1434","reported_seq":1446,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.617091+0000","last_change":"2024-09-15T12:28:39.023135+0000","last_active":"2024-09-15T12:30:40.617091+0000","last_peered":"2024-09-15T12:30:40.617091+0000","last_clean":"2024-09-15T12:30:40.617091+0000","last_became_active":"2024-09-15T12:28:39.014305+0000","last_became_peered":"2024-09-15T12:28:39.014305+0000","last_unstale":"2024-09-15T12:30:40.617091+0000","last_undegraded":"2024-09-15T12:30:40.617091+0000","last_fullsized":"2024-09-15T12:30:40.617091+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1434,"log_dups_size":0,"ondisk_log_size":1434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":736,"num_object_clones":0,"num_object_copies":2208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1434,"num_write_kb":69440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.907958+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:28:39.907958+0000","last_peered":"2024-09-15T12:28:39.907958+0000","last_clean":"2024-09-15T12:28:39.907958+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:28:39.907958+0000","last_undegraded":"2024-09-15T12:28:39.907958+0000","last_fullsized":"2024-09-15T12:28:39.907958+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"86'1558","reported_seq":1570,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.638804+0000","last_change":"2024-09-15T12:28:39.054857+0000","last_active":"2024-09-15T12:30:40.638804+0000","last_peered":"2024-09-15T12:30:40.638804+0000","last_clean":"2024-09-15T12:30:40.638804+0000","last_became_active":"2024-09-15T12:28:39.046395+0000","last_became_peered":"2024-09-15T12:28:39.046395+0000","last_unstale":"2024-09-15T12:30:40.638804+0000","last_undegraded":"2024-09-15T12:30:40.638804+0000","last_fullsized":"2024-09-15T12:30:40.638804+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1558,"log_dups_size":0,"ondisk_log_size":1558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50593792,"num_objects":772,"num_object_clones":0,"num_object_copies":2316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1558,"num_write_kb":74560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.907938+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:28:39.907938+0000","last_peered":"2024-09-15T12:28:39.907938+0000","last_clean":"2024-09-15T12:28:39.907938+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:28:39.907938+0000","last_undegraded":"2024-09-15T12:28:39.907938+0000","last_fullsized":"2024-09-15T12:28:39.907938+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"86'1571","reported_seq":1583,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.459354+0000","last_change":"2024-09-15T12:28:39.052760+0000","last_active":"2024-09-15T12:30:40.459354+0000","last_peered":"2024-09-15T12:30:40.459354+0000","last_clean":"2024-09-15T12:30:40.459354+0000","last_became_active":"2024-09-15T12:28:39.041365+0000","last_became_peered":"2024-09-15T12:28:39.041365+0000","last_unstale":"2024-09-15T12:30:40.459354+0000","last_undegraded":"2024-09-15T12:30:40.459354+0000","last_fullsized":"2024-09-15T12:30:40.459354+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1571,"log_dups_size":0,"ondisk_log_size":1571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48562176,"num_objects":741,"num_object_clones":0,"num_object_copies":2223,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1571,"num_write_kb":73984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.906843+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:28:39.906843+0000","last_peered":"2024-09-15T12:28:39.906843+0000","last_clean":"2024-09-15T12:28:39.906843+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:28:39.906843+0000","last_undegraded":"2024-09-15T12:28:39.906843+0000","last_fullsized":"2024-09-15T12:28:39.906843+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"86'1403","reported_seq":1415,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.783716+0000","last_change":"2024-09-15T12:28:39.046988+0000","last_active":"2024-09-15T12:30:40.783716+0000","last_peered":"2024-09-15T12:30:40.783716+0000","last_clean":"2024-09-15T12:30:40.783716+0000","last_became_active":"2024-09-15T12:28:39.017167+0000","last_became_peered":"2024-09-15T12:28:39.017167+0000","last_unstale":"2024-09-15T12:30:40.783716+0000","last_undegraded":"2024-09-15T12:30:40.783716+0000","last_fullsized":"2024-09-15T12:30:40.783716+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1403,"log_dups_size":0,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44630016,"num_objects":681,"num_object_clones":0,"num_object_copies":2043,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1403,"num_write_kb":66688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.914018+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:28:39.914018+0000","last_peered":"2024-09-15T12:28:39.914018+0000","last_clean":"2024-09-15T12:28:39.914018+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:28:39.914018+0000","last_undegraded":"2024-09-15T12:28:39.914018+0000","last_fullsized":"2024-09-15T12:28:39.914018+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":776077336,"num_objects":11843,"num_object_clones":0,"num_object_copies":35529,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":23709,"num_write_kb":1137601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":145666048,"data_stored":2330460232,"data_compressed":110662717,"data_compressed_allocated":145653760,"data_compressed_original":2330460160,"omap_allocated":0,"internal_metadata":0},"log_size":23709,"ondisk_log_size":23709,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673678,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":154340,"kb_used_data":33108,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94217500,"statfs":{"total":96636764160,"available":96478720000,"internally_reserved":0,"allocated":33902592,"data_stored":530719472,"data_compressed":25190551,"data_compressed_allocated":33157120,"data_compressed_original":530432000,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":149360,"kb_used_data":33696,"kb_used_omap":0,"kb_used_meta":115648,"kb_avail":94222480,"statfs":{"total":96636764160,"available":96483819520,"internally_reserved":0,"allocated":34504704,"data_stored":540353259,"data_compressed":25648016,"data_compressed_allocated":33759232,"data_compressed_original":540065792,"omap_allocated":0,"internal_metadata":118423552},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":160848,"kb_used_data":39616,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94210992,"statfs":{"total":96636764160,"available":96472055808,"internally_reserved":0,"allocated":40566784,"data_stored":637673699,"data_compressed":30267311,"data_compressed_allocated":39837696,"data_compressed_original":637403136,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":169060,"kb_used_data":39504,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94202780,"statfs":{"total":96636764160,"available":96463646720,"internally_reserved":0,"allocated":40452096,"data_stored":635446019,"data_compressed":30163527,"data_compressed_allocated":39702528,"data_compressed_original":635158528,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":39546880,"data_stored":632684568,"data_compressed":30043247,"data_compressed_allocated":39542784,"data_compressed_original":632684544,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":39632896,"data_stored":634060824,"data_compressed":30108599,"data_compressed_allocated":39628800,"data_compressed_original":634060800,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":536870912,"data_compressed":25493504,"data_compressed_allocated":33554432,"data_compressed_original":536870912,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32931840,"data_stored":526843928,"data_compressed":25017367,"data_compressed_allocated":32927744,"data_compressed_original":526843904,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:30:56.776 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:30:56.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:56.934+0000 7fbe734ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:56.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:56.945+0000 7fbe734ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:57.319 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:30:57.320 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:30:57.340 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":451,"stamp":"2024-09-15T12:30:56.314833+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":776667723,"num_objects":11847,"num_object_clones":0,"num_object_copies":35541,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":23790,"num_write_kb":1138709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23764,"ondisk_log_size":23764,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":633608,"kb_used_data":145924,"kb_used_omap":0,"kb_used_meta":487616,"kb_avail":376853752,"statfs":{"total":386547056640,"available":385898242048,"internally_reserved":0,"allocated":149426176,"data_stored":2344192449,"data_compressed":111269405,"data_compressed_allocated":146456576,"data_compressed_original":2343059456,"omap_allocated":0,"internal_metadata":499318784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.405184"},"pg_stats":[{"pgid":"6.f","version":"86'1499","reported_seq":1511,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.656363+0000","last_change":"2024-09-15T12:28:39.077376+0000","last_active":"2024-09-15T12:30:40.656363+0000","last_peered":"2024-09-15T12:30:40.656363+0000","last_clean":"2024-09-15T12:30:40.656363+0000","last_became_active":"2024-09-15T12:28:39.068998+0000","last_became_peered":"2024-09-15T12:28:39.068998+0000","last_unstale":"2024-09-15T12:30:40.656363+0000","last_undegraded":"2024-09-15T12:30:40.656363+0000","last_fullsized":"2024-09-15T12:30:40.656363+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1499,"log_dups_size":0,"ondisk_log_size":1499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48300032,"num_objects":737,"num_object_clones":0,"num_object_copies":2211,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1499,"num_write_kb":71552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"86'1506","reported_seq":1518,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.631402+0000","last_change":"2024-09-15T12:28:39.087809+0000","last_active":"2024-09-15T12:30:40.631402+0000","last_peered":"2024-09-15T12:30:40.631402+0000","last_clean":"2024-09-15T12:30:40.631402+0000","last_became_active":"2024-09-15T12:28:39.074098+0000","last_became_peered":"2024-09-15T12:28:39.074098+0000","last_unstale":"2024-09-15T12:30:40.631402+0000","last_undegraded":"2024-09-15T12:30:40.631402+0000","last_fullsized":"2024-09-15T12:30:40.631402+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1506,"log_dups_size":0,"ondisk_log_size":1506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":736,"num_object_clones":0,"num_object_copies":2208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1506,"num_write_kb":71744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"86'1499","reported_seq":1512,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.384829+0000","last_change":"2024-09-15T12:28:39.061230+0000","last_active":"2024-09-15T12:30:40.384829+0000","last_peered":"2024-09-15T12:30:40.384829+0000","last_clean":"2024-09-15T12:30:40.384829+0000","last_became_active":"2024-09-15T12:28:39.046625+0000","last_became_peered":"2024-09-15T12:28:39.046625+0000","last_unstale":"2024-09-15T12:30:40.384829+0000","last_undegraded":"2024-09-15T12:30:40.384829+0000","last_fullsized":"2024-09-15T12:30:40.384829+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1499,"log_dups_size":0,"ondisk_log_size":1499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51904536,"num_objects":793,"num_object_clones":0,"num_object_copies":2379,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1499,"num_write_kb":73281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"86'1450","reported_seq":1462,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:41.706215+0000","last_change":"2024-09-15T12:28:39.043350+0000","last_active":"2024-09-15T12:30:41.706215+0000","last_peered":"2024-09-15T12:30:41.706215+0000","last_clean":"2024-09-15T12:30:41.706215+0000","last_became_active":"2024-09-15T12:28:39.034104+0000","last_became_peered":"2024-09-15T12:28:39.034104+0000","last_unstale":"2024-09-15T12:30:41.706215+0000","last_undegraded":"2024-09-15T12:30:41.706215+0000","last_fullsized":"2024-09-15T12:30:41.706215+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1450,"log_dups_size":0,"ondisk_log_size":1450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47579136,"num_objects":726,"num_object_clones":0,"num_object_copies":2178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1450,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"86'1546","reported_seq":1558,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.603492+0000","last_change":"2024-09-15T12:28:39.083865+0000","last_active":"2024-09-15T12:30:40.603492+0000","last_peered":"2024-09-15T12:30:40.603492+0000","last_clean":"2024-09-15T12:30:40.603492+0000","last_became_active":"2024-09-15T12:28:39.075263+0000","last_became_peered":"2024-09-15T12:28:39.075263+0000","last_unstale":"2024-09-15T12:30:40.603492+0000","last_undegraded":"2024-09-15T12:30:40.603492+0000","last_fullsized":"2024-09-15T12:30:40.603492+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1546,"log_dups_size":0,"ondisk_log_size":1546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49545216,"num_objects":756,"num_object_clones":0,"num_object_copies":2268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1546,"num_write_kb":73664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"86'1409","reported_seq":1421,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.687401+0000","last_change":"2024-09-15T12:28:39.031088+0000","last_active":"2024-09-15T12:30:40.687401+0000","last_peered":"2024-09-15T12:30:40.687401+0000","last_clean":"2024-09-15T12:30:40.687401+0000","last_became_active":"2024-09-15T12:28:39.025037+0000","last_became_peered":"2024-09-15T12:28:39.025037+0000","last_unstale":"2024-09-15T12:30:40.687401+0000","last_undegraded":"2024-09-15T12:30:40.687401+0000","last_fullsized":"2024-09-15T12:30:40.687401+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1409,"log_dups_size":0,"ondisk_log_size":1409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48037888,"num_objects":733,"num_object_clones":0,"num_object_copies":2199,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1409,"num_write_kb":68544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"86'1495","reported_seq":1507,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:41.691265+0000","last_change":"2024-09-15T12:28:39.067539+0000","last_active":"2024-09-15T12:30:41.691265+0000","last_peered":"2024-09-15T12:30:41.691265+0000","last_clean":"2024-09-15T12:30:41.691265+0000","last_became_active":"2024-09-15T12:28:39.054389+0000","last_became_peered":"2024-09-15T12:28:39.054389+0000","last_unstale":"2024-09-15T12:30:41.691265+0000","last_undegraded":"2024-09-15T12:30:41.691265+0000","last_fullsized":"2024-09-15T12:30:41.691265+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1495,"log_dups_size":0,"ondisk_log_size":1495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48037888,"num_objects":733,"num_object_clones":0,"num_object_copies":2199,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1495,"num_write_kb":71296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"86'1432","reported_seq":1444,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.716060+0000","last_change":"2024-09-15T12:28:38.993796+0000","last_active":"2024-09-15T12:30:40.716060+0000","last_peered":"2024-09-15T12:30:40.716060+0000","last_clean":"2024-09-15T12:30:40.716060+0000","last_became_active":"2024-09-15T12:28:38.987121+0000","last_became_peered":"2024-09-15T12:28:38.987121+0000","last_unstale":"2024-09-15T12:30:40.716060+0000","last_undegraded":"2024-09-15T12:30:40.716060+0000","last_fullsized":"2024-09-15T12:30:40.716060+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1432,"log_dups_size":0,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49020928,"num_objects":748,"num_object_clones":0,"num_object_copies":2244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1432,"num_write_kb":69760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"86'1465","reported_seq":1477,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.760154+0000","last_change":"2024-09-15T12:28:39.047799+0000","last_active":"2024-09-15T12:30:40.760154+0000","last_peered":"2024-09-15T12:30:40.760154+0000","last_clean":"2024-09-15T12:30:40.760154+0000","last_became_active":"2024-09-15T12:28:39.017997+0000","last_became_peered":"2024-09-15T12:28:39.017997+0000","last_unstale":"2024-09-15T12:30:40.760154+0000","last_undegraded":"2024-09-15T12:30:40.760154+0000","last_fullsized":"2024-09-15T12:30:40.760154+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1465,"log_dups_size":0,"ondisk_log_size":1465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49348608,"num_objects":753,"num_object_clones":0,"num_object_copies":2259,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1465,"num_write_kb":70976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":301,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.902781+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:28:39.902781+0000","last_peered":"2024-09-15T12:28:39.902781+0000","last_clean":"2024-09-15T12:28:39.902781+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:28:39.902781+0000","last_undegraded":"2024-09-15T12:28:39.902781+0000","last_fullsized":"2024-09-15T12:28:39.902781+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":230,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.911586+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:28:39.911586+0000","last_peered":"2024-09-15T12:28:39.911586+0000","last_clean":"2024-09-15T12:28:39.911586+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:28:39.911586+0000","last_undegraded":"2024-09-15T12:28:39.911586+0000","last_fullsized":"2024-09-15T12:28:39.911586+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"86'1452","reported_seq":1464,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:41.622342+0000","last_change":"2024-09-15T12:28:39.071985+0000","last_active":"2024-09-15T12:30:41.622342+0000","last_peered":"2024-09-15T12:30:41.622342+0000","last_clean":"2024-09-15T12:30:41.622342+0000","last_became_active":"2024-09-15T12:28:39.061062+0000","last_became_peered":"2024-09-15T12:28:39.061062+0000","last_unstale":"2024-09-15T12:30:41.622342+0000","last_undegraded":"2024-09-15T12:30:41.622342+0000","last_fullsized":"2024-09-15T12:30:41.622342+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1452,"log_dups_size":0,"ondisk_log_size":1452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47579136,"num_objects":726,"num_object_clones":0,"num_object_copies":2178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1452,"num_write_kb":69696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.910978+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:28:39.910978+0000","last_peered":"2024-09-15T12:28:39.910978+0000","last_clean":"2024-09-15T12:28:39.910978+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:28:39.910978+0000","last_undegraded":"2024-09-15T12:28:39.910978+0000","last_fullsized":"2024-09-15T12:28:39.910978+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"86'1503","reported_seq":1515,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.597165+0000","last_change":"2024-09-15T12:28:39.025429+0000","last_active":"2024-09-15T12:30:40.597165+0000","last_peered":"2024-09-15T12:30:40.597165+0000","last_clean":"2024-09-15T12:30:40.597165+0000","last_became_active":"2024-09-15T12:28:39.007673+0000","last_became_peered":"2024-09-15T12:28:39.007673+0000","last_unstale":"2024-09-15T12:30:40.597165+0000","last_undegraded":"2024-09-15T12:30:40.597165+0000","last_fullsized":"2024-09-15T12:30:40.597165+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1503,"log_dups_size":0,"ondisk_log_size":1503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48824320,"num_objects":745,"num_object_clones":0,"num_object_copies":2235,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1503,"num_write_kb":71936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.905410+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:28:39.905410+0000","last_peered":"2024-09-15T12:28:39.905410+0000","last_clean":"2024-09-15T12:28:39.905410+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:28:39.905410+0000","last_undegraded":"2024-09-15T12:28:39.905410+0000","last_fullsized":"2024-09-15T12:28:39.905410+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"86'1487","reported_seq":1499,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:41.770963+0000","last_change":"2024-09-15T12:28:39.029713+0000","last_active":"2024-09-15T12:30:41.770963+0000","last_peered":"2024-09-15T12:30:41.770963+0000","last_clean":"2024-09-15T12:30:41.770963+0000","last_became_active":"2024-09-15T12:28:39.020975+0000","last_became_peered":"2024-09-15T12:28:39.020975+0000","last_unstale":"2024-09-15T12:30:41.770963+0000","last_undegraded":"2024-09-15T12:30:41.770963+0000","last_fullsized":"2024-09-15T12:30:41.770963+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1487,"log_dups_size":0,"ondisk_log_size":1487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47644672,"num_objects":727,"num_object_clones":0,"num_object_copies":2181,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1487,"num_write_kb":70848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":231,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.904865+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:28:39.904865+0000","last_peered":"2024-09-15T12:28:39.904865+0000","last_clean":"2024-09-15T12:28:39.904865+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:28:39.904865+0000","last_undegraded":"2024-09-15T12:28:39.904865+0000","last_fullsized":"2024-09-15T12:28:39.904865+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"86'1434","reported_seq":1446,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.617091+0000","last_change":"2024-09-15T12:28:39.023135+0000","last_active":"2024-09-15T12:30:40.617091+0000","last_peered":"2024-09-15T12:30:40.617091+0000","last_clean":"2024-09-15T12:30:40.617091+0000","last_became_active":"2024-09-15T12:28:39.014305+0000","last_became_peered":"2024-09-15T12:28:39.014305+0000","last_unstale":"2024-09-15T12:30:40.617091+0000","last_undegraded":"2024-09-15T12:30:40.617091+0000","last_fullsized":"2024-09-15T12:30:40.617091+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1434,"log_dups_size":0,"ondisk_log_size":1434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":736,"num_object_clones":0,"num_object_copies":2208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1434,"num_write_kb":69440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.907958+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:28:39.907958+0000","last_peered":"2024-09-15T12:28:39.907958+0000","last_clean":"2024-09-15T12:28:39.907958+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:28:39.907958+0000","last_undegraded":"2024-09-15T12:28:39.907958+0000","last_fullsized":"2024-09-15T12:28:39.907958+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"86'1558","reported_seq":1570,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.638804+0000","last_change":"2024-09-15T12:28:39.054857+0000","last_active":"2024-09-15T12:30:40.638804+0000","last_peered":"2024-09-15T12:30:40.638804+0000","last_clean":"2024-09-15T12:30:40.638804+0000","last_became_active":"2024-09-15T12:28:39.046395+0000","last_became_peered":"2024-09-15T12:28:39.046395+0000","last_unstale":"2024-09-15T12:30:40.638804+0000","last_undegraded":"2024-09-15T12:30:40.638804+0000","last_fullsized":"2024-09-15T12:30:40.638804+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1558,"log_dups_size":0,"ondisk_log_size":1558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50593792,"num_objects":772,"num_object_clones":0,"num_object_copies":2316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1558,"num_write_kb":74560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.907938+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:28:39.907938+0000","last_peered":"2024-09-15T12:28:39.907938+0000","last_clean":"2024-09-15T12:28:39.907938+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:28:39.907938+0000","last_undegraded":"2024-09-15T12:28:39.907938+0000","last_fullsized":"2024-09-15T12:28:39.907938+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"86'1571","reported_seq":1583,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.459354+0000","last_change":"2024-09-15T12:28:39.052760+0000","last_active":"2024-09-15T12:30:40.459354+0000","last_peered":"2024-09-15T12:30:40.459354+0000","last_clean":"2024-09-15T12:30:40.459354+0000","last_became_active":"2024-09-15T12:28:39.041365+0000","last_became_peered":"2024-09-15T12:28:39.041365+0000","last_unstale":"2024-09-15T12:30:40.459354+0000","last_undegraded":"2024-09-15T12:30:40.459354+0000","last_fullsized":"2024-09-15T12:30:40.459354+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1571,"log_dups_size":0,"ondisk_log_size":1571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48562176,"num_objects":741,"num_object_clones":0,"num_object_copies":2223,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1571,"num_write_kb":73984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.906843+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:28:39.906843+0000","last_peered":"2024-09-15T12:28:39.906843+0000","last_clean":"2024-09-15T12:28:39.906843+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:28:39.906843+0000","last_undegraded":"2024-09-15T12:28:39.906843+0000","last_fullsized":"2024-09-15T12:28:39.906843+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"86'1403","reported_seq":1415,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.783716+0000","last_change":"2024-09-15T12:28:39.046988+0000","last_active":"2024-09-15T12:30:40.783716+0000","last_peered":"2024-09-15T12:30:40.783716+0000","last_clean":"2024-09-15T12:30:40.783716+0000","last_became_active":"2024-09-15T12:28:39.017167+0000","last_became_peered":"2024-09-15T12:28:39.017167+0000","last_unstale":"2024-09-15T12:30:40.783716+0000","last_undegraded":"2024-09-15T12:30:40.783716+0000","last_fullsized":"2024-09-15T12:30:40.783716+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1403,"log_dups_size":0,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44630016,"num_objects":681,"num_object_clones":0,"num_object_copies":2043,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1403,"num_write_kb":66688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.914018+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:28:39.914018+0000","last_peered":"2024-09-15T12:28:39.914018+0000","last_clean":"2024-09-15T12:28:39.914018+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:28:39.914018+0000","last_undegraded":"2024-09-15T12:28:39.914018+0000","last_fullsized":"2024-09-15T12:28:39.914018+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":776077336,"num_objects":11843,"num_object_clones":0,"num_object_copies":35529,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":23709,"num_write_kb":1137601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":145666048,"data_stored":2330460232,"data_compressed":110662717,"data_compressed_allocated":145653760,"data_compressed_original":2330460160,"omap_allocated":0,"internal_metadata":0},"log_size":23709,"ondisk_log_size":23709,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673678,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":154340,"kb_used_data":33108,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94217500,"statfs":{"total":96636764160,"available":96478720000,"internally_reserved":0,"allocated":33902592,"data_stored":530719472,"data_compressed":25190551,"data_compressed_allocated":33157120,"data_compressed_original":530432000,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":149360,"kb_used_data":33696,"kb_used_omap":0,"kb_used_meta":115648,"kb_avail":94222480,"statfs":{"total":96636764160,"available":96483819520,"internally_reserved":0,"allocated":34504704,"data_stored":540353259,"data_compressed":25648016,"data_compressed_allocated":33759232,"data_compressed_original":540065792,"omap_allocated":0,"internal_metadata":118423552},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":160848,"kb_used_data":39616,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94210992,"statfs":{"total":96636764160,"available":96472055808,"internally_reserved":0,"allocated":40566784,"data_stored":637673699,"data_compressed":30267311,"data_compressed_allocated":39837696,"data_compressed_original":637403136,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":169060,"kb_used_data":39504,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94202780,"statfs":{"total":96636764160,"available":96463646720,"internally_reserved":0,"allocated":40452096,"data_stored":635446019,"data_compressed":30163527,"data_compressed_allocated":39702528,"data_compressed_original":635158528,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":39546880,"data_stored":632684568,"data_compressed":30043247,"data_compressed_allocated":39542784,"data_compressed_original":632684544,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":39632896,"data_stored":634060824,"data_compressed":30108599,"data_compressed_allocated":39628800,"data_compressed_original":634060800,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":536870912,"data_compressed":25493504,"data_compressed_allocated":33554432,"data_compressed_original":536870912,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32931840,"data_stored":526843928,"data_compressed":25017367,"data_compressed_allocated":32927744,"data_compressed_original":526843904,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:30:57.341 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-15T12:30:57.341 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:30:57.341 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:30:57.342 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:30:57.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:57.503+0000 7fe346cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:57.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:57.523+0000 7fe346cfd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:57.757 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:30:57.757 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:30:57.757 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:30:57.758 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:30:57.758 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:30:57.758 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:30:57.758 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:30:57.758 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:30:57.758 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:30:57.758 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:30:57.758 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:30:57.758 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:30:57.761 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:30:57.761 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:30:57.761 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:30:57.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:57.907+0000 7fe981351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:57.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:57.925+0000 7fe981351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:58.073 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:30:58.073 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:30:58.073 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:30:58.073 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:30:58.074 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:30:58.074 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:30:58.074 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:30:58.074 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:30:58.074 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:30:58.074 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:30:58.074 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:30:58.074 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:30:58.079 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:30:58.079 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:30:58.079 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:30:58.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:58.242+0000 7f6acab48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:58.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:58.261+0000 7f6acab48640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:58.512 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:30:58.512 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:30:58.512 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:30:58.512 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:30:58.512 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:30:58.512 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:30:58.513 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:30:58.513 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:30:58.513 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:30:58.513 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:30:58.513 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:30:58.513 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:30:58.516 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:30:58.516 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:30:58.516 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:30:58.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:58.664+0000 7facb86d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:58.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:58.678+0000 7facb86d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:58.761 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:30:58.761 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:30:58.761 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:30:58.761 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:30:58.762 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:30:58.762 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:30:58.762 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:30:58.762 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:30:58.762 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:30:58.762 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:30:58.762 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:30:58.762 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:30:58.765 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:30:58.765 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:30:59.016 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:30:59.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:59.158+0000 7f72d0257640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:30:59.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:30:59.167+0000 7f72d0257640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:01.794 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:31:01.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:01.925+0000 7f79f2ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:01.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:01.932+0000 7f79f2ed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:03.767 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:31:03.767 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:31:03.767 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:31:03.767 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:31:03.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:03.938+0000 7f7743991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:03.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:03.954+0000 7f7743991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:04.186 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:31:04.186 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:31:04.186 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:31:04.187 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:31:04.187 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:31:04.187 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:31:04.187 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:31:04.187 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:31:04.187 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:31:04.187 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:31:04.187 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:31:04.187 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:31:04.191 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:31:04.192 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:31:04.192 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:31:04.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:04.356+0000 7fd243548640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:04.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:04.371+0000 7fd243548640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:04.399 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:31:04.399 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:31:04.399 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:31:04.399 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:31:04.399 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:31:04.399 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:31:04.399 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:31:04.399 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:31:04.400 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:31:04.400 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:31:04.400 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:31:04.400 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:31:04.404 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:31:04.405 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:31:04.405 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:31:04.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:04.568+0000 7f4e78efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:04.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:04.585+0000 7f4e78efd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:04.682 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:31:04.826 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:31:04.827 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:31:04.827 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:31:04.827 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:31:04.827 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:31:04.827 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:31:04.827 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:31:04.827 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:31:04.827 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:31:04.827 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:31:04.827 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:31:04.827 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:31:04.831 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:31:04.832 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:31:04.832 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:31:04.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:04.840+0000 7fa3d8791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:04.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:04.848+0000 7fa3d8791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:05.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:05.005+0000 7f2a98791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:05.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:05.020+0000 7f2a98791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:05.079 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:31:05.080 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:31:05.080 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:31:05.080 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:31:05.080 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:31:05.080 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:31:05.080 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:31:05.080 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:31:05.080 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:31:05.080 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:31:05.081 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:31:05.081 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:31:05.084 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:31:05.084 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:31:07.544 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:31:07.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:07.700+0000 7fbc4acd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:07.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:07.710+0000 7fbc4acd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:10.086 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:31:10.086 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:31:10.086 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:31:10.207 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:31:10.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:10.231+0000 7f6a10f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:10.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:10.247+0000 7f6a10f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:10.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:10.347+0000 7fddaf911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:10.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:10.355+0000 7fddaf911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:10.630 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:31:10.630 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:31:10.651 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":459,"stamp":"2024-09-15T12:31:09.850932+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":776667723,"num_objects":11847,"num_object_clones":0,"num_object_copies":35541,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":23790,"num_write_kb":1138709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23764,"ondisk_log_size":23764,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":633608,"kb_used_data":145924,"kb_used_omap":0,"kb_used_meta":487616,"kb_avail":376853752,"statfs":{"total":386547056640,"available":385898242048,"internally_reserved":0,"allocated":149426176,"data_stored":2344192449,"data_compressed":111269405,"data_compressed_allocated":146456576,"data_compressed_original":2343059456,"omap_allocated":0,"internal_metadata":499318784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.553265"},"pg_stats":[{"pgid":"6.f","version":"86'1499","reported_seq":1511,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.656363+0000","last_change":"2024-09-15T12:28:39.077376+0000","last_active":"2024-09-15T12:30:40.656363+0000","last_peered":"2024-09-15T12:30:40.656363+0000","last_clean":"2024-09-15T12:30:40.656363+0000","last_became_active":"2024-09-15T12:28:39.068998+0000","last_became_peered":"2024-09-15T12:28:39.068998+0000","last_unstale":"2024-09-15T12:30:40.656363+0000","last_undegraded":"2024-09-15T12:30:40.656363+0000","last_fullsized":"2024-09-15T12:30:40.656363+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1499,"log_dups_size":0,"ondisk_log_size":1499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48300032,"num_objects":737,"num_object_clones":0,"num_object_copies":2211,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1499,"num_write_kb":71552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"86'1506","reported_seq":1518,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.631402+0000","last_change":"2024-09-15T12:28:39.087809+0000","last_active":"2024-09-15T12:30:40.631402+0000","last_peered":"2024-09-15T12:30:40.631402+0000","last_clean":"2024-09-15T12:30:40.631402+0000","last_became_active":"2024-09-15T12:28:39.074098+0000","last_became_peered":"2024-09-15T12:28:39.074098+0000","last_unstale":"2024-09-15T12:30:40.631402+0000","last_undegraded":"2024-09-15T12:30:40.631402+0000","last_fullsized":"2024-09-15T12:30:40.631402+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1506,"log_dups_size":0,"ondisk_log_size":1506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":736,"num_object_clones":0,"num_object_copies":2208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1506,"num_write_kb":71744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"86'1499","reported_seq":1512,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.384829+0000","last_change":"2024-09-15T12:28:39.061230+0000","last_active":"2024-09-15T12:30:40.384829+0000","last_peered":"2024-09-15T12:30:40.384829+0000","last_clean":"2024-09-15T12:30:40.384829+0000","last_became_active":"2024-09-15T12:28:39.046625+0000","last_became_peered":"2024-09-15T12:28:39.046625+0000","last_unstale":"2024-09-15T12:30:40.384829+0000","last_undegraded":"2024-09-15T12:30:40.384829+0000","last_fullsized":"2024-09-15T12:30:40.384829+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1499,"log_dups_size":0,"ondisk_log_size":1499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51904536,"num_objects":793,"num_object_clones":0,"num_object_copies":2379,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1499,"num_write_kb":73281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"86'1450","reported_seq":1462,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:41.706215+0000","last_change":"2024-09-15T12:28:39.043350+0000","last_active":"2024-09-15T12:30:41.706215+0000","last_peered":"2024-09-15T12:30:41.706215+0000","last_clean":"2024-09-15T12:30:41.706215+0000","last_became_active":"2024-09-15T12:28:39.034104+0000","last_became_peered":"2024-09-15T12:28:39.034104+0000","last_unstale":"2024-09-15T12:30:41.706215+0000","last_undegraded":"2024-09-15T12:30:41.706215+0000","last_fullsized":"2024-09-15T12:30:41.706215+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1450,"log_dups_size":0,"ondisk_log_size":1450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47579136,"num_objects":726,"num_object_clones":0,"num_object_copies":2178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1450,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"86'1546","reported_seq":1558,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.603492+0000","last_change":"2024-09-15T12:28:39.083865+0000","last_active":"2024-09-15T12:30:40.603492+0000","last_peered":"2024-09-15T12:30:40.603492+0000","last_clean":"2024-09-15T12:30:40.603492+0000","last_became_active":"2024-09-15T12:28:39.075263+0000","last_became_peered":"2024-09-15T12:28:39.075263+0000","last_unstale":"2024-09-15T12:30:40.603492+0000","last_undegraded":"2024-09-15T12:30:40.603492+0000","last_fullsized":"2024-09-15T12:30:40.603492+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1546,"log_dups_size":0,"ondisk_log_size":1546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49545216,"num_objects":756,"num_object_clones":0,"num_object_copies":2268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1546,"num_write_kb":73664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"86'1409","reported_seq":1421,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.687401+0000","last_change":"2024-09-15T12:28:39.031088+0000","last_active":"2024-09-15T12:30:40.687401+0000","last_peered":"2024-09-15T12:30:40.687401+0000","last_clean":"2024-09-15T12:30:40.687401+0000","last_became_active":"2024-09-15T12:28:39.025037+0000","last_became_peered":"2024-09-15T12:28:39.025037+0000","last_unstale":"2024-09-15T12:30:40.687401+0000","last_undegraded":"2024-09-15T12:30:40.687401+0000","last_fullsized":"2024-09-15T12:30:40.687401+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1409,"log_dups_size":0,"ondisk_log_size":1409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48037888,"num_objects":733,"num_object_clones":0,"num_object_copies":2199,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1409,"num_write_kb":68544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"86'1495","reported_seq":1507,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:41.691265+0000","last_change":"2024-09-15T12:28:39.067539+0000","last_active":"2024-09-15T12:30:41.691265+0000","last_peered":"2024-09-15T12:30:41.691265+0000","last_clean":"2024-09-15T12:30:41.691265+0000","last_became_active":"2024-09-15T12:28:39.054389+0000","last_became_peered":"2024-09-15T12:28:39.054389+0000","last_unstale":"2024-09-15T12:30:41.691265+0000","last_undegraded":"2024-09-15T12:30:41.691265+0000","last_fullsized":"2024-09-15T12:30:41.691265+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1495,"log_dups_size":0,"ondisk_log_size":1495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48037888,"num_objects":733,"num_object_clones":0,"num_object_copies":2199,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1495,"num_write_kb":71296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"86'1432","reported_seq":1444,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.716060+0000","last_change":"2024-09-15T12:28:38.993796+0000","last_active":"2024-09-15T12:30:40.716060+0000","last_peered":"2024-09-15T12:30:40.716060+0000","last_clean":"2024-09-15T12:30:40.716060+0000","last_became_active":"2024-09-15T12:28:38.987121+0000","last_became_peered":"2024-09-15T12:28:38.987121+0000","last_unstale":"2024-09-15T12:30:40.716060+0000","last_undegraded":"2024-09-15T12:30:40.716060+0000","last_fullsized":"2024-09-15T12:30:40.716060+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1432,"log_dups_size":0,"ondisk_log_size":1432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49020928,"num_objects":748,"num_object_clones":0,"num_object_copies":2244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1432,"num_write_kb":69760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"86'1465","reported_seq":1477,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.760154+0000","last_change":"2024-09-15T12:28:39.047799+0000","last_active":"2024-09-15T12:30:40.760154+0000","last_peered":"2024-09-15T12:30:40.760154+0000","last_clean":"2024-09-15T12:30:40.760154+0000","last_became_active":"2024-09-15T12:28:39.017997+0000","last_became_peered":"2024-09-15T12:28:39.017997+0000","last_unstale":"2024-09-15T12:30:40.760154+0000","last_undegraded":"2024-09-15T12:30:40.760154+0000","last_fullsized":"2024-09-15T12:30:40.760154+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1465,"log_dups_size":0,"ondisk_log_size":1465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49348608,"num_objects":753,"num_object_clones":0,"num_object_copies":2259,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1465,"num_write_kb":70976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":301,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.902781+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:28:39.902781+0000","last_peered":"2024-09-15T12:28:39.902781+0000","last_clean":"2024-09-15T12:28:39.902781+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:28:39.902781+0000","last_undegraded":"2024-09-15T12:28:39.902781+0000","last_fullsized":"2024-09-15T12:28:39.902781+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":230,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.911586+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:28:39.911586+0000","last_peered":"2024-09-15T12:28:39.911586+0000","last_clean":"2024-09-15T12:28:39.911586+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:28:39.911586+0000","last_undegraded":"2024-09-15T12:28:39.911586+0000","last_fullsized":"2024-09-15T12:28:39.911586+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"86'1452","reported_seq":1464,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:41.622342+0000","last_change":"2024-09-15T12:28:39.071985+0000","last_active":"2024-09-15T12:30:41.622342+0000","last_peered":"2024-09-15T12:30:41.622342+0000","last_clean":"2024-09-15T12:30:41.622342+0000","last_became_active":"2024-09-15T12:28:39.061062+0000","last_became_peered":"2024-09-15T12:28:39.061062+0000","last_unstale":"2024-09-15T12:30:41.622342+0000","last_undegraded":"2024-09-15T12:30:41.622342+0000","last_fullsized":"2024-09-15T12:30:41.622342+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1452,"log_dups_size":0,"ondisk_log_size":1452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47579136,"num_objects":726,"num_object_clones":0,"num_object_copies":2178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1452,"num_write_kb":69696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.910978+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:28:39.910978+0000","last_peered":"2024-09-15T12:28:39.910978+0000","last_clean":"2024-09-15T12:28:39.910978+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:28:39.910978+0000","last_undegraded":"2024-09-15T12:28:39.910978+0000","last_fullsized":"2024-09-15T12:28:39.910978+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"86'1503","reported_seq":1515,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.597165+0000","last_change":"2024-09-15T12:28:39.025429+0000","last_active":"2024-09-15T12:30:40.597165+0000","last_peered":"2024-09-15T12:30:40.597165+0000","last_clean":"2024-09-15T12:30:40.597165+0000","last_became_active":"2024-09-15T12:28:39.007673+0000","last_became_peered":"2024-09-15T12:28:39.007673+0000","last_unstale":"2024-09-15T12:30:40.597165+0000","last_undegraded":"2024-09-15T12:30:40.597165+0000","last_fullsized":"2024-09-15T12:30:40.597165+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1503,"log_dups_size":0,"ondisk_log_size":1503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48824320,"num_objects":745,"num_object_clones":0,"num_object_copies":2235,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1503,"num_write_kb":71936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.905410+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:28:39.905410+0000","last_peered":"2024-09-15T12:28:39.905410+0000","last_clean":"2024-09-15T12:28:39.905410+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:28:39.905410+0000","last_undegraded":"2024-09-15T12:28:39.905410+0000","last_fullsized":"2024-09-15T12:28:39.905410+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"86'1487","reported_seq":1499,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:41.770963+0000","last_change":"2024-09-15T12:28:39.029713+0000","last_active":"2024-09-15T12:30:41.770963+0000","last_peered":"2024-09-15T12:30:41.770963+0000","last_clean":"2024-09-15T12:30:41.770963+0000","last_became_active":"2024-09-15T12:28:39.020975+0000","last_became_peered":"2024-09-15T12:28:39.020975+0000","last_unstale":"2024-09-15T12:30:41.770963+0000","last_undegraded":"2024-09-15T12:30:41.770963+0000","last_fullsized":"2024-09-15T12:30:41.770963+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1487,"log_dups_size":0,"ondisk_log_size":1487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47644672,"num_objects":727,"num_object_clones":0,"num_object_copies":2181,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1487,"num_write_kb":70848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":231,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.904865+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:28:39.904865+0000","last_peered":"2024-09-15T12:28:39.904865+0000","last_clean":"2024-09-15T12:28:39.904865+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:28:39.904865+0000","last_undegraded":"2024-09-15T12:28:39.904865+0000","last_fullsized":"2024-09-15T12:28:39.904865+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"86'1434","reported_seq":1446,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.617091+0000","last_change":"2024-09-15T12:28:39.023135+0000","last_active":"2024-09-15T12:30:40.617091+0000","last_peered":"2024-09-15T12:30:40.617091+0000","last_clean":"2024-09-15T12:30:40.617091+0000","last_became_active":"2024-09-15T12:28:39.014305+0000","last_became_peered":"2024-09-15T12:28:39.014305+0000","last_unstale":"2024-09-15T12:30:40.617091+0000","last_undegraded":"2024-09-15T12:30:40.617091+0000","last_fullsized":"2024-09-15T12:30:40.617091+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1434,"log_dups_size":0,"ondisk_log_size":1434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":736,"num_object_clones":0,"num_object_copies":2208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1434,"num_write_kb":69440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.907958+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:28:39.907958+0000","last_peered":"2024-09-15T12:28:39.907958+0000","last_clean":"2024-09-15T12:28:39.907958+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:28:39.907958+0000","last_undegraded":"2024-09-15T12:28:39.907958+0000","last_fullsized":"2024-09-15T12:28:39.907958+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"86'1558","reported_seq":1570,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.638804+0000","last_change":"2024-09-15T12:28:39.054857+0000","last_active":"2024-09-15T12:30:40.638804+0000","last_peered":"2024-09-15T12:30:40.638804+0000","last_clean":"2024-09-15T12:30:40.638804+0000","last_became_active":"2024-09-15T12:28:39.046395+0000","last_became_peered":"2024-09-15T12:28:39.046395+0000","last_unstale":"2024-09-15T12:30:40.638804+0000","last_undegraded":"2024-09-15T12:30:40.638804+0000","last_fullsized":"2024-09-15T12:30:40.638804+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1558,"log_dups_size":0,"ondisk_log_size":1558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50593792,"num_objects":772,"num_object_clones":0,"num_object_copies":2316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1558,"num_write_kb":74560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.907938+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:28:39.907938+0000","last_peered":"2024-09-15T12:28:39.907938+0000","last_clean":"2024-09-15T12:28:39.907938+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:28:39.907938+0000","last_undegraded":"2024-09-15T12:28:39.907938+0000","last_fullsized":"2024-09-15T12:28:39.907938+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"86'1571","reported_seq":1583,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.459354+0000","last_change":"2024-09-15T12:28:39.052760+0000","last_active":"2024-09-15T12:30:40.459354+0000","last_peered":"2024-09-15T12:30:40.459354+0000","last_clean":"2024-09-15T12:30:40.459354+0000","last_became_active":"2024-09-15T12:28:39.041365+0000","last_became_peered":"2024-09-15T12:28:39.041365+0000","last_unstale":"2024-09-15T12:30:40.459354+0000","last_undegraded":"2024-09-15T12:30:40.459354+0000","last_fullsized":"2024-09-15T12:30:40.459354+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1571,"log_dups_size":0,"ondisk_log_size":1571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48562176,"num_objects":741,"num_object_clones":0,"num_object_copies":2223,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1571,"num_write_kb":73984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.906843+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:28:39.906843+0000","last_peered":"2024-09-15T12:28:39.906843+0000","last_clean":"2024-09-15T12:28:39.906843+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:28:39.906843+0000","last_undegraded":"2024-09-15T12:28:39.906843+0000","last_fullsized":"2024-09-15T12:28:39.906843+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"86'1403","reported_seq":1415,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:30:40.783716+0000","last_change":"2024-09-15T12:28:39.046988+0000","last_active":"2024-09-15T12:30:40.783716+0000","last_peered":"2024-09-15T12:30:40.783716+0000","last_clean":"2024-09-15T12:30:40.783716+0000","last_became_active":"2024-09-15T12:28:39.017167+0000","last_became_peered":"2024-09-15T12:28:39.017167+0000","last_unstale":"2024-09-15T12:30:40.783716+0000","last_undegraded":"2024-09-15T12:30:40.783716+0000","last_fullsized":"2024-09-15T12:30:40.783716+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1403,"log_dups_size":0,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44630016,"num_objects":681,"num_object_clones":0,"num_object_copies":2043,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1403,"num_write_kb":66688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":229,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-15T12:28:39.914018+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:28:39.914018+0000","last_peered":"2024-09-15T12:28:39.914018+0000","last_clean":"2024-09-15T12:28:39.914018+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:28:39.914018+0000","last_undegraded":"2024-09-15T12:28:39.914018+0000","last_fullsized":"2024-09-15T12:28:39.914018+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":776077336,"num_objects":11843,"num_object_clones":0,"num_object_copies":35529,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":23709,"num_write_kb":1137601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":145666048,"data_stored":2330460232,"data_compressed":110662717,"data_compressed_allocated":145653760,"data_compressed_original":2330460160,"omap_allocated":0,"internal_metadata":0},"log_size":23709,"ondisk_log_size":23709,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673678,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":154340,"kb_used_data":33108,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94217500,"statfs":{"total":96636764160,"available":96478720000,"internally_reserved":0,"allocated":33902592,"data_stored":530719472,"data_compressed":25190551,"data_compressed_allocated":33157120,"data_compressed_original":530432000,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":149360,"kb_used_data":33696,"kb_used_omap":0,"kb_used_meta":115648,"kb_avail":94222480,"statfs":{"total":96636764160,"available":96483819520,"internally_reserved":0,"allocated":34504704,"data_stored":540353259,"data_compressed":25648016,"data_compressed_allocated":33759232,"data_compressed_original":540065792,"omap_allocated":0,"internal_metadata":118423552},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":160848,"kb_used_data":39616,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94210992,"statfs":{"total":96636764160,"available":96472055808,"internally_reserved":0,"allocated":40566784,"data_stored":637673699,"data_compressed":30267311,"data_compressed_allocated":39837696,"data_compressed_original":637403136,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706382,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":169060,"kb_used_data":39504,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94202780,"statfs":{"total":96636764160,"available":96463646720,"internally_reserved":0,"allocated":40452096,"data_stored":635446019,"data_compressed":30163527,"data_compressed_allocated":39702528,"data_compressed_original":635158528,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":39546880,"data_stored":632684568,"data_compressed":30043247,"data_compressed_allocated":39542784,"data_compressed_original":632684544,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":39632896,"data_stored":634060824,"data_compressed":30108599,"data_compressed_allocated":39628800,"data_compressed_original":634060800,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":536870912,"data_compressed":25493504,"data_compressed_allocated":33554432,"data_compressed_original":536870912,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32931840,"data_stored":526843928,"data_compressed":25017367,"data_compressed_allocated":32927744,"data_compressed_original":526843904,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:31:13.157 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:31:13.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:13.331+0000 7f840c351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:13.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:13.339+0000 7f840c351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:15.653 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:31:15.653 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:31:15.654 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:31:15.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:15.798+0000 7f8826991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:15.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:15.808+0000 7f8826991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:16.018 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:31:16.117 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:31:16.118 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:31:16.144 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":462,"stamp":"2024-09-15T12:31:15.852280+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":423756363,"num_objects":6462,"num_object_clones":0,"num_object_copies":19386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":29175,"num_write_kb":1138709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29149,"ondisk_log_size":29149,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":582832,"kb_used_data":81256,"kb_used_omap":0,"kb_used_meta":501504,"kb_avail":376904528,"statfs":{"total":386547056640,"available":385950236672,"internally_reserved":0,"allocated":83206144,"data_stored":1281604697,"data_compressed":60808328,"data_compressed_allocated":80039936,"data_compressed_original":1280393216,"omap_allocated":0,"internal_metadata":513540096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-352911360,"num_objects":-5385,"num_object_clones":0,"num_object_copies":-16155,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5385,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002555"},"pg_stats":[{"pgid":"6.f","version":"92'1840","reported_seq":1870,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.696172+0000","last_change":"2024-09-15T12:28:39.077376+0000","last_active":"2024-09-15T12:31:10.696172+0000","last_peered":"2024-09-15T12:31:10.696172+0000","last_clean":"2024-09-15T12:31:10.696172+0000","last_became_active":"2024-09-15T12:28:39.068998+0000","last_became_peered":"2024-09-15T12:28:39.068998+0000","last_unstale":"2024-09-15T12:31:10.696172+0000","last_undegraded":"2024-09-15T12:31:10.696172+0000","last_fullsized":"2024-09-15T12:31:10.696172+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1840,"log_dups_size":0,"ondisk_log_size":1840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25952256,"num_objects":396,"num_object_clones":0,"num_object_copies":1188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1840,"num_write_kb":71552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"92'1818","reported_seq":1848,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.541974+0000","last_change":"2024-09-15T12:28:39.087809+0000","last_active":"2024-09-15T12:31:10.541974+0000","last_peered":"2024-09-15T12:31:10.541974+0000","last_clean":"2024-09-15T12:31:10.541974+0000","last_became_active":"2024-09-15T12:28:39.074098+0000","last_became_peered":"2024-09-15T12:28:39.074098+0000","last_unstale":"2024-09-15T12:31:10.541974+0000","last_undegraded":"2024-09-15T12:31:10.541974+0000","last_fullsized":"2024-09-15T12:31:10.541974+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1818,"log_dups_size":0,"ondisk_log_size":1818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27787264,"num_objects":424,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1818,"num_write_kb":71744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"92'1878","reported_seq":1909,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.709028+0000","last_change":"2024-09-15T12:28:39.061230+0000","last_active":"2024-09-15T12:31:10.709028+0000","last_peered":"2024-09-15T12:31:10.709028+0000","last_clean":"2024-09-15T12:31:10.709028+0000","last_became_active":"2024-09-15T12:28:39.046625+0000","last_became_peered":"2024-09-15T12:28:39.046625+0000","last_unstale":"2024-09-15T12:31:10.709028+0000","last_undegraded":"2024-09-15T12:31:10.709028+0000","last_fullsized":"2024-09-15T12:31:10.709028+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1878,"log_dups_size":0,"ondisk_log_size":1878,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27066392,"num_objects":414,"num_object_clones":0,"num_object_copies":1242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1878,"num_write_kb":73281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"92'1771","reported_seq":1801,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:11.370230+0000","last_change":"2024-09-15T12:28:39.043350+0000","last_active":"2024-09-15T12:31:11.370230+0000","last_peered":"2024-09-15T12:31:11.370230+0000","last_clean":"2024-09-15T12:31:11.370230+0000","last_became_active":"2024-09-15T12:28:39.034104+0000","last_became_peered":"2024-09-15T12:28:39.034104+0000","last_unstale":"2024-09-15T12:31:11.370230+0000","last_undegraded":"2024-09-15T12:31:11.370230+0000","last_fullsized":"2024-09-15T12:31:11.370230+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1771,"log_dups_size":0,"ondisk_log_size":1771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26542080,"num_objects":405,"num_object_clones":0,"num_object_copies":1215,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1771,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"92'1892","reported_seq":1922,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.697237+0000","last_change":"2024-09-15T12:28:39.083865+0000","last_active":"2024-09-15T12:31:10.697237+0000","last_peered":"2024-09-15T12:31:10.697237+0000","last_clean":"2024-09-15T12:31:10.697237+0000","last_became_active":"2024-09-15T12:28:39.075263+0000","last_became_peered":"2024-09-15T12:28:39.075263+0000","last_unstale":"2024-09-15T12:31:10.697237+0000","last_undegraded":"2024-09-15T12:31:10.697237+0000","last_fullsized":"2024-09-15T12:31:10.697237+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1892,"log_dups_size":0,"ondisk_log_size":1892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26869760,"num_objects":410,"num_object_clones":0,"num_object_copies":1230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1892,"num_write_kb":73664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"92'1749","reported_seq":1779,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.465171+0000","last_change":"2024-09-15T12:28:39.031088+0000","last_active":"2024-09-15T12:31:10.465171+0000","last_peered":"2024-09-15T12:31:10.465171+0000","last_clean":"2024-09-15T12:31:10.465171+0000","last_became_active":"2024-09-15T12:28:39.025037+0000","last_became_peered":"2024-09-15T12:28:39.025037+0000","last_unstale":"2024-09-15T12:31:10.465171+0000","last_undegraded":"2024-09-15T12:31:10.465171+0000","last_fullsized":"2024-09-15T12:31:10.465171+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1749,"log_dups_size":0,"ondisk_log_size":1749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25755648,"num_objects":393,"num_object_clones":0,"num_object_copies":1179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1749,"num_write_kb":68544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"92'1842","reported_seq":1872,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:11.784982+0000","last_change":"2024-09-15T12:28:39.067539+0000","last_active":"2024-09-15T12:31:11.784982+0000","last_peered":"2024-09-15T12:31:11.784982+0000","last_clean":"2024-09-15T12:31:11.784982+0000","last_became_active":"2024-09-15T12:28:39.054389+0000","last_became_peered":"2024-09-15T12:28:39.054389+0000","last_unstale":"2024-09-15T12:31:11.784982+0000","last_undegraded":"2024-09-15T12:31:11.784982+0000","last_fullsized":"2024-09-15T12:31:11.784982+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1842,"log_dups_size":0,"ondisk_log_size":1842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25296896,"num_objects":386,"num_object_clones":0,"num_object_copies":1158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1842,"num_write_kb":71296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"92'1784","reported_seq":1814,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.566972+0000","last_change":"2024-09-15T12:28:38.993796+0000","last_active":"2024-09-15T12:31:10.566972+0000","last_peered":"2024-09-15T12:31:10.566972+0000","last_clean":"2024-09-15T12:31:10.566972+0000","last_became_active":"2024-09-15T12:28:38.987121+0000","last_became_peered":"2024-09-15T12:28:38.987121+0000","last_unstale":"2024-09-15T12:31:10.566972+0000","last_undegraded":"2024-09-15T12:31:10.566972+0000","last_fullsized":"2024-09-15T12:31:10.566972+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1784,"log_dups_size":0,"ondisk_log_size":1784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25952256,"num_objects":396,"num_object_clones":0,"num_object_copies":1188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1784,"num_write_kb":69760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"92'1792","reported_seq":1822,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.458495+0000","last_change":"2024-09-15T12:28:39.047799+0000","last_active":"2024-09-15T12:31:10.458495+0000","last_peered":"2024-09-15T12:31:10.458495+0000","last_clean":"2024-09-15T12:31:10.458495+0000","last_became_active":"2024-09-15T12:28:39.017997+0000","last_became_peered":"2024-09-15T12:28:39.017997+0000","last_unstale":"2024-09-15T12:31:10.458495+0000","last_undegraded":"2024-09-15T12:31:10.458495+0000","last_fullsized":"2024-09-15T12:31:10.458495+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1792,"log_dups_size":0,"ondisk_log_size":1792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27918336,"num_objects":426,"num_object_clones":0,"num_object_copies":1278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1792,"num_write_kb":70976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":319,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.347895+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:30:58.347895+0000","last_peered":"2024-09-15T12:30:58.347895+0000","last_clean":"2024-09-15T12:30:58.347895+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:30:58.347895+0000","last_undegraded":"2024-09-15T12:30:58.347895+0000","last_fullsized":"2024-09-15T12:30:58.347895+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":248,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.357144+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:30:58.357144+0000","last_peered":"2024-09-15T12:30:58.357144+0000","last_clean":"2024-09-15T12:30:58.357144+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:30:58.357144+0000","last_undegraded":"2024-09-15T12:30:58.357144+0000","last_fullsized":"2024-09-15T12:30:58.357144+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"92'1785","reported_seq":1815,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:11.624763+0000","last_change":"2024-09-15T12:28:39.071985+0000","last_active":"2024-09-15T12:31:11.624763+0000","last_peered":"2024-09-15T12:31:11.624763+0000","last_clean":"2024-09-15T12:31:11.624763+0000","last_became_active":"2024-09-15T12:28:39.061062+0000","last_became_peered":"2024-09-15T12:28:39.061062+0000","last_unstale":"2024-09-15T12:31:11.624763+0000","last_undegraded":"2024-09-15T12:31:11.624763+0000","last_fullsized":"2024-09-15T12:31:11.624763+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1785,"log_dups_size":0,"ondisk_log_size":1785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25755648,"num_objects":393,"num_object_clones":0,"num_object_copies":1179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1785,"num_write_kb":69696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.364558+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:30:58.364558+0000","last_peered":"2024-09-15T12:30:58.364558+0000","last_clean":"2024-09-15T12:30:58.364558+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:30:58.364558+0000","last_undegraded":"2024-09-15T12:30:58.364558+0000","last_fullsized":"2024-09-15T12:30:58.364558+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"92'1833","reported_seq":1863,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.672823+0000","last_change":"2024-09-15T12:28:39.025429+0000","last_active":"2024-09-15T12:31:10.672823+0000","last_peered":"2024-09-15T12:31:10.672823+0000","last_clean":"2024-09-15T12:31:10.672823+0000","last_became_active":"2024-09-15T12:28:39.007673+0000","last_became_peered":"2024-09-15T12:28:39.007673+0000","last_unstale":"2024-09-15T12:31:10.672823+0000","last_undegraded":"2024-09-15T12:31:10.672823+0000","last_fullsized":"2024-09-15T12:31:10.672823+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1833,"log_dups_size":0,"ondisk_log_size":1833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27197440,"num_objects":415,"num_object_clones":0,"num_object_copies":1245,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1833,"num_write_kb":71936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.339624+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:30:58.339624+0000","last_peered":"2024-09-15T12:30:58.339624+0000","last_clean":"2024-09-15T12:30:58.339624+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:30:58.339624+0000","last_undegraded":"2024-09-15T12:30:58.339624+0000","last_fullsized":"2024-09-15T12:30:58.339624+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"92'1813","reported_seq":1843,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:11.748799+0000","last_change":"2024-09-15T12:28:39.029713+0000","last_active":"2024-09-15T12:31:11.748799+0000","last_peered":"2024-09-15T12:31:11.748799+0000","last_clean":"2024-09-15T12:31:11.748799+0000","last_became_active":"2024-09-15T12:28:39.020975+0000","last_became_peered":"2024-09-15T12:28:39.020975+0000","last_unstale":"2024-09-15T12:31:11.748799+0000","last_undegraded":"2024-09-15T12:31:11.748799+0000","last_fullsized":"2024-09-15T12:31:11.748799+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1813,"log_dups_size":0,"ondisk_log_size":1813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26279936,"num_objects":401,"num_object_clones":0,"num_object_copies":1203,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1813,"num_write_kb":70848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":249,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.357439+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:30:58.357439+0000","last_peered":"2024-09-15T12:30:58.357439+0000","last_clean":"2024-09-15T12:30:58.357439+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:30:58.357439+0000","last_undegraded":"2024-09-15T12:30:58.357439+0000","last_fullsized":"2024-09-15T12:30:58.357439+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"92'1758","reported_seq":1788,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.695282+0000","last_change":"2024-09-15T12:28:39.023135+0000","last_active":"2024-09-15T12:31:10.695282+0000","last_peered":"2024-09-15T12:31:10.695282+0000","last_clean":"2024-09-15T12:31:10.695282+0000","last_became_active":"2024-09-15T12:28:39.014305+0000","last_became_peered":"2024-09-15T12:28:39.014305+0000","last_unstale":"2024-09-15T12:31:10.695282+0000","last_undegraded":"2024-09-15T12:31:10.695282+0000","last_fullsized":"2024-09-15T12:31:10.695282+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1758,"log_dups_size":0,"ondisk_log_size":1758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27000832,"num_objects":412,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1758,"num_write_kb":69440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.341995+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:30:58.341995+0000","last_peered":"2024-09-15T12:30:58.341995+0000","last_clean":"2024-09-15T12:30:58.341995+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:30:58.341995+0000","last_undegraded":"2024-09-15T12:30:58.341995+0000","last_fullsized":"2024-09-15T12:30:58.341995+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"92'1919","reported_seq":1949,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.746632+0000","last_change":"2024-09-15T12:28:39.054857+0000","last_active":"2024-09-15T12:31:10.746632+0000","last_peered":"2024-09-15T12:31:10.746632+0000","last_clean":"2024-09-15T12:31:10.746632+0000","last_became_active":"2024-09-15T12:28:39.046395+0000","last_became_peered":"2024-09-15T12:28:39.046395+0000","last_unstale":"2024-09-15T12:31:10.746632+0000","last_undegraded":"2024-09-15T12:31:10.746632+0000","last_fullsized":"2024-09-15T12:31:10.746632+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1919,"log_dups_size":0,"ondisk_log_size":1919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26935296,"num_objects":411,"num_object_clones":0,"num_object_copies":1233,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1919,"num_write_kb":74560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.353747+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:30:58.353747+0000","last_peered":"2024-09-15T12:30:58.353747+0000","last_clean":"2024-09-15T12:30:58.353747+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:30:58.353747+0000","last_undegraded":"2024-09-15T12:30:58.353747+0000","last_fullsized":"2024-09-15T12:30:58.353747+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"92'1897","reported_seq":1927,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.589952+0000","last_change":"2024-09-15T12:28:39.052760+0000","last_active":"2024-09-15T12:31:10.589952+0000","last_peered":"2024-09-15T12:31:10.589952+0000","last_clean":"2024-09-15T12:31:10.589952+0000","last_became_active":"2024-09-15T12:28:39.041365+0000","last_became_peered":"2024-09-15T12:28:39.041365+0000","last_unstale":"2024-09-15T12:31:10.589952+0000","last_undegraded":"2024-09-15T12:31:10.589952+0000","last_fullsized":"2024-09-15T12:31:10.589952+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1897,"log_dups_size":0,"ondisk_log_size":1897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27197440,"num_objects":415,"num_object_clones":0,"num_object_copies":1245,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1897,"num_write_kb":73984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.328638+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:30:58.328638+0000","last_peered":"2024-09-15T12:30:58.328638+0000","last_clean":"2024-09-15T12:30:58.328638+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:30:58.328638+0000","last_undegraded":"2024-09-15T12:30:58.328638+0000","last_fullsized":"2024-09-15T12:30:58.328638+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"92'1723","reported_seq":1753,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.492348+0000","last_change":"2024-09-15T12:28:39.046988+0000","last_active":"2024-09-15T12:31:10.492348+0000","last_peered":"2024-09-15T12:31:10.492348+0000","last_clean":"2024-09-15T12:31:10.492348+0000","last_became_active":"2024-09-15T12:28:39.017167+0000","last_became_peered":"2024-09-15T12:28:39.017167+0000","last_unstale":"2024-09-15T12:31:10.492348+0000","last_undegraded":"2024-09-15T12:31:10.492348+0000","last_fullsized":"2024-09-15T12:31:10.492348+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1723,"log_dups_size":0,"ondisk_log_size":1723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23658496,"num_objects":361,"num_object_clones":0,"num_object_copies":1083,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1723,"num_write_kb":66688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.354596+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:30:58.354596+0000","last_peered":"2024-09-15T12:30:58.354596+0000","last_clean":"2024-09-15T12:30:58.354596+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:30:58.354596+0000","last_undegraded":"2024-09-15T12:30:58.354596+0000","last_fullsized":"2024-09-15T12:30:58.354596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":423165976,"num_objects":6458,"num_object_clones":0,"num_object_copies":19374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":29094,"num_write_kb":1137601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79433728,"data_stored":1270743112,"data_compressed":60341680,"data_compressed_allocated":79421440,"data_compressed_original":1270743040,"omap_allocated":0,"internal_metadata":0},"log_size":29094,"ondisk_log_size":29094,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673708,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":139556,"kb_used_data":18320,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94232284,"statfs":{"total":96636764160,"available":96493858816,"internally_reserved":0,"allocated":18759680,"data_stored":287666070,"data_compressed":13648144,"data_compressed_allocated":17965056,"data_compressed_original":287358976,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":148432,"kb_used_data":18880,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94223408,"statfs":{"total":96636764160,"available":96484769792,"internally_reserved":0,"allocated":19333120,"data_stored":296841105,"data_compressed":14083824,"data_compressed_allocated":18538496,"data_compressed_original":296534016,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":143292,"kb_used_data":22056,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94228548,"statfs":{"total":96636764160,"available":96490033152,"internally_reserved":0,"allocated":22585344,"data_stored":349203849,"data_compressed":16568288,"data_compressed_allocated":21807104,"data_compressed_original":348913664,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":151552,"kb_used_data":22000,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94220288,"statfs":{"total":96636764160,"available":96481574912,"internally_reserved":0,"allocated":22528000,"data_stored":347893673,"data_compressed":16508072,"data_compressed_allocated":21729280,"data_compressed_original":347586560,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21622784,"data_stored":345899032,"data_compressed":16425136,"data_compressed_allocated":21618688,"data_compressed_original":345899008,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21651456,"data_stored":346357784,"data_compressed":16446920,"data_compressed_allocated":21647360,"data_compressed_original":346357760,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18382848,"data_stored":294125568,"data_compressed":13966656,"data_compressed_allocated":18382848,"data_compressed_original":294125568,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17776640,"data_stored":284360728,"data_compressed":13502968,"data_compressed_allocated":17772544,"data_compressed_original":284360704,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:31:16.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:16.186+0000 7fa871991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:16.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:16.194+0000 7fa871991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:18.915 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:31:19.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:19.081+0000 7fd69fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:19.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:19.090+0000 7fd69fb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:21.146 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:31:21.146 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:31:21.146 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:31:21.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:21.302+0000 7fd2ae991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:21.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:21.313+0000 7fd2ae991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:21.577 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:31:21.577 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:31:21.596 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":464,"stamp":"2024-09-15T12:31:19.853040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":423756363,"num_objects":6462,"num_object_clones":0,"num_object_copies":19386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":29175,"num_write_kb":1138709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29149,"ondisk_log_size":29149,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":582832,"kb_used_data":81256,"kb_used_omap":0,"kb_used_meta":501504,"kb_avail":376904528,"statfs":{"total":386547056640,"available":385950236672,"internally_reserved":0,"allocated":83206144,"data_stored":1281604697,"data_compressed":60808328,"data_compressed_allocated":80039936,"data_compressed_original":1280393216,"omap_allocated":0,"internal_metadata":513540096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-352911360,"num_objects":-5385,"num_object_clones":0,"num_object_copies":-16155,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5385,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002531"},"pg_stats":[{"pgid":"6.f","version":"92'1840","reported_seq":1870,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.696172+0000","last_change":"2024-09-15T12:28:39.077376+0000","last_active":"2024-09-15T12:31:10.696172+0000","last_peered":"2024-09-15T12:31:10.696172+0000","last_clean":"2024-09-15T12:31:10.696172+0000","last_became_active":"2024-09-15T12:28:39.068998+0000","last_became_peered":"2024-09-15T12:28:39.068998+0000","last_unstale":"2024-09-15T12:31:10.696172+0000","last_undegraded":"2024-09-15T12:31:10.696172+0000","last_fullsized":"2024-09-15T12:31:10.696172+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1840,"log_dups_size":0,"ondisk_log_size":1840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25952256,"num_objects":396,"num_object_clones":0,"num_object_copies":1188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1840,"num_write_kb":71552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"92'1818","reported_seq":1848,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.541974+0000","last_change":"2024-09-15T12:28:39.087809+0000","last_active":"2024-09-15T12:31:10.541974+0000","last_peered":"2024-09-15T12:31:10.541974+0000","last_clean":"2024-09-15T12:31:10.541974+0000","last_became_active":"2024-09-15T12:28:39.074098+0000","last_became_peered":"2024-09-15T12:28:39.074098+0000","last_unstale":"2024-09-15T12:31:10.541974+0000","last_undegraded":"2024-09-15T12:31:10.541974+0000","last_fullsized":"2024-09-15T12:31:10.541974+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1818,"log_dups_size":0,"ondisk_log_size":1818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27787264,"num_objects":424,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1818,"num_write_kb":71744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"92'1878","reported_seq":1909,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.709028+0000","last_change":"2024-09-15T12:28:39.061230+0000","last_active":"2024-09-15T12:31:10.709028+0000","last_peered":"2024-09-15T12:31:10.709028+0000","last_clean":"2024-09-15T12:31:10.709028+0000","last_became_active":"2024-09-15T12:28:39.046625+0000","last_became_peered":"2024-09-15T12:28:39.046625+0000","last_unstale":"2024-09-15T12:31:10.709028+0000","last_undegraded":"2024-09-15T12:31:10.709028+0000","last_fullsized":"2024-09-15T12:31:10.709028+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1878,"log_dups_size":0,"ondisk_log_size":1878,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27066392,"num_objects":414,"num_object_clones":0,"num_object_copies":1242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1878,"num_write_kb":73281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"92'1771","reported_seq":1801,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:11.370230+0000","last_change":"2024-09-15T12:28:39.043350+0000","last_active":"2024-09-15T12:31:11.370230+0000","last_peered":"2024-09-15T12:31:11.370230+0000","last_clean":"2024-09-15T12:31:11.370230+0000","last_became_active":"2024-09-15T12:28:39.034104+0000","last_became_peered":"2024-09-15T12:28:39.034104+0000","last_unstale":"2024-09-15T12:31:11.370230+0000","last_undegraded":"2024-09-15T12:31:11.370230+0000","last_fullsized":"2024-09-15T12:31:11.370230+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1771,"log_dups_size":0,"ondisk_log_size":1771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26542080,"num_objects":405,"num_object_clones":0,"num_object_copies":1215,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1771,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"92'1892","reported_seq":1922,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.697237+0000","last_change":"2024-09-15T12:28:39.083865+0000","last_active":"2024-09-15T12:31:10.697237+0000","last_peered":"2024-09-15T12:31:10.697237+0000","last_clean":"2024-09-15T12:31:10.697237+0000","last_became_active":"2024-09-15T12:28:39.075263+0000","last_became_peered":"2024-09-15T12:28:39.075263+0000","last_unstale":"2024-09-15T12:31:10.697237+0000","last_undegraded":"2024-09-15T12:31:10.697237+0000","last_fullsized":"2024-09-15T12:31:10.697237+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1892,"log_dups_size":0,"ondisk_log_size":1892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26869760,"num_objects":410,"num_object_clones":0,"num_object_copies":1230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1892,"num_write_kb":73664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"92'1749","reported_seq":1779,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.465171+0000","last_change":"2024-09-15T12:28:39.031088+0000","last_active":"2024-09-15T12:31:10.465171+0000","last_peered":"2024-09-15T12:31:10.465171+0000","last_clean":"2024-09-15T12:31:10.465171+0000","last_became_active":"2024-09-15T12:28:39.025037+0000","last_became_peered":"2024-09-15T12:28:39.025037+0000","last_unstale":"2024-09-15T12:31:10.465171+0000","last_undegraded":"2024-09-15T12:31:10.465171+0000","last_fullsized":"2024-09-15T12:31:10.465171+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1749,"log_dups_size":0,"ondisk_log_size":1749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25755648,"num_objects":393,"num_object_clones":0,"num_object_copies":1179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1749,"num_write_kb":68544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"92'1842","reported_seq":1872,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:11.784982+0000","last_change":"2024-09-15T12:28:39.067539+0000","last_active":"2024-09-15T12:31:11.784982+0000","last_peered":"2024-09-15T12:31:11.784982+0000","last_clean":"2024-09-15T12:31:11.784982+0000","last_became_active":"2024-09-15T12:28:39.054389+0000","last_became_peered":"2024-09-15T12:28:39.054389+0000","last_unstale":"2024-09-15T12:31:11.784982+0000","last_undegraded":"2024-09-15T12:31:11.784982+0000","last_fullsized":"2024-09-15T12:31:11.784982+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1842,"log_dups_size":0,"ondisk_log_size":1842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25296896,"num_objects":386,"num_object_clones":0,"num_object_copies":1158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1842,"num_write_kb":71296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"92'1784","reported_seq":1814,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.566972+0000","last_change":"2024-09-15T12:28:38.993796+0000","last_active":"2024-09-15T12:31:10.566972+0000","last_peered":"2024-09-15T12:31:10.566972+0000","last_clean":"2024-09-15T12:31:10.566972+0000","last_became_active":"2024-09-15T12:28:38.987121+0000","last_became_peered":"2024-09-15T12:28:38.987121+0000","last_unstale":"2024-09-15T12:31:10.566972+0000","last_undegraded":"2024-09-15T12:31:10.566972+0000","last_fullsized":"2024-09-15T12:31:10.566972+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1784,"log_dups_size":0,"ondisk_log_size":1784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25952256,"num_objects":396,"num_object_clones":0,"num_object_copies":1188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1784,"num_write_kb":69760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"92'1792","reported_seq":1822,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.458495+0000","last_change":"2024-09-15T12:28:39.047799+0000","last_active":"2024-09-15T12:31:10.458495+0000","last_peered":"2024-09-15T12:31:10.458495+0000","last_clean":"2024-09-15T12:31:10.458495+0000","last_became_active":"2024-09-15T12:28:39.017997+0000","last_became_peered":"2024-09-15T12:28:39.017997+0000","last_unstale":"2024-09-15T12:31:10.458495+0000","last_undegraded":"2024-09-15T12:31:10.458495+0000","last_fullsized":"2024-09-15T12:31:10.458495+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1792,"log_dups_size":0,"ondisk_log_size":1792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27918336,"num_objects":426,"num_object_clones":0,"num_object_copies":1278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1792,"num_write_kb":70976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":319,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.347895+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:30:58.347895+0000","last_peered":"2024-09-15T12:30:58.347895+0000","last_clean":"2024-09-15T12:30:58.347895+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:30:58.347895+0000","last_undegraded":"2024-09-15T12:30:58.347895+0000","last_fullsized":"2024-09-15T12:30:58.347895+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":248,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.357144+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:30:58.357144+0000","last_peered":"2024-09-15T12:30:58.357144+0000","last_clean":"2024-09-15T12:30:58.357144+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:30:58.357144+0000","last_undegraded":"2024-09-15T12:30:58.357144+0000","last_fullsized":"2024-09-15T12:30:58.357144+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"92'1785","reported_seq":1815,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:11.624763+0000","last_change":"2024-09-15T12:28:39.071985+0000","last_active":"2024-09-15T12:31:11.624763+0000","last_peered":"2024-09-15T12:31:11.624763+0000","last_clean":"2024-09-15T12:31:11.624763+0000","last_became_active":"2024-09-15T12:28:39.061062+0000","last_became_peered":"2024-09-15T12:28:39.061062+0000","last_unstale":"2024-09-15T12:31:11.624763+0000","last_undegraded":"2024-09-15T12:31:11.624763+0000","last_fullsized":"2024-09-15T12:31:11.624763+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1785,"log_dups_size":0,"ondisk_log_size":1785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25755648,"num_objects":393,"num_object_clones":0,"num_object_copies":1179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1785,"num_write_kb":69696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.364558+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:30:58.364558+0000","last_peered":"2024-09-15T12:30:58.364558+0000","last_clean":"2024-09-15T12:30:58.364558+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:30:58.364558+0000","last_undegraded":"2024-09-15T12:30:58.364558+0000","last_fullsized":"2024-09-15T12:30:58.364558+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"92'1833","reported_seq":1863,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.672823+0000","last_change":"2024-09-15T12:28:39.025429+0000","last_active":"2024-09-15T12:31:10.672823+0000","last_peered":"2024-09-15T12:31:10.672823+0000","last_clean":"2024-09-15T12:31:10.672823+0000","last_became_active":"2024-09-15T12:28:39.007673+0000","last_became_peered":"2024-09-15T12:28:39.007673+0000","last_unstale":"2024-09-15T12:31:10.672823+0000","last_undegraded":"2024-09-15T12:31:10.672823+0000","last_fullsized":"2024-09-15T12:31:10.672823+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1833,"log_dups_size":0,"ondisk_log_size":1833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27197440,"num_objects":415,"num_object_clones":0,"num_object_copies":1245,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1833,"num_write_kb":71936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.339624+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:30:58.339624+0000","last_peered":"2024-09-15T12:30:58.339624+0000","last_clean":"2024-09-15T12:30:58.339624+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:30:58.339624+0000","last_undegraded":"2024-09-15T12:30:58.339624+0000","last_fullsized":"2024-09-15T12:30:58.339624+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"92'1813","reported_seq":1843,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:11.748799+0000","last_change":"2024-09-15T12:28:39.029713+0000","last_active":"2024-09-15T12:31:11.748799+0000","last_peered":"2024-09-15T12:31:11.748799+0000","last_clean":"2024-09-15T12:31:11.748799+0000","last_became_active":"2024-09-15T12:28:39.020975+0000","last_became_peered":"2024-09-15T12:28:39.020975+0000","last_unstale":"2024-09-15T12:31:11.748799+0000","last_undegraded":"2024-09-15T12:31:11.748799+0000","last_fullsized":"2024-09-15T12:31:11.748799+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1813,"log_dups_size":0,"ondisk_log_size":1813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26279936,"num_objects":401,"num_object_clones":0,"num_object_copies":1203,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1813,"num_write_kb":70848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":249,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.357439+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:30:58.357439+0000","last_peered":"2024-09-15T12:30:58.357439+0000","last_clean":"2024-09-15T12:30:58.357439+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:30:58.357439+0000","last_undegraded":"2024-09-15T12:30:58.357439+0000","last_fullsized":"2024-09-15T12:30:58.357439+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"92'1758","reported_seq":1788,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.695282+0000","last_change":"2024-09-15T12:28:39.023135+0000","last_active":"2024-09-15T12:31:10.695282+0000","last_peered":"2024-09-15T12:31:10.695282+0000","last_clean":"2024-09-15T12:31:10.695282+0000","last_became_active":"2024-09-15T12:28:39.014305+0000","last_became_peered":"2024-09-15T12:28:39.014305+0000","last_unstale":"2024-09-15T12:31:10.695282+0000","last_undegraded":"2024-09-15T12:31:10.695282+0000","last_fullsized":"2024-09-15T12:31:10.695282+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1758,"log_dups_size":0,"ondisk_log_size":1758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27000832,"num_objects":412,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1758,"num_write_kb":69440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.341995+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:30:58.341995+0000","last_peered":"2024-09-15T12:30:58.341995+0000","last_clean":"2024-09-15T12:30:58.341995+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:30:58.341995+0000","last_undegraded":"2024-09-15T12:30:58.341995+0000","last_fullsized":"2024-09-15T12:30:58.341995+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"92'1919","reported_seq":1949,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.746632+0000","last_change":"2024-09-15T12:28:39.054857+0000","last_active":"2024-09-15T12:31:10.746632+0000","last_peered":"2024-09-15T12:31:10.746632+0000","last_clean":"2024-09-15T12:31:10.746632+0000","last_became_active":"2024-09-15T12:28:39.046395+0000","last_became_peered":"2024-09-15T12:28:39.046395+0000","last_unstale":"2024-09-15T12:31:10.746632+0000","last_undegraded":"2024-09-15T12:31:10.746632+0000","last_fullsized":"2024-09-15T12:31:10.746632+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1919,"log_dups_size":0,"ondisk_log_size":1919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26935296,"num_objects":411,"num_object_clones":0,"num_object_copies":1233,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1919,"num_write_kb":74560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.353747+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:30:58.353747+0000","last_peered":"2024-09-15T12:30:58.353747+0000","last_clean":"2024-09-15T12:30:58.353747+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:30:58.353747+0000","last_undegraded":"2024-09-15T12:30:58.353747+0000","last_fullsized":"2024-09-15T12:30:58.353747+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"92'1897","reported_seq":1927,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.589952+0000","last_change":"2024-09-15T12:28:39.052760+0000","last_active":"2024-09-15T12:31:10.589952+0000","last_peered":"2024-09-15T12:31:10.589952+0000","last_clean":"2024-09-15T12:31:10.589952+0000","last_became_active":"2024-09-15T12:28:39.041365+0000","last_became_peered":"2024-09-15T12:28:39.041365+0000","last_unstale":"2024-09-15T12:31:10.589952+0000","last_undegraded":"2024-09-15T12:31:10.589952+0000","last_fullsized":"2024-09-15T12:31:10.589952+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1897,"log_dups_size":0,"ondisk_log_size":1897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27197440,"num_objects":415,"num_object_clones":0,"num_object_copies":1245,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1897,"num_write_kb":73984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.328638+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:30:58.328638+0000","last_peered":"2024-09-15T12:30:58.328638+0000","last_clean":"2024-09-15T12:30:58.328638+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:30:58.328638+0000","last_undegraded":"2024-09-15T12:30:58.328638+0000","last_fullsized":"2024-09-15T12:30:58.328638+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"92'1723","reported_seq":1753,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.492348+0000","last_change":"2024-09-15T12:28:39.046988+0000","last_active":"2024-09-15T12:31:10.492348+0000","last_peered":"2024-09-15T12:31:10.492348+0000","last_clean":"2024-09-15T12:31:10.492348+0000","last_became_active":"2024-09-15T12:28:39.017167+0000","last_became_peered":"2024-09-15T12:28:39.017167+0000","last_unstale":"2024-09-15T12:31:10.492348+0000","last_undegraded":"2024-09-15T12:31:10.492348+0000","last_fullsized":"2024-09-15T12:31:10.492348+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1723,"log_dups_size":0,"ondisk_log_size":1723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23658496,"num_objects":361,"num_object_clones":0,"num_object_copies":1083,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1723,"num_write_kb":66688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.354596+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:30:58.354596+0000","last_peered":"2024-09-15T12:30:58.354596+0000","last_clean":"2024-09-15T12:30:58.354596+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:30:58.354596+0000","last_undegraded":"2024-09-15T12:30:58.354596+0000","last_fullsized":"2024-09-15T12:30:58.354596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":423165976,"num_objects":6458,"num_object_clones":0,"num_object_copies":19374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":29094,"num_write_kb":1137601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79433728,"data_stored":1270743112,"data_compressed":60341680,"data_compressed_allocated":79421440,"data_compressed_original":1270743040,"omap_allocated":0,"internal_metadata":0},"log_size":29094,"ondisk_log_size":29094,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673708,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":139556,"kb_used_data":18320,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94232284,"statfs":{"total":96636764160,"available":96493858816,"internally_reserved":0,"allocated":18759680,"data_stored":287666070,"data_compressed":13648144,"data_compressed_allocated":17965056,"data_compressed_original":287358976,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":148432,"kb_used_data":18880,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94223408,"statfs":{"total":96636764160,"available":96484769792,"internally_reserved":0,"allocated":19333120,"data_stored":296841105,"data_compressed":14083824,"data_compressed_allocated":18538496,"data_compressed_original":296534016,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":143292,"kb_used_data":22056,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94228548,"statfs":{"total":96636764160,"available":96490033152,"internally_reserved":0,"allocated":22585344,"data_stored":349203849,"data_compressed":16568288,"data_compressed_allocated":21807104,"data_compressed_original":348913664,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":151552,"kb_used_data":22000,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94220288,"statfs":{"total":96636764160,"available":96481574912,"internally_reserved":0,"allocated":22528000,"data_stored":347893673,"data_compressed":16508072,"data_compressed_allocated":21729280,"data_compressed_original":347586560,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21622784,"data_stored":345899032,"data_compressed":16425136,"data_compressed_allocated":21618688,"data_compressed_original":345899008,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21651456,"data_stored":346357784,"data_compressed":16446920,"data_compressed_allocated":21647360,"data_compressed_original":346357760,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18382848,"data_stored":294125568,"data_compressed":13966656,"data_compressed_allocated":18382848,"data_compressed_original":294125568,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17776640,"data_stored":284360728,"data_compressed":13502968,"data_compressed_allocated":17772544,"data_compressed_original":284360704,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:31:21.821 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:31:21.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:21.983+0000 7f2505391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:21.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:21.995+0000 7f2505391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:24.692 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:31:24.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:24.836+0000 7fb922711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:24.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:24.846+0000 7fb922711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:26.598 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:31:26.598 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:31:26.599 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:31:26.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:26.758+0000 7f90f7791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:26.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:26.772+0000 7f90f7791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:27.084 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:31:27.085 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:31:27.108 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":467,"stamp":"2024-09-15T12:31:25.854289+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":423756363,"num_objects":6462,"num_object_clones":0,"num_object_copies":19386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":29175,"num_write_kb":1138709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29149,"ondisk_log_size":29149,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":582832,"kb_used_data":81256,"kb_used_omap":0,"kb_used_meta":501504,"kb_avail":376904528,"statfs":{"total":386547056640,"available":385950236672,"internally_reserved":0,"allocated":83206144,"data_stored":1281604697,"data_compressed":60808328,"data_compressed_allocated":80039936,"data_compressed_original":1280393216,"omap_allocated":0,"internal_metadata":513540096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002433"},"pg_stats":[{"pgid":"6.f","version":"92'1840","reported_seq":1870,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.696172+0000","last_change":"2024-09-15T12:28:39.077376+0000","last_active":"2024-09-15T12:31:10.696172+0000","last_peered":"2024-09-15T12:31:10.696172+0000","last_clean":"2024-09-15T12:31:10.696172+0000","last_became_active":"2024-09-15T12:28:39.068998+0000","last_became_peered":"2024-09-15T12:28:39.068998+0000","last_unstale":"2024-09-15T12:31:10.696172+0000","last_undegraded":"2024-09-15T12:31:10.696172+0000","last_fullsized":"2024-09-15T12:31:10.696172+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1840,"log_dups_size":0,"ondisk_log_size":1840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25952256,"num_objects":396,"num_object_clones":0,"num_object_copies":1188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1840,"num_write_kb":71552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"92'1818","reported_seq":1848,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.541974+0000","last_change":"2024-09-15T12:28:39.087809+0000","last_active":"2024-09-15T12:31:10.541974+0000","last_peered":"2024-09-15T12:31:10.541974+0000","last_clean":"2024-09-15T12:31:10.541974+0000","last_became_active":"2024-09-15T12:28:39.074098+0000","last_became_peered":"2024-09-15T12:28:39.074098+0000","last_unstale":"2024-09-15T12:31:10.541974+0000","last_undegraded":"2024-09-15T12:31:10.541974+0000","last_fullsized":"2024-09-15T12:31:10.541974+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1818,"log_dups_size":0,"ondisk_log_size":1818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27787264,"num_objects":424,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1818,"num_write_kb":71744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"92'1878","reported_seq":1909,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.709028+0000","last_change":"2024-09-15T12:28:39.061230+0000","last_active":"2024-09-15T12:31:10.709028+0000","last_peered":"2024-09-15T12:31:10.709028+0000","last_clean":"2024-09-15T12:31:10.709028+0000","last_became_active":"2024-09-15T12:28:39.046625+0000","last_became_peered":"2024-09-15T12:28:39.046625+0000","last_unstale":"2024-09-15T12:31:10.709028+0000","last_undegraded":"2024-09-15T12:31:10.709028+0000","last_fullsized":"2024-09-15T12:31:10.709028+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1878,"log_dups_size":0,"ondisk_log_size":1878,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27066392,"num_objects":414,"num_object_clones":0,"num_object_copies":1242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1878,"num_write_kb":73281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"92'1771","reported_seq":1801,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:11.370230+0000","last_change":"2024-09-15T12:28:39.043350+0000","last_active":"2024-09-15T12:31:11.370230+0000","last_peered":"2024-09-15T12:31:11.370230+0000","last_clean":"2024-09-15T12:31:11.370230+0000","last_became_active":"2024-09-15T12:28:39.034104+0000","last_became_peered":"2024-09-15T12:28:39.034104+0000","last_unstale":"2024-09-15T12:31:11.370230+0000","last_undegraded":"2024-09-15T12:31:11.370230+0000","last_fullsized":"2024-09-15T12:31:11.370230+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1771,"log_dups_size":0,"ondisk_log_size":1771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26542080,"num_objects":405,"num_object_clones":0,"num_object_copies":1215,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1771,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"92'1892","reported_seq":1922,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.697237+0000","last_change":"2024-09-15T12:28:39.083865+0000","last_active":"2024-09-15T12:31:10.697237+0000","last_peered":"2024-09-15T12:31:10.697237+0000","last_clean":"2024-09-15T12:31:10.697237+0000","last_became_active":"2024-09-15T12:28:39.075263+0000","last_became_peered":"2024-09-15T12:28:39.075263+0000","last_unstale":"2024-09-15T12:31:10.697237+0000","last_undegraded":"2024-09-15T12:31:10.697237+0000","last_fullsized":"2024-09-15T12:31:10.697237+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1892,"log_dups_size":0,"ondisk_log_size":1892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26869760,"num_objects":410,"num_object_clones":0,"num_object_copies":1230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1892,"num_write_kb":73664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"92'1749","reported_seq":1779,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.465171+0000","last_change":"2024-09-15T12:28:39.031088+0000","last_active":"2024-09-15T12:31:10.465171+0000","last_peered":"2024-09-15T12:31:10.465171+0000","last_clean":"2024-09-15T12:31:10.465171+0000","last_became_active":"2024-09-15T12:28:39.025037+0000","last_became_peered":"2024-09-15T12:28:39.025037+0000","last_unstale":"2024-09-15T12:31:10.465171+0000","last_undegraded":"2024-09-15T12:31:10.465171+0000","last_fullsized":"2024-09-15T12:31:10.465171+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1749,"log_dups_size":0,"ondisk_log_size":1749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25755648,"num_objects":393,"num_object_clones":0,"num_object_copies":1179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1749,"num_write_kb":68544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"92'1842","reported_seq":1872,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:11.784982+0000","last_change":"2024-09-15T12:28:39.067539+0000","last_active":"2024-09-15T12:31:11.784982+0000","last_peered":"2024-09-15T12:31:11.784982+0000","last_clean":"2024-09-15T12:31:11.784982+0000","last_became_active":"2024-09-15T12:28:39.054389+0000","last_became_peered":"2024-09-15T12:28:39.054389+0000","last_unstale":"2024-09-15T12:31:11.784982+0000","last_undegraded":"2024-09-15T12:31:11.784982+0000","last_fullsized":"2024-09-15T12:31:11.784982+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1842,"log_dups_size":0,"ondisk_log_size":1842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25296896,"num_objects":386,"num_object_clones":0,"num_object_copies":1158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1842,"num_write_kb":71296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"92'1784","reported_seq":1814,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.566972+0000","last_change":"2024-09-15T12:28:38.993796+0000","last_active":"2024-09-15T12:31:10.566972+0000","last_peered":"2024-09-15T12:31:10.566972+0000","last_clean":"2024-09-15T12:31:10.566972+0000","last_became_active":"2024-09-15T12:28:38.987121+0000","last_became_peered":"2024-09-15T12:28:38.987121+0000","last_unstale":"2024-09-15T12:31:10.566972+0000","last_undegraded":"2024-09-15T12:31:10.566972+0000","last_fullsized":"2024-09-15T12:31:10.566972+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1784,"log_dups_size":0,"ondisk_log_size":1784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25952256,"num_objects":396,"num_object_clones":0,"num_object_copies":1188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1784,"num_write_kb":69760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"92'1792","reported_seq":1822,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.458495+0000","last_change":"2024-09-15T12:28:39.047799+0000","last_active":"2024-09-15T12:31:10.458495+0000","last_peered":"2024-09-15T12:31:10.458495+0000","last_clean":"2024-09-15T12:31:10.458495+0000","last_became_active":"2024-09-15T12:28:39.017997+0000","last_became_peered":"2024-09-15T12:28:39.017997+0000","last_unstale":"2024-09-15T12:31:10.458495+0000","last_undegraded":"2024-09-15T12:31:10.458495+0000","last_fullsized":"2024-09-15T12:31:10.458495+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1792,"log_dups_size":0,"ondisk_log_size":1792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27918336,"num_objects":426,"num_object_clones":0,"num_object_copies":1278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1792,"num_write_kb":70976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":319,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.347895+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:30:58.347895+0000","last_peered":"2024-09-15T12:30:58.347895+0000","last_clean":"2024-09-15T12:30:58.347895+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:30:58.347895+0000","last_undegraded":"2024-09-15T12:30:58.347895+0000","last_fullsized":"2024-09-15T12:30:58.347895+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":248,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.357144+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:30:58.357144+0000","last_peered":"2024-09-15T12:30:58.357144+0000","last_clean":"2024-09-15T12:30:58.357144+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:30:58.357144+0000","last_undegraded":"2024-09-15T12:30:58.357144+0000","last_fullsized":"2024-09-15T12:30:58.357144+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"92'1785","reported_seq":1815,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:11.624763+0000","last_change":"2024-09-15T12:28:39.071985+0000","last_active":"2024-09-15T12:31:11.624763+0000","last_peered":"2024-09-15T12:31:11.624763+0000","last_clean":"2024-09-15T12:31:11.624763+0000","last_became_active":"2024-09-15T12:28:39.061062+0000","last_became_peered":"2024-09-15T12:28:39.061062+0000","last_unstale":"2024-09-15T12:31:11.624763+0000","last_undegraded":"2024-09-15T12:31:11.624763+0000","last_fullsized":"2024-09-15T12:31:11.624763+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1785,"log_dups_size":0,"ondisk_log_size":1785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25755648,"num_objects":393,"num_object_clones":0,"num_object_copies":1179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1785,"num_write_kb":69696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.364558+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:30:58.364558+0000","last_peered":"2024-09-15T12:30:58.364558+0000","last_clean":"2024-09-15T12:30:58.364558+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:30:58.364558+0000","last_undegraded":"2024-09-15T12:30:58.364558+0000","last_fullsized":"2024-09-15T12:30:58.364558+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"92'1833","reported_seq":1863,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.672823+0000","last_change":"2024-09-15T12:28:39.025429+0000","last_active":"2024-09-15T12:31:10.672823+0000","last_peered":"2024-09-15T12:31:10.672823+0000","last_clean":"2024-09-15T12:31:10.672823+0000","last_became_active":"2024-09-15T12:28:39.007673+0000","last_became_peered":"2024-09-15T12:28:39.007673+0000","last_unstale":"2024-09-15T12:31:10.672823+0000","last_undegraded":"2024-09-15T12:31:10.672823+0000","last_fullsized":"2024-09-15T12:31:10.672823+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1833,"log_dups_size":0,"ondisk_log_size":1833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27197440,"num_objects":415,"num_object_clones":0,"num_object_copies":1245,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1833,"num_write_kb":71936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.339624+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:30:58.339624+0000","last_peered":"2024-09-15T12:30:58.339624+0000","last_clean":"2024-09-15T12:30:58.339624+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:30:58.339624+0000","last_undegraded":"2024-09-15T12:30:58.339624+0000","last_fullsized":"2024-09-15T12:30:58.339624+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"92'1813","reported_seq":1843,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:11.748799+0000","last_change":"2024-09-15T12:28:39.029713+0000","last_active":"2024-09-15T12:31:11.748799+0000","last_peered":"2024-09-15T12:31:11.748799+0000","last_clean":"2024-09-15T12:31:11.748799+0000","last_became_active":"2024-09-15T12:28:39.020975+0000","last_became_peered":"2024-09-15T12:28:39.020975+0000","last_unstale":"2024-09-15T12:31:11.748799+0000","last_undegraded":"2024-09-15T12:31:11.748799+0000","last_fullsized":"2024-09-15T12:31:11.748799+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1813,"log_dups_size":0,"ondisk_log_size":1813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26279936,"num_objects":401,"num_object_clones":0,"num_object_copies":1203,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1813,"num_write_kb":70848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":249,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.357439+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:30:58.357439+0000","last_peered":"2024-09-15T12:30:58.357439+0000","last_clean":"2024-09-15T12:30:58.357439+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:30:58.357439+0000","last_undegraded":"2024-09-15T12:30:58.357439+0000","last_fullsized":"2024-09-15T12:30:58.357439+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"92'1758","reported_seq":1788,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.695282+0000","last_change":"2024-09-15T12:28:39.023135+0000","last_active":"2024-09-15T12:31:10.695282+0000","last_peered":"2024-09-15T12:31:10.695282+0000","last_clean":"2024-09-15T12:31:10.695282+0000","last_became_active":"2024-09-15T12:28:39.014305+0000","last_became_peered":"2024-09-15T12:28:39.014305+0000","last_unstale":"2024-09-15T12:31:10.695282+0000","last_undegraded":"2024-09-15T12:31:10.695282+0000","last_fullsized":"2024-09-15T12:31:10.695282+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1758,"log_dups_size":0,"ondisk_log_size":1758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27000832,"num_objects":412,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1758,"num_write_kb":69440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.341995+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:30:58.341995+0000","last_peered":"2024-09-15T12:30:58.341995+0000","last_clean":"2024-09-15T12:30:58.341995+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:30:58.341995+0000","last_undegraded":"2024-09-15T12:30:58.341995+0000","last_fullsized":"2024-09-15T12:30:58.341995+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"92'1919","reported_seq":1949,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.746632+0000","last_change":"2024-09-15T12:28:39.054857+0000","last_active":"2024-09-15T12:31:10.746632+0000","last_peered":"2024-09-15T12:31:10.746632+0000","last_clean":"2024-09-15T12:31:10.746632+0000","last_became_active":"2024-09-15T12:28:39.046395+0000","last_became_peered":"2024-09-15T12:28:39.046395+0000","last_unstale":"2024-09-15T12:31:10.746632+0000","last_undegraded":"2024-09-15T12:31:10.746632+0000","last_fullsized":"2024-09-15T12:31:10.746632+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1919,"log_dups_size":0,"ondisk_log_size":1919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26935296,"num_objects":411,"num_object_clones":0,"num_object_copies":1233,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1919,"num_write_kb":74560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.353747+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:30:58.353747+0000","last_peered":"2024-09-15T12:30:58.353747+0000","last_clean":"2024-09-15T12:30:58.353747+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:30:58.353747+0000","last_undegraded":"2024-09-15T12:30:58.353747+0000","last_fullsized":"2024-09-15T12:30:58.353747+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"92'1897","reported_seq":1927,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.589952+0000","last_change":"2024-09-15T12:28:39.052760+0000","last_active":"2024-09-15T12:31:10.589952+0000","last_peered":"2024-09-15T12:31:10.589952+0000","last_clean":"2024-09-15T12:31:10.589952+0000","last_became_active":"2024-09-15T12:28:39.041365+0000","last_became_peered":"2024-09-15T12:28:39.041365+0000","last_unstale":"2024-09-15T12:31:10.589952+0000","last_undegraded":"2024-09-15T12:31:10.589952+0000","last_fullsized":"2024-09-15T12:31:10.589952+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1897,"log_dups_size":0,"ondisk_log_size":1897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27197440,"num_objects":415,"num_object_clones":0,"num_object_copies":1245,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1897,"num_write_kb":73984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.328638+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:30:58.328638+0000","last_peered":"2024-09-15T12:30:58.328638+0000","last_clean":"2024-09-15T12:30:58.328638+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:30:58.328638+0000","last_undegraded":"2024-09-15T12:30:58.328638+0000","last_fullsized":"2024-09-15T12:30:58.328638+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"92'1723","reported_seq":1753,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.492348+0000","last_change":"2024-09-15T12:28:39.046988+0000","last_active":"2024-09-15T12:31:10.492348+0000","last_peered":"2024-09-15T12:31:10.492348+0000","last_clean":"2024-09-15T12:31:10.492348+0000","last_became_active":"2024-09-15T12:28:39.017167+0000","last_became_peered":"2024-09-15T12:28:39.017167+0000","last_unstale":"2024-09-15T12:31:10.492348+0000","last_undegraded":"2024-09-15T12:31:10.492348+0000","last_fullsized":"2024-09-15T12:31:10.492348+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1723,"log_dups_size":0,"ondisk_log_size":1723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23658496,"num_objects":361,"num_object_clones":0,"num_object_copies":1083,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1723,"num_write_kb":66688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.354596+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:30:58.354596+0000","last_peered":"2024-09-15T12:30:58.354596+0000","last_clean":"2024-09-15T12:30:58.354596+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:30:58.354596+0000","last_undegraded":"2024-09-15T12:30:58.354596+0000","last_fullsized":"2024-09-15T12:30:58.354596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":423165976,"num_objects":6458,"num_object_clones":0,"num_object_copies":19374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":29094,"num_write_kb":1137601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79433728,"data_stored":1270743112,"data_compressed":60341680,"data_compressed_allocated":79421440,"data_compressed_original":1270743040,"omap_allocated":0,"internal_metadata":0},"log_size":29094,"ondisk_log_size":29094,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673708,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":139556,"kb_used_data":18320,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94232284,"statfs":{"total":96636764160,"available":96493858816,"internally_reserved":0,"allocated":18759680,"data_stored":287666070,"data_compressed":13648144,"data_compressed_allocated":17965056,"data_compressed_original":287358976,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":148432,"kb_used_data":18880,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94223408,"statfs":{"total":96636764160,"available":96484769792,"internally_reserved":0,"allocated":19333120,"data_stored":296841105,"data_compressed":14083824,"data_compressed_allocated":18538496,"data_compressed_original":296534016,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":143292,"kb_used_data":22056,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94228548,"statfs":{"total":96636764160,"available":96490033152,"internally_reserved":0,"allocated":22585344,"data_stored":349203849,"data_compressed":16568288,"data_compressed_allocated":21807104,"data_compressed_original":348913664,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":151552,"kb_used_data":22000,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94220288,"statfs":{"total":96636764160,"available":96481574912,"internally_reserved":0,"allocated":22528000,"data_stored":347893673,"data_compressed":16508072,"data_compressed_allocated":21729280,"data_compressed_original":347586560,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21622784,"data_stored":345899032,"data_compressed":16425136,"data_compressed_allocated":21618688,"data_compressed_original":345899008,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21651456,"data_stored":346357784,"data_compressed":16446920,"data_compressed_allocated":21647360,"data_compressed_original":346357760,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18382848,"data_stored":294125568,"data_compressed":13966656,"data_compressed_allocated":18382848,"data_compressed_original":294125568,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17776640,"data_stored":284360728,"data_compressed":13502968,"data_compressed_allocated":17772544,"data_compressed_original":284360704,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:31:27.293 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:31:27.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:27.446+0000 7f1ddb711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:27.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:27.452+0000 7f1ddb711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:30.360 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:31:30.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:30.525+0000 7f7ebe07f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:30.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:30.533+0000 7f7ebe07f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:32.109 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:31:32.110 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:31:32.110 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:31:32.110 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:31:32.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:32.278+0000 7f4f728d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:32.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:32.293+0000 7f4f728d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:32.517 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:31:32.517 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:31:32.517 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:31:32.517 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:31:32.517 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:31:32.517 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:31:32.517 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:31:32.517 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:31:32.517 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:31:32.518 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:31:32.518 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:31:32.518 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:31:32.521 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:31:32.522 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:31:32.522 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:31:32.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:32.685+0000 7efe666fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:32.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:32.701+0000 7efe666fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:32.883 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:31:32.883 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:31:32.883 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:31:32.883 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:31:32.883 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:31:32.883 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:31:32.883 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:31:32.883 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:31:32.884 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:31:32.884 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:31:32.884 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:31:32.884 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:31:32.888 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:31:32.888 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:31:32.888 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:31:33.017 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:31:33.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:33.045+0000 7f169c311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:33.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:33.063+0000 7f169c311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:33.101 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:31:33.101 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:31:33.101 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:31:33.101 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:31:33.101 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:31:33.101 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:31:33.101 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:31:33.101 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:31:33.101 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:31:33.102 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:31:33.102 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:31:33.102 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:31:33.106 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:31:33.106 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:31:33.106 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:31:33.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:33.180+0000 7f05b6b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:33.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:33.194+0000 7f05b6b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:33.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:33.315+0000 7f8cb0f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:33.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:33.328+0000 7f8cb0f11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:33.370 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:31:33.370 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:31:33.371 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:31:33.371 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:31:33.371 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:31:33.371 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:31:33.371 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:31:33.371 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:31:33.371 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:31:33.371 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:31:33.371 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:31:33.371 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:31:33.374 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:31:33.375 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:31:36.086 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:31:36.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:36.223+0000 7f6ee0791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:36.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:36.232+0000 7f6ee0791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:38.375 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:31:38.376 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:31:38.376 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:31:38.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:38.548+0000 7fd2218fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:38.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:38.564+0000 7fd2218fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:38.619 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:31:38.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:38.761+0000 7ff8a04d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:38.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:38.769+0000 7ff8a04d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:38.931 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:31:38.931 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:31:38.951 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":473,"stamp":"2024-09-15T12:31:37.856488+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":423756363,"num_objects":6462,"num_object_clones":0,"num_object_copies":19386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":29175,"num_write_kb":1138709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29149,"ondisk_log_size":29149,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":582832,"kb_used_data":81256,"kb_used_omap":0,"kb_used_meta":501504,"kb_avail":376904528,"statfs":{"total":386547056640,"available":385950236672,"internally_reserved":0,"allocated":83206144,"data_stored":1281604697,"data_compressed":60808328,"data_compressed_allocated":80039936,"data_compressed_original":1280393216,"omap_allocated":0,"internal_metadata":513540096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002198"},"pg_stats":[{"pgid":"6.f","version":"92'1840","reported_seq":1870,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.696172+0000","last_change":"2024-09-15T12:28:39.077376+0000","last_active":"2024-09-15T12:31:10.696172+0000","last_peered":"2024-09-15T12:31:10.696172+0000","last_clean":"2024-09-15T12:31:10.696172+0000","last_became_active":"2024-09-15T12:28:39.068998+0000","last_became_peered":"2024-09-15T12:28:39.068998+0000","last_unstale":"2024-09-15T12:31:10.696172+0000","last_undegraded":"2024-09-15T12:31:10.696172+0000","last_fullsized":"2024-09-15T12:31:10.696172+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1840,"log_dups_size":0,"ondisk_log_size":1840,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25952256,"num_objects":396,"num_object_clones":0,"num_object_copies":1188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1840,"num_write_kb":71552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"92'1818","reported_seq":1848,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.541974+0000","last_change":"2024-09-15T12:28:39.087809+0000","last_active":"2024-09-15T12:31:10.541974+0000","last_peered":"2024-09-15T12:31:10.541974+0000","last_clean":"2024-09-15T12:31:10.541974+0000","last_became_active":"2024-09-15T12:28:39.074098+0000","last_became_peered":"2024-09-15T12:28:39.074098+0000","last_unstale":"2024-09-15T12:31:10.541974+0000","last_undegraded":"2024-09-15T12:31:10.541974+0000","last_fullsized":"2024-09-15T12:31:10.541974+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1818,"log_dups_size":0,"ondisk_log_size":1818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27787264,"num_objects":424,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1818,"num_write_kb":71744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"92'1878","reported_seq":1909,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.709028+0000","last_change":"2024-09-15T12:28:39.061230+0000","last_active":"2024-09-15T12:31:10.709028+0000","last_peered":"2024-09-15T12:31:10.709028+0000","last_clean":"2024-09-15T12:31:10.709028+0000","last_became_active":"2024-09-15T12:28:39.046625+0000","last_became_peered":"2024-09-15T12:28:39.046625+0000","last_unstale":"2024-09-15T12:31:10.709028+0000","last_undegraded":"2024-09-15T12:31:10.709028+0000","last_fullsized":"2024-09-15T12:31:10.709028+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1878,"log_dups_size":0,"ondisk_log_size":1878,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27066392,"num_objects":414,"num_object_clones":0,"num_object_copies":1242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1878,"num_write_kb":73281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"92'1771","reported_seq":1801,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:11.370230+0000","last_change":"2024-09-15T12:28:39.043350+0000","last_active":"2024-09-15T12:31:11.370230+0000","last_peered":"2024-09-15T12:31:11.370230+0000","last_clean":"2024-09-15T12:31:11.370230+0000","last_became_active":"2024-09-15T12:28:39.034104+0000","last_became_peered":"2024-09-15T12:28:39.034104+0000","last_unstale":"2024-09-15T12:31:11.370230+0000","last_undegraded":"2024-09-15T12:31:11.370230+0000","last_fullsized":"2024-09-15T12:31:11.370230+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1771,"log_dups_size":0,"ondisk_log_size":1771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26542080,"num_objects":405,"num_object_clones":0,"num_object_copies":1215,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1771,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"92'1892","reported_seq":1922,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.697237+0000","last_change":"2024-09-15T12:28:39.083865+0000","last_active":"2024-09-15T12:31:10.697237+0000","last_peered":"2024-09-15T12:31:10.697237+0000","last_clean":"2024-09-15T12:31:10.697237+0000","last_became_active":"2024-09-15T12:28:39.075263+0000","last_became_peered":"2024-09-15T12:28:39.075263+0000","last_unstale":"2024-09-15T12:31:10.697237+0000","last_undegraded":"2024-09-15T12:31:10.697237+0000","last_fullsized":"2024-09-15T12:31:10.697237+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1892,"log_dups_size":0,"ondisk_log_size":1892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26869760,"num_objects":410,"num_object_clones":0,"num_object_copies":1230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1892,"num_write_kb":73664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"92'1749","reported_seq":1779,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.465171+0000","last_change":"2024-09-15T12:28:39.031088+0000","last_active":"2024-09-15T12:31:10.465171+0000","last_peered":"2024-09-15T12:31:10.465171+0000","last_clean":"2024-09-15T12:31:10.465171+0000","last_became_active":"2024-09-15T12:28:39.025037+0000","last_became_peered":"2024-09-15T12:28:39.025037+0000","last_unstale":"2024-09-15T12:31:10.465171+0000","last_undegraded":"2024-09-15T12:31:10.465171+0000","last_fullsized":"2024-09-15T12:31:10.465171+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1749,"log_dups_size":0,"ondisk_log_size":1749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25755648,"num_objects":393,"num_object_clones":0,"num_object_copies":1179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1749,"num_write_kb":68544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"92'1842","reported_seq":1872,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:11.784982+0000","last_change":"2024-09-15T12:28:39.067539+0000","last_active":"2024-09-15T12:31:11.784982+0000","last_peered":"2024-09-15T12:31:11.784982+0000","last_clean":"2024-09-15T12:31:11.784982+0000","last_became_active":"2024-09-15T12:28:39.054389+0000","last_became_peered":"2024-09-15T12:28:39.054389+0000","last_unstale":"2024-09-15T12:31:11.784982+0000","last_undegraded":"2024-09-15T12:31:11.784982+0000","last_fullsized":"2024-09-15T12:31:11.784982+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1842,"log_dups_size":0,"ondisk_log_size":1842,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25296896,"num_objects":386,"num_object_clones":0,"num_object_copies":1158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1842,"num_write_kb":71296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"92'1784","reported_seq":1814,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.566972+0000","last_change":"2024-09-15T12:28:38.993796+0000","last_active":"2024-09-15T12:31:10.566972+0000","last_peered":"2024-09-15T12:31:10.566972+0000","last_clean":"2024-09-15T12:31:10.566972+0000","last_became_active":"2024-09-15T12:28:38.987121+0000","last_became_peered":"2024-09-15T12:28:38.987121+0000","last_unstale":"2024-09-15T12:31:10.566972+0000","last_undegraded":"2024-09-15T12:31:10.566972+0000","last_fullsized":"2024-09-15T12:31:10.566972+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1784,"log_dups_size":0,"ondisk_log_size":1784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25952256,"num_objects":396,"num_object_clones":0,"num_object_copies":1188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1784,"num_write_kb":69760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"92'1792","reported_seq":1822,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.458495+0000","last_change":"2024-09-15T12:28:39.047799+0000","last_active":"2024-09-15T12:31:10.458495+0000","last_peered":"2024-09-15T12:31:10.458495+0000","last_clean":"2024-09-15T12:31:10.458495+0000","last_became_active":"2024-09-15T12:28:39.017997+0000","last_became_peered":"2024-09-15T12:28:39.017997+0000","last_unstale":"2024-09-15T12:31:10.458495+0000","last_undegraded":"2024-09-15T12:31:10.458495+0000","last_fullsized":"2024-09-15T12:31:10.458495+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1792,"log_dups_size":0,"ondisk_log_size":1792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27918336,"num_objects":426,"num_object_clones":0,"num_object_copies":1278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1792,"num_write_kb":70976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":319,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.347895+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:30:58.347895+0000","last_peered":"2024-09-15T12:30:58.347895+0000","last_clean":"2024-09-15T12:30:58.347895+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:30:58.347895+0000","last_undegraded":"2024-09-15T12:30:58.347895+0000","last_fullsized":"2024-09-15T12:30:58.347895+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":248,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.357144+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:30:58.357144+0000","last_peered":"2024-09-15T12:30:58.357144+0000","last_clean":"2024-09-15T12:30:58.357144+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:30:58.357144+0000","last_undegraded":"2024-09-15T12:30:58.357144+0000","last_fullsized":"2024-09-15T12:30:58.357144+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"92'1785","reported_seq":1815,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:11.624763+0000","last_change":"2024-09-15T12:28:39.071985+0000","last_active":"2024-09-15T12:31:11.624763+0000","last_peered":"2024-09-15T12:31:11.624763+0000","last_clean":"2024-09-15T12:31:11.624763+0000","last_became_active":"2024-09-15T12:28:39.061062+0000","last_became_peered":"2024-09-15T12:28:39.061062+0000","last_unstale":"2024-09-15T12:31:11.624763+0000","last_undegraded":"2024-09-15T12:31:11.624763+0000","last_fullsized":"2024-09-15T12:31:11.624763+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1785,"log_dups_size":0,"ondisk_log_size":1785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25755648,"num_objects":393,"num_object_clones":0,"num_object_copies":1179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1785,"num_write_kb":69696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.364558+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:30:58.364558+0000","last_peered":"2024-09-15T12:30:58.364558+0000","last_clean":"2024-09-15T12:30:58.364558+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:30:58.364558+0000","last_undegraded":"2024-09-15T12:30:58.364558+0000","last_fullsized":"2024-09-15T12:30:58.364558+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"92'1833","reported_seq":1863,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.672823+0000","last_change":"2024-09-15T12:28:39.025429+0000","last_active":"2024-09-15T12:31:10.672823+0000","last_peered":"2024-09-15T12:31:10.672823+0000","last_clean":"2024-09-15T12:31:10.672823+0000","last_became_active":"2024-09-15T12:28:39.007673+0000","last_became_peered":"2024-09-15T12:28:39.007673+0000","last_unstale":"2024-09-15T12:31:10.672823+0000","last_undegraded":"2024-09-15T12:31:10.672823+0000","last_fullsized":"2024-09-15T12:31:10.672823+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1833,"log_dups_size":0,"ondisk_log_size":1833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27197440,"num_objects":415,"num_object_clones":0,"num_object_copies":1245,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1833,"num_write_kb":71936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.339624+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:30:58.339624+0000","last_peered":"2024-09-15T12:30:58.339624+0000","last_clean":"2024-09-15T12:30:58.339624+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:30:58.339624+0000","last_undegraded":"2024-09-15T12:30:58.339624+0000","last_fullsized":"2024-09-15T12:30:58.339624+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"92'1813","reported_seq":1843,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:11.748799+0000","last_change":"2024-09-15T12:28:39.029713+0000","last_active":"2024-09-15T12:31:11.748799+0000","last_peered":"2024-09-15T12:31:11.748799+0000","last_clean":"2024-09-15T12:31:11.748799+0000","last_became_active":"2024-09-15T12:28:39.020975+0000","last_became_peered":"2024-09-15T12:28:39.020975+0000","last_unstale":"2024-09-15T12:31:11.748799+0000","last_undegraded":"2024-09-15T12:31:11.748799+0000","last_fullsized":"2024-09-15T12:31:11.748799+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1813,"log_dups_size":0,"ondisk_log_size":1813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26279936,"num_objects":401,"num_object_clones":0,"num_object_copies":1203,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1813,"num_write_kb":70848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":249,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.357439+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:30:58.357439+0000","last_peered":"2024-09-15T12:30:58.357439+0000","last_clean":"2024-09-15T12:30:58.357439+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:30:58.357439+0000","last_undegraded":"2024-09-15T12:30:58.357439+0000","last_fullsized":"2024-09-15T12:30:58.357439+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"92'1758","reported_seq":1788,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.695282+0000","last_change":"2024-09-15T12:28:39.023135+0000","last_active":"2024-09-15T12:31:10.695282+0000","last_peered":"2024-09-15T12:31:10.695282+0000","last_clean":"2024-09-15T12:31:10.695282+0000","last_became_active":"2024-09-15T12:28:39.014305+0000","last_became_peered":"2024-09-15T12:28:39.014305+0000","last_unstale":"2024-09-15T12:31:10.695282+0000","last_undegraded":"2024-09-15T12:31:10.695282+0000","last_fullsized":"2024-09-15T12:31:10.695282+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1758,"log_dups_size":0,"ondisk_log_size":1758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27000832,"num_objects":412,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1758,"num_write_kb":69440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.341995+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:30:58.341995+0000","last_peered":"2024-09-15T12:30:58.341995+0000","last_clean":"2024-09-15T12:30:58.341995+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:30:58.341995+0000","last_undegraded":"2024-09-15T12:30:58.341995+0000","last_fullsized":"2024-09-15T12:30:58.341995+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"92'1919","reported_seq":1949,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.746632+0000","last_change":"2024-09-15T12:28:39.054857+0000","last_active":"2024-09-15T12:31:10.746632+0000","last_peered":"2024-09-15T12:31:10.746632+0000","last_clean":"2024-09-15T12:31:10.746632+0000","last_became_active":"2024-09-15T12:28:39.046395+0000","last_became_peered":"2024-09-15T12:28:39.046395+0000","last_unstale":"2024-09-15T12:31:10.746632+0000","last_undegraded":"2024-09-15T12:31:10.746632+0000","last_fullsized":"2024-09-15T12:31:10.746632+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1919,"log_dups_size":0,"ondisk_log_size":1919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26935296,"num_objects":411,"num_object_clones":0,"num_object_copies":1233,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1919,"num_write_kb":74560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.353747+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:30:58.353747+0000","last_peered":"2024-09-15T12:30:58.353747+0000","last_clean":"2024-09-15T12:30:58.353747+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:30:58.353747+0000","last_undegraded":"2024-09-15T12:30:58.353747+0000","last_fullsized":"2024-09-15T12:30:58.353747+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"92'1897","reported_seq":1927,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.589952+0000","last_change":"2024-09-15T12:28:39.052760+0000","last_active":"2024-09-15T12:31:10.589952+0000","last_peered":"2024-09-15T12:31:10.589952+0000","last_clean":"2024-09-15T12:31:10.589952+0000","last_became_active":"2024-09-15T12:28:39.041365+0000","last_became_peered":"2024-09-15T12:28:39.041365+0000","last_unstale":"2024-09-15T12:31:10.589952+0000","last_undegraded":"2024-09-15T12:31:10.589952+0000","last_fullsized":"2024-09-15T12:31:10.589952+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1897,"log_dups_size":0,"ondisk_log_size":1897,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27197440,"num_objects":415,"num_object_clones":0,"num_object_copies":1245,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1897,"num_write_kb":73984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.328638+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:30:58.328638+0000","last_peered":"2024-09-15T12:30:58.328638+0000","last_clean":"2024-09-15T12:30:58.328638+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:30:58.328638+0000","last_undegraded":"2024-09-15T12:30:58.328638+0000","last_fullsized":"2024-09-15T12:30:58.328638+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"92'1723","reported_seq":1753,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:10.492348+0000","last_change":"2024-09-15T12:28:39.046988+0000","last_active":"2024-09-15T12:31:10.492348+0000","last_peered":"2024-09-15T12:31:10.492348+0000","last_clean":"2024-09-15T12:31:10.492348+0000","last_became_active":"2024-09-15T12:28:39.017167+0000","last_became_peered":"2024-09-15T12:28:39.017167+0000","last_unstale":"2024-09-15T12:31:10.492348+0000","last_undegraded":"2024-09-15T12:31:10.492348+0000","last_fullsized":"2024-09-15T12:31:10.492348+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1723,"log_dups_size":0,"ondisk_log_size":1723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23658496,"num_objects":361,"num_object_clones":0,"num_object_copies":1083,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1723,"num_write_kb":66688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.354596+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:30:58.354596+0000","last_peered":"2024-09-15T12:30:58.354596+0000","last_clean":"2024-09-15T12:30:58.354596+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:30:58.354596+0000","last_undegraded":"2024-09-15T12:30:58.354596+0000","last_fullsized":"2024-09-15T12:30:58.354596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":423165976,"num_objects":6458,"num_object_clones":0,"num_object_copies":19374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":29094,"num_write_kb":1137601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79433728,"data_stored":1270743112,"data_compressed":60341680,"data_compressed_allocated":79421440,"data_compressed_original":1270743040,"omap_allocated":0,"internal_metadata":0},"log_size":29094,"ondisk_log_size":29094,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673708,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":139556,"kb_used_data":18320,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94232284,"statfs":{"total":96636764160,"available":96493858816,"internally_reserved":0,"allocated":18759680,"data_stored":287666070,"data_compressed":13648144,"data_compressed_allocated":17965056,"data_compressed_original":287358976,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":148432,"kb_used_data":18880,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94223408,"statfs":{"total":96636764160,"available":96484769792,"internally_reserved":0,"allocated":19333120,"data_stored":296841105,"data_compressed":14083824,"data_compressed_allocated":18538496,"data_compressed_original":296534016,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":143292,"kb_used_data":22056,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94228548,"statfs":{"total":96636764160,"available":96490033152,"internally_reserved":0,"allocated":22585344,"data_stored":349203849,"data_compressed":16568288,"data_compressed_allocated":21807104,"data_compressed_original":348913664,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":151552,"kb_used_data":22000,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94220288,"statfs":{"total":96636764160,"available":96481574912,"internally_reserved":0,"allocated":22528000,"data_stored":347893673,"data_compressed":16508072,"data_compressed_allocated":21729280,"data_compressed_original":347586560,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21622784,"data_stored":345899032,"data_compressed":16425136,"data_compressed_allocated":21618688,"data_compressed_original":345899008,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21651456,"data_stored":346357784,"data_compressed":16446920,"data_compressed_allocated":21647360,"data_compressed_original":346357760,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18382848,"data_stored":294125568,"data_compressed":13966656,"data_compressed_allocated":18382848,"data_compressed_original":294125568,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17776640,"data_stored":284360728,"data_compressed":13502968,"data_compressed_allocated":17772544,"data_compressed_original":284360704,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:31:41.633 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:31:41.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:41.798+0000 7f30c6d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:41.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:41.807+0000 7f30c6d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:43.953 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:31:43.954 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:31:43.954 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:31:43.954 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:31:44.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:44.115+0000 7fd4aa511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:44.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:44.132+0000 7fd4aa511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:44.332 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:31:44.332 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:31:44.332 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:31:44.332 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:31:44.332 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:31:44.333 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:31:44.333 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:31:44.333 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:31:44.333 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:31:44.333 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:31:44.333 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:31:44.333 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:31:44.336 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:31:44.337 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:31:44.337 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:31:44.406 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:31:44.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:44.482+0000 7f7d224bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:44.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:44.501+0000 7f7d224bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:44.544 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:31:44.544 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:31:44.544 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:31:44.544 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:31:44.544 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:31:44.544 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:31:44.544 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:31:44.544 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:31:44.544 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:31:44.545 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:31:44.545 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:31:44.545 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:31:44.553 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:31:44.554 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:31:44.554 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:31:44.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:44.572+0000 7f53b9991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:44.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:44.582+0000 7f53b3fff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:44.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:44.707+0000 7fc95446c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:44.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:44.719+0000 7fc95446c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:44.742 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:31:44.743 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:31:44.743 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:31:44.743 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:31:44.743 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:31:44.743 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:31:44.743 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:31:44.743 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:31:44.743 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:31:44.743 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:31:44.743 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:31:44.743 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:31:44.746 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:31:44.747 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:31:44.747 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:31:44.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:44.923+0000 7f2fffb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:44.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:44.934+0000 7f2fffb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:45.004 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:31:45.005 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:31:45.005 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:31:45.005 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:31:45.005 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:31:45.005 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:31:45.005 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:31:45.005 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:31:45.005 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:31:45.005 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:31:45.005 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:31:45.005 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:31:45.008 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:31:45.008 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:31:47.454 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:31:47.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:47.587+0000 7f2aa9aac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:47.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:47.596+0000 7f2aa9aac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:49.841 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Removed 17775 objects 2024-09-15T12:31:49.842 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Clean up completed and total clean up time :98.786 2024-09-15T12:31:50.009 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:31:50.009 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:31:50.009 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:31:50.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:50.113+0000 7fcc074a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:50.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:50.120+0000 7fcc074a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:50.232 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:31:50.307 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:31:50.308 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:31:50.320 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":479,"stamp":"2024-09-15T12:31:49.858986+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":92799563,"num_objects":1412,"num_object_clones":0,"num_object_copies":4236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":34225,"num_write_kb":1138709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34199,"ondisk_log_size":34199,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":518452,"kb_used_data":21040,"kb_used_omap":0,"kb_used_meta":497344,"kb_avail":376968908,"statfs":{"total":386547056640,"available":386016161792,"internally_reserved":0,"allocated":21544960,"data_stored":295025753,"data_compressed":13960280,"data_compressed_allocated":18378752,"data_compressed_original":293814272,"omap_allocated":0,"internal_metadata":509280256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-330956800,"num_objects":-5050,"num_object_clones":0,"num_object_copies":-15150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5050,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002497"},"pg_stats":[{"pgid":"6.f","version":"92'2150","reported_seq":2180,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:40.660602+0000","last_change":"2024-09-15T12:28:39.077376+0000","last_active":"2024-09-15T12:31:40.660602+0000","last_peered":"2024-09-15T12:31:40.660602+0000","last_clean":"2024-09-15T12:31:40.660602+0000","last_became_active":"2024-09-15T12:28:39.068998+0000","last_became_peered":"2024-09-15T12:28:39.068998+0000","last_unstale":"2024-09-15T12:31:40.660602+0000","last_undegraded":"2024-09-15T12:31:40.660602+0000","last_fullsized":"2024-09-15T12:31:40.660602+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":2150,"log_dups_size":0,"ondisk_log_size":2150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2150,"num_write_kb":71552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"92'2143","reported_seq":2173,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:40.641325+0000","last_change":"2024-09-15T12:28:39.087809+0000","last_active":"2024-09-15T12:31:40.641325+0000","last_peered":"2024-09-15T12:31:40.641325+0000","last_clean":"2024-09-15T12:31:40.641325+0000","last_became_active":"2024-09-15T12:28:39.074098+0000","last_became_peered":"2024-09-15T12:28:39.074098+0000","last_unstale":"2024-09-15T12:31:40.641325+0000","last_undegraded":"2024-09-15T12:31:40.641325+0000","last_fullsized":"2024-09-15T12:31:40.641325+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":2143,"log_dups_size":0,"ondisk_log_size":2143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2143,"num_write_kb":71744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"92'2205","reported_seq":2236,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:40.733814+0000","last_change":"2024-09-15T12:28:39.061230+0000","last_active":"2024-09-15T12:31:40.733814+0000","last_peered":"2024-09-15T12:31:40.733814+0000","last_clean":"2024-09-15T12:31:40.733814+0000","last_became_active":"2024-09-15T12:28:39.046625+0000","last_became_peered":"2024-09-15T12:28:39.046625+0000","last_unstale":"2024-09-15T12:31:40.733814+0000","last_undegraded":"2024-09-15T12:31:40.733814+0000","last_fullsized":"2024-09-15T12:31:40.733814+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":2205,"log_dups_size":0,"ondisk_log_size":2205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636120,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2205,"num_write_kb":73281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"92'2091","reported_seq":2121,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:41.635848+0000","last_change":"2024-09-15T12:28:39.043350+0000","last_active":"2024-09-15T12:31:41.635848+0000","last_peered":"2024-09-15T12:31:41.635848+0000","last_clean":"2024-09-15T12:31:41.635848+0000","last_became_active":"2024-09-15T12:28:39.034104+0000","last_became_peered":"2024-09-15T12:28:39.034104+0000","last_unstale":"2024-09-15T12:31:41.635848+0000","last_undegraded":"2024-09-15T12:31:41.635848+0000","last_fullsized":"2024-09-15T12:31:41.635848+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":2091,"log_dups_size":0,"ondisk_log_size":2091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570560,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2091,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"92'2215","reported_seq":2245,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:40.501733+0000","last_change":"2024-09-15T12:28:39.083865+0000","last_active":"2024-09-15T12:31:40.501733+0000","last_peered":"2024-09-15T12:31:40.501733+0000","last_clean":"2024-09-15T12:31:40.501733+0000","last_became_active":"2024-09-15T12:28:39.075263+0000","last_became_peered":"2024-09-15T12:28:39.075263+0000","last_unstale":"2024-09-15T12:31:40.501733+0000","last_undegraded":"2024-09-15T12:31:40.501733+0000","last_fullsized":"2024-09-15T12:31:40.501733+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":2215,"log_dups_size":0,"ondisk_log_size":2215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2215,"num_write_kb":73664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"92'2058","reported_seq":2088,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:40.493688+0000","last_change":"2024-09-15T12:28:39.031088+0000","last_active":"2024-09-15T12:31:40.493688+0000","last_peered":"2024-09-15T12:31:40.493688+0000","last_clean":"2024-09-15T12:31:40.493688+0000","last_became_active":"2024-09-15T12:28:39.025037+0000","last_became_peered":"2024-09-15T12:28:39.025037+0000","last_unstale":"2024-09-15T12:31:40.493688+0000","last_undegraded":"2024-09-15T12:31:40.493688+0000","last_fullsized":"2024-09-15T12:31:40.493688+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":2058,"log_dups_size":0,"ondisk_log_size":2058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2058,"num_write_kb":68544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"92'2141","reported_seq":2171,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:41.636540+0000","last_change":"2024-09-15T12:28:39.067539+0000","last_active":"2024-09-15T12:31:41.636540+0000","last_peered":"2024-09-15T12:31:41.636540+0000","last_clean":"2024-09-15T12:31:41.636540+0000","last_became_active":"2024-09-15T12:28:39.054389+0000","last_became_peered":"2024-09-15T12:28:39.054389+0000","last_unstale":"2024-09-15T12:31:41.636540+0000","last_undegraded":"2024-09-15T12:31:41.636540+0000","last_fullsized":"2024-09-15T12:31:41.636540+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":2141,"log_dups_size":0,"ondisk_log_size":2141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2141,"num_write_kb":71296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"92'2085","reported_seq":2115,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:40.745149+0000","last_change":"2024-09-15T12:28:38.993796+0000","last_active":"2024-09-15T12:31:40.745149+0000","last_peered":"2024-09-15T12:31:40.745149+0000","last_clean":"2024-09-15T12:31:40.745149+0000","last_became_active":"2024-09-15T12:28:38.987121+0000","last_became_peered":"2024-09-15T12:28:38.987121+0000","last_unstale":"2024-09-15T12:31:40.745149+0000","last_undegraded":"2024-09-15T12:31:40.745149+0000","last_fullsized":"2024-09-15T12:31:40.745149+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":2085,"log_dups_size":0,"ondisk_log_size":2085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2085,"num_write_kb":69760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"92'2124","reported_seq":2154,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:40.564709+0000","last_change":"2024-09-15T12:28:39.047799+0000","last_active":"2024-09-15T12:31:40.564709+0000","last_peered":"2024-09-15T12:31:40.564709+0000","last_clean":"2024-09-15T12:31:40.564709+0000","last_became_active":"2024-09-15T12:28:39.017997+0000","last_became_peered":"2024-09-15T12:28:39.017997+0000","last_unstale":"2024-09-15T12:31:40.564709+0000","last_undegraded":"2024-09-15T12:31:40.564709+0000","last_fullsized":"2024-09-15T12:31:40.564709+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":2124,"log_dups_size":0,"ondisk_log_size":2124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160384,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2124,"num_write_kb":70976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":319,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.347895+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:30:58.347895+0000","last_peered":"2024-09-15T12:30:58.347895+0000","last_clean":"2024-09-15T12:30:58.347895+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:30:58.347895+0000","last_undegraded":"2024-09-15T12:30:58.347895+0000","last_fullsized":"2024-09-15T12:30:58.347895+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":248,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.357144+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:30:58.357144+0000","last_peered":"2024-09-15T12:30:58.357144+0000","last_clean":"2024-09-15T12:30:58.357144+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:30:58.357144+0000","last_undegraded":"2024-09-15T12:30:58.357144+0000","last_fullsized":"2024-09-15T12:30:58.357144+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"92'2103","reported_seq":2133,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:41.736488+0000","last_change":"2024-09-15T12:28:39.071985+0000","last_active":"2024-09-15T12:31:41.736488+0000","last_peered":"2024-09-15T12:31:41.736488+0000","last_clean":"2024-09-15T12:31:41.736488+0000","last_became_active":"2024-09-15T12:28:39.061062+0000","last_became_peered":"2024-09-15T12:28:39.061062+0000","last_unstale":"2024-09-15T12:31:41.736488+0000","last_undegraded":"2024-09-15T12:31:41.736488+0000","last_fullsized":"2024-09-15T12:31:41.736488+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":2103,"log_dups_size":0,"ondisk_log_size":2103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2103,"num_write_kb":69696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.364558+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:30:58.364558+0000","last_peered":"2024-09-15T12:30:58.364558+0000","last_clean":"2024-09-15T12:30:58.364558+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:30:58.364558+0000","last_undegraded":"2024-09-15T12:30:58.364558+0000","last_fullsized":"2024-09-15T12:30:58.364558+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"92'2162","reported_seq":2192,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:40.437409+0000","last_change":"2024-09-15T12:28:39.025429+0000","last_active":"2024-09-15T12:31:40.437409+0000","last_peered":"2024-09-15T12:31:40.437409+0000","last_clean":"2024-09-15T12:31:40.437409+0000","last_became_active":"2024-09-15T12:28:39.007673+0000","last_became_peered":"2024-09-15T12:28:39.007673+0000","last_unstale":"2024-09-15T12:31:40.437409+0000","last_undegraded":"2024-09-15T12:31:40.437409+0000","last_fullsized":"2024-09-15T12:31:40.437409+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":2162,"log_dups_size":0,"ondisk_log_size":2162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2162,"num_write_kb":71936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.339624+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:30:58.339624+0000","last_peered":"2024-09-15T12:30:58.339624+0000","last_clean":"2024-09-15T12:30:58.339624+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:30:58.339624+0000","last_undegraded":"2024-09-15T12:30:58.339624+0000","last_fullsized":"2024-09-15T12:30:58.339624+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"92'2128","reported_seq":2158,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:41.680310+0000","last_change":"2024-09-15T12:28:39.029713+0000","last_active":"2024-09-15T12:31:41.680310+0000","last_peered":"2024-09-15T12:31:41.680310+0000","last_clean":"2024-09-15T12:31:41.680310+0000","last_became_active":"2024-09-15T12:28:39.020975+0000","last_became_peered":"2024-09-15T12:28:39.020975+0000","last_unstale":"2024-09-15T12:31:41.680310+0000","last_undegraded":"2024-09-15T12:31:41.680310+0000","last_fullsized":"2024-09-15T12:31:41.680310+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":2128,"log_dups_size":0,"ondisk_log_size":2128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2128,"num_write_kb":70848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":249,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.357439+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:30:58.357439+0000","last_peered":"2024-09-15T12:30:58.357439+0000","last_clean":"2024-09-15T12:30:58.357439+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:30:58.357439+0000","last_undegraded":"2024-09-15T12:30:58.357439+0000","last_fullsized":"2024-09-15T12:30:58.357439+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"92'2075","reported_seq":2105,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:40.748794+0000","last_change":"2024-09-15T12:28:39.023135+0000","last_active":"2024-09-15T12:31:40.748794+0000","last_peered":"2024-09-15T12:31:40.748794+0000","last_clean":"2024-09-15T12:31:40.748794+0000","last_became_active":"2024-09-15T12:28:39.014305+0000","last_became_peered":"2024-09-15T12:28:39.014305+0000","last_unstale":"2024-09-15T12:31:40.748794+0000","last_undegraded":"2024-09-15T12:31:40.748794+0000","last_fullsized":"2024-09-15T12:31:40.748794+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":2075,"log_dups_size":0,"ondisk_log_size":2075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2075,"num_write_kb":69440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.341995+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:30:58.341995+0000","last_peered":"2024-09-15T12:30:58.341995+0000","last_clean":"2024-09-15T12:30:58.341995+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:30:58.341995+0000","last_undegraded":"2024-09-15T12:30:58.341995+0000","last_fullsized":"2024-09-15T12:30:58.341995+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"92'2245","reported_seq":2275,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:40.718997+0000","last_change":"2024-09-15T12:28:39.054857+0000","last_active":"2024-09-15T12:31:40.718997+0000","last_peered":"2024-09-15T12:31:40.718997+0000","last_clean":"2024-09-15T12:31:40.718997+0000","last_became_active":"2024-09-15T12:28:39.046395+0000","last_became_peered":"2024-09-15T12:28:39.046395+0000","last_unstale":"2024-09-15T12:31:40.718997+0000","last_undegraded":"2024-09-15T12:31:40.718997+0000","last_fullsized":"2024-09-15T12:31:40.718997+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":2245,"log_dups_size":0,"ondisk_log_size":2245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570560,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2245,"num_write_kb":74560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.353747+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:30:58.353747+0000","last_peered":"2024-09-15T12:30:58.353747+0000","last_clean":"2024-09-15T12:30:58.353747+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:30:58.353747+0000","last_undegraded":"2024-09-15T12:30:58.353747+0000","last_fullsized":"2024-09-15T12:30:58.353747+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"92'2225","reported_seq":2255,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:40.704477+0000","last_change":"2024-09-15T12:28:39.052760+0000","last_active":"2024-09-15T12:31:40.704477+0000","last_peered":"2024-09-15T12:31:40.704477+0000","last_clean":"2024-09-15T12:31:40.704477+0000","last_became_active":"2024-09-15T12:28:39.041365+0000","last_became_peered":"2024-09-15T12:28:39.041365+0000","last_unstale":"2024-09-15T12:31:40.704477+0000","last_undegraded":"2024-09-15T12:31:40.704477+0000","last_fullsized":"2024-09-15T12:31:40.704477+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":2225,"log_dups_size":0,"ondisk_log_size":2225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2225,"num_write_kb":73984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.328638+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:30:58.328638+0000","last_peered":"2024-09-15T12:30:58.328638+0000","last_clean":"2024-09-15T12:30:58.328638+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:30:58.328638+0000","last_undegraded":"2024-09-15T12:30:58.328638+0000","last_fullsized":"2024-09-15T12:30:58.328638+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"92'1994","reported_seq":2024,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:40.472566+0000","last_change":"2024-09-15T12:28:39.046988+0000","last_active":"2024-09-15T12:31:40.472566+0000","last_peered":"2024-09-15T12:31:40.472566+0000","last_clean":"2024-09-15T12:31:40.472566+0000","last_became_active":"2024-09-15T12:28:39.017167+0000","last_became_peered":"2024-09-15T12:28:39.017167+0000","last_unstale":"2024-09-15T12:31:40.472566+0000","last_undegraded":"2024-09-15T12:31:40.472566+0000","last_fullsized":"2024-09-15T12:31:40.472566+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1994,"log_dups_size":0,"ondisk_log_size":1994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1994,"num_write_kb":66688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.354596+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:30:58.354596+0000","last_peered":"2024-09-15T12:30:58.354596+0000","last_clean":"2024-09-15T12:30:58.354596+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:30:58.354596+0000","last_undegraded":"2024-09-15T12:30:58.354596+0000","last_fullsized":"2024-09-15T12:30:58.354596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":92209176,"num_objects":1408,"num_object_clones":0,"num_object_copies":4224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":34144,"num_write_kb":1137601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17342464,"data_stored":277282888,"data_compressed":13166872,"data_compressed_allocated":17330176,"data_compressed_original":277282816,"omap_allocated":0,"internal_metadata":0},"log_size":34144,"ondisk_log_size":34144,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673738,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":121552,"kb_used_data":4480,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94250288,"statfs":{"total":96636764160,"available":96512294912,"internally_reserved":0,"allocated":4587520,"data_stored":60911510,"data_compressed":2880624,"data_compressed_allocated":3792896,"data_compressed_original":60604416,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706442,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":134484,"kb_used_data":4932,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94237356,"statfs":{"total":96636764160,"available":96499052544,"internally_reserved":0,"allocated":5050368,"data_stored":68317073,"data_compressed":3232280,"data_compressed_allocated":4255744,"data_compressed_original":68009984,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706442,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":126828,"kb_used_data":5596,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94245012,"statfs":{"total":96636764160,"available":96506892288,"internally_reserved":0,"allocated":5730304,"data_stored":79523209,"data_compressed":3762408,"data_compressed_allocated":4952064,"data_compressed_original":79233024,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706441,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":135588,"kb_used_data":6032,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94236252,"statfs":{"total":96636764160,"available":96497922048,"internally_reserved":0,"allocated":6176768,"data_stored":86273961,"data_compressed":4084968,"data_compressed_allocated":5378048,"data_compressed_original":85966848,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4800512,"data_stored":76742680,"data_compressed":3644152,"data_compressed_allocated":4796416,"data_compressed_original":76742656,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4820992,"data_stored":77070360,"data_compressed":3659712,"data_compressed_allocated":4816896,"data_compressed_original":77070336,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4087808,"data_stored":65404928,"data_compressed":3105776,"data_compressed_allocated":4087808,"data_compressed_original":65404928,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3633152,"data_stored":58064920,"data_compressed":2757232,"data_compressed_allocated":3629056,"data_compressed_original":58064896,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:31:50.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:50.336+0000 7f78c0111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:50.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:50.341+0000 7f78c0111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:52.445 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:31:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:52.558+0000 7fe000791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:52.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:52.563+0000 7fe000791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:54.670 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:31:54.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:54.787+0000 7f7fda24f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:54.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:54.792+0000 7f7fda24f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:55.200 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_3 2024-09-15T12:31:55.200 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_3 unique_pool_3 --yes-i-really-really-mean-it 2024-09-15T12:31:55.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:55.304+0000 7f5f84d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:55.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:55.317+0000 7f5f84d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:55.322 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:31:55.322 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:31:55.322 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:31:55.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:55.426+0000 7f05bf591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:55.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:55.434+0000 7f05bf591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:55.623 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:31:55.623 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:31:55.636 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":481,"stamp":"2024-09-15T12:31:53.859911+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":92799563,"num_objects":1412,"num_object_clones":0,"num_object_copies":4236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":34225,"num_write_kb":1138709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34199,"ondisk_log_size":34199,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":518452,"kb_used_data":21040,"kb_used_omap":0,"kb_used_meta":497344,"kb_avail":376968908,"statfs":{"total":386547056640,"available":386016161792,"internally_reserved":0,"allocated":21544960,"data_stored":295025753,"data_compressed":13960280,"data_compressed_allocated":18378752,"data_compressed_original":293814272,"omap_allocated":0,"internal_metadata":509280256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002668"},"pg_stats":[{"pgid":"6.f","version":"92'2150","reported_seq":2180,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:40.660602+0000","last_change":"2024-09-15T12:28:39.077376+0000","last_active":"2024-09-15T12:31:40.660602+0000","last_peered":"2024-09-15T12:31:40.660602+0000","last_clean":"2024-09-15T12:31:40.660602+0000","last_became_active":"2024-09-15T12:28:39.068998+0000","last_became_peered":"2024-09-15T12:28:39.068998+0000","last_unstale":"2024-09-15T12:31:40.660602+0000","last_undegraded":"2024-09-15T12:31:40.660602+0000","last_fullsized":"2024-09-15T12:31:40.660602+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":2150,"log_dups_size":0,"ondisk_log_size":2150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2150,"num_write_kb":71552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"92'2143","reported_seq":2173,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:40.641325+0000","last_change":"2024-09-15T12:28:39.087809+0000","last_active":"2024-09-15T12:31:40.641325+0000","last_peered":"2024-09-15T12:31:40.641325+0000","last_clean":"2024-09-15T12:31:40.641325+0000","last_became_active":"2024-09-15T12:28:39.074098+0000","last_became_peered":"2024-09-15T12:28:39.074098+0000","last_unstale":"2024-09-15T12:31:40.641325+0000","last_undegraded":"2024-09-15T12:31:40.641325+0000","last_fullsized":"2024-09-15T12:31:40.641325+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":2143,"log_dups_size":0,"ondisk_log_size":2143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2143,"num_write_kb":71744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"92'2205","reported_seq":2236,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:40.733814+0000","last_change":"2024-09-15T12:28:39.061230+0000","last_active":"2024-09-15T12:31:40.733814+0000","last_peered":"2024-09-15T12:31:40.733814+0000","last_clean":"2024-09-15T12:31:40.733814+0000","last_became_active":"2024-09-15T12:28:39.046625+0000","last_became_peered":"2024-09-15T12:28:39.046625+0000","last_unstale":"2024-09-15T12:31:40.733814+0000","last_undegraded":"2024-09-15T12:31:40.733814+0000","last_fullsized":"2024-09-15T12:31:40.733814+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":2205,"log_dups_size":0,"ondisk_log_size":2205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636120,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2205,"num_write_kb":73281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"92'2091","reported_seq":2121,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:41.635848+0000","last_change":"2024-09-15T12:28:39.043350+0000","last_active":"2024-09-15T12:31:41.635848+0000","last_peered":"2024-09-15T12:31:41.635848+0000","last_clean":"2024-09-15T12:31:41.635848+0000","last_became_active":"2024-09-15T12:28:39.034104+0000","last_became_peered":"2024-09-15T12:28:39.034104+0000","last_unstale":"2024-09-15T12:31:41.635848+0000","last_undegraded":"2024-09-15T12:31:41.635848+0000","last_fullsized":"2024-09-15T12:31:41.635848+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":2091,"log_dups_size":0,"ondisk_log_size":2091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570560,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2091,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"92'2215","reported_seq":2245,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:40.501733+0000","last_change":"2024-09-15T12:28:39.083865+0000","last_active":"2024-09-15T12:31:40.501733+0000","last_peered":"2024-09-15T12:31:40.501733+0000","last_clean":"2024-09-15T12:31:40.501733+0000","last_became_active":"2024-09-15T12:28:39.075263+0000","last_became_peered":"2024-09-15T12:28:39.075263+0000","last_unstale":"2024-09-15T12:31:40.501733+0000","last_undegraded":"2024-09-15T12:31:40.501733+0000","last_fullsized":"2024-09-15T12:31:40.501733+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":2215,"log_dups_size":0,"ondisk_log_size":2215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2215,"num_write_kb":73664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"92'2058","reported_seq":2088,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:40.493688+0000","last_change":"2024-09-15T12:28:39.031088+0000","last_active":"2024-09-15T12:31:40.493688+0000","last_peered":"2024-09-15T12:31:40.493688+0000","last_clean":"2024-09-15T12:31:40.493688+0000","last_became_active":"2024-09-15T12:28:39.025037+0000","last_became_peered":"2024-09-15T12:28:39.025037+0000","last_unstale":"2024-09-15T12:31:40.493688+0000","last_undegraded":"2024-09-15T12:31:40.493688+0000","last_fullsized":"2024-09-15T12:31:40.493688+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":2058,"log_dups_size":0,"ondisk_log_size":2058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2058,"num_write_kb":68544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"92'2141","reported_seq":2171,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:41.636540+0000","last_change":"2024-09-15T12:28:39.067539+0000","last_active":"2024-09-15T12:31:41.636540+0000","last_peered":"2024-09-15T12:31:41.636540+0000","last_clean":"2024-09-15T12:31:41.636540+0000","last_became_active":"2024-09-15T12:28:39.054389+0000","last_became_peered":"2024-09-15T12:28:39.054389+0000","last_unstale":"2024-09-15T12:31:41.636540+0000","last_undegraded":"2024-09-15T12:31:41.636540+0000","last_fullsized":"2024-09-15T12:31:41.636540+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":2141,"log_dups_size":0,"ondisk_log_size":2141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2141,"num_write_kb":71296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.8","version":"92'2085","reported_seq":2115,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:40.745149+0000","last_change":"2024-09-15T12:28:38.993796+0000","last_active":"2024-09-15T12:31:40.745149+0000","last_peered":"2024-09-15T12:31:40.745149+0000","last_clean":"2024-09-15T12:31:40.745149+0000","last_became_active":"2024-09-15T12:28:38.987121+0000","last_became_peered":"2024-09-15T12:28:38.987121+0000","last_unstale":"2024-09-15T12:31:40.745149+0000","last_undegraded":"2024-09-15T12:31:40.745149+0000","last_fullsized":"2024-09-15T12:31:40.745149+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":2085,"log_dups_size":0,"ondisk_log_size":2085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2085,"num_write_kb":69760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"92'2124","reported_seq":2154,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:40.564709+0000","last_change":"2024-09-15T12:28:39.047799+0000","last_active":"2024-09-15T12:31:40.564709+0000","last_peered":"2024-09-15T12:31:40.564709+0000","last_clean":"2024-09-15T12:31:40.564709+0000","last_became_active":"2024-09-15T12:28:39.017997+0000","last_became_peered":"2024-09-15T12:28:39.017997+0000","last_unstale":"2024-09-15T12:31:40.564709+0000","last_undegraded":"2024-09-15T12:31:40.564709+0000","last_fullsized":"2024-09-15T12:31:40.564709+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":2124,"log_dups_size":0,"ondisk_log_size":2124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6160384,"num_objects":94,"num_object_clones":0,"num_object_copies":282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2124,"num_write_kb":70976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":319,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.347895+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:30:58.347895+0000","last_peered":"2024-09-15T12:30:58.347895+0000","last_clean":"2024-09-15T12:30:58.347895+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:30:58.347895+0000","last_undegraded":"2024-09-15T12:30:58.347895+0000","last_fullsized":"2024-09-15T12:30:58.347895+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":248,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.357144+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:30:58.357144+0000","last_peered":"2024-09-15T12:30:58.357144+0000","last_clean":"2024-09-15T12:30:58.357144+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:30:58.357144+0000","last_undegraded":"2024-09-15T12:30:58.357144+0000","last_fullsized":"2024-09-15T12:30:58.357144+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"92'2103","reported_seq":2133,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:41.736488+0000","last_change":"2024-09-15T12:28:39.071985+0000","last_active":"2024-09-15T12:31:41.736488+0000","last_peered":"2024-09-15T12:31:41.736488+0000","last_clean":"2024-09-15T12:31:41.736488+0000","last_became_active":"2024-09-15T12:28:39.061062+0000","last_became_peered":"2024-09-15T12:28:39.061062+0000","last_unstale":"2024-09-15T12:31:41.736488+0000","last_undegraded":"2024-09-15T12:31:41.736488+0000","last_fullsized":"2024-09-15T12:31:41.736488+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":2103,"log_dups_size":0,"ondisk_log_size":2103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4915200,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2103,"num_write_kb":69696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.364558+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:30:58.364558+0000","last_peered":"2024-09-15T12:30:58.364558+0000","last_clean":"2024-09-15T12:30:58.364558+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:30:58.364558+0000","last_undegraded":"2024-09-15T12:30:58.364558+0000","last_fullsized":"2024-09-15T12:30:58.364558+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"92'2162","reported_seq":2192,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:40.437409+0000","last_change":"2024-09-15T12:28:39.025429+0000","last_active":"2024-09-15T12:31:40.437409+0000","last_peered":"2024-09-15T12:31:40.437409+0000","last_clean":"2024-09-15T12:31:40.437409+0000","last_became_active":"2024-09-15T12:28:39.007673+0000","last_became_peered":"2024-09-15T12:28:39.007673+0000","last_unstale":"2024-09-15T12:31:40.437409+0000","last_undegraded":"2024-09-15T12:31:40.437409+0000","last_fullsized":"2024-09-15T12:31:40.437409+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":2162,"log_dups_size":0,"ondisk_log_size":2162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2162,"num_write_kb":71936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.339624+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:30:58.339624+0000","last_peered":"2024-09-15T12:30:58.339624+0000","last_clean":"2024-09-15T12:30:58.339624+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:30:58.339624+0000","last_undegraded":"2024-09-15T12:30:58.339624+0000","last_fullsized":"2024-09-15T12:30:58.339624+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"92'2128","reported_seq":2158,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:41.680310+0000","last_change":"2024-09-15T12:28:39.029713+0000","last_active":"2024-09-15T12:31:41.680310+0000","last_peered":"2024-09-15T12:31:41.680310+0000","last_clean":"2024-09-15T12:31:41.680310+0000","last_became_active":"2024-09-15T12:28:39.020975+0000","last_became_peered":"2024-09-15T12:28:39.020975+0000","last_unstale":"2024-09-15T12:31:41.680310+0000","last_undegraded":"2024-09-15T12:31:41.680310+0000","last_fullsized":"2024-09-15T12:31:41.680310+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":2128,"log_dups_size":0,"ondisk_log_size":2128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5636096,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2128,"num_write_kb":70848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":249,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.357439+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:30:58.357439+0000","last_peered":"2024-09-15T12:30:58.357439+0000","last_clean":"2024-09-15T12:30:58.357439+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:30:58.357439+0000","last_undegraded":"2024-09-15T12:30:58.357439+0000","last_fullsized":"2024-09-15T12:30:58.357439+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"92'2075","reported_seq":2105,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:40.748794+0000","last_change":"2024-09-15T12:28:39.023135+0000","last_active":"2024-09-15T12:31:40.748794+0000","last_peered":"2024-09-15T12:31:40.748794+0000","last_clean":"2024-09-15T12:31:40.748794+0000","last_became_active":"2024-09-15T12:28:39.014305+0000","last_became_peered":"2024-09-15T12:28:39.014305+0000","last_unstale":"2024-09-15T12:31:40.748794+0000","last_undegraded":"2024-09-15T12:31:40.748794+0000","last_fullsized":"2024-09-15T12:31:40.748794+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":2075,"log_dups_size":0,"ondisk_log_size":2075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6225920,"num_objects":95,"num_object_clones":0,"num_object_copies":285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2075,"num_write_kb":69440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.341995+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:30:58.341995+0000","last_peered":"2024-09-15T12:30:58.341995+0000","last_clean":"2024-09-15T12:30:58.341995+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:30:58.341995+0000","last_undegraded":"2024-09-15T12:30:58.341995+0000","last_fullsized":"2024-09-15T12:30:58.341995+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1","version":"92'2245","reported_seq":2275,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:40.718997+0000","last_change":"2024-09-15T12:28:39.054857+0000","last_active":"2024-09-15T12:31:40.718997+0000","last_peered":"2024-09-15T12:31:40.718997+0000","last_clean":"2024-09-15T12:31:40.718997+0000","last_became_active":"2024-09-15T12:28:39.046395+0000","last_became_peered":"2024-09-15T12:28:39.046395+0000","last_unstale":"2024-09-15T12:31:40.718997+0000","last_undegraded":"2024-09-15T12:31:40.718997+0000","last_fullsized":"2024-09-15T12:31:40.718997+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":2245,"log_dups_size":0,"ondisk_log_size":2245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570560,"num_objects":85,"num_object_clones":0,"num_object_copies":255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2245,"num_write_kb":74560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.353747+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:30:58.353747+0000","last_peered":"2024-09-15T12:30:58.353747+0000","last_clean":"2024-09-15T12:30:58.353747+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:30:58.353747+0000","last_undegraded":"2024-09-15T12:30:58.353747+0000","last_fullsized":"2024-09-15T12:30:58.353747+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"92'2225","reported_seq":2255,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:40.704477+0000","last_change":"2024-09-15T12:28:39.052760+0000","last_active":"2024-09-15T12:31:40.704477+0000","last_peered":"2024-09-15T12:31:40.704477+0000","last_clean":"2024-09-15T12:31:40.704477+0000","last_became_active":"2024-09-15T12:28:39.041365+0000","last_became_peered":"2024-09-15T12:28:39.041365+0000","last_unstale":"2024-09-15T12:31:40.704477+0000","last_undegraded":"2024-09-15T12:31:40.704477+0000","last_fullsized":"2024-09-15T12:31:40.704477+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":2225,"log_dups_size":0,"ondisk_log_size":2225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701632,"num_objects":87,"num_object_clones":0,"num_object_copies":261,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2225,"num_write_kb":73984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.328638+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:30:58.328638+0000","last_peered":"2024-09-15T12:30:58.328638+0000","last_clean":"2024-09-15T12:30:58.328638+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:30:58.328638+0000","last_undegraded":"2024-09-15T12:30:58.328638+0000","last_fullsized":"2024-09-15T12:30:58.328638+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"92'1994","reported_seq":2024,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:31:40.472566+0000","last_change":"2024-09-15T12:28:39.046988+0000","last_active":"2024-09-15T12:31:40.472566+0000","last_peered":"2024-09-15T12:31:40.472566+0000","last_clean":"2024-09-15T12:31:40.472566+0000","last_became_active":"2024-09-15T12:28:39.017167+0000","last_became_peered":"2024-09-15T12:28:39.017167+0000","last_unstale":"2024-09-15T12:31:40.472566+0000","last_undegraded":"2024-09-15T12:31:40.472566+0000","last_fullsized":"2024-09-15T12:31:40.472566+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:28:37.878584+0000","last_clean_scrub_stamp":"2024-09-15T12:28:37.878584+0000","objects_scrubbed":0,"log_size":1994,"log_dups_size":0,"ondisk_log_size":1994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1994,"num_write_kb":66688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.354596+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:30:58.354596+0000","last_peered":"2024-09-15T12:30:58.354596+0000","last_clean":"2024-09-15T12:30:58.354596+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:30:58.354596+0000","last_undegraded":"2024-09-15T12:30:58.354596+0000","last_fullsized":"2024-09-15T12:30:58.354596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":16,"stat_sum":{"num_bytes":92209176,"num_objects":1408,"num_object_clones":0,"num_object_copies":4224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":34144,"num_write_kb":1137601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":17342464,"data_stored":277282888,"data_compressed":13166872,"data_compressed_allocated":17330176,"data_compressed_original":277282816,"omap_allocated":0,"internal_metadata":0},"log_size":34144,"ondisk_log_size":34144,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673738,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":121552,"kb_used_data":4480,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94250288,"statfs":{"total":96636764160,"available":96512294912,"internally_reserved":0,"allocated":4587520,"data_stored":60911510,"data_compressed":2880624,"data_compressed_allocated":3792896,"data_compressed_original":60604416,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706442,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":134484,"kb_used_data":4932,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94237356,"statfs":{"total":96636764160,"available":96499052544,"internally_reserved":0,"allocated":5050368,"data_stored":68317073,"data_compressed":3232280,"data_compressed_allocated":4255744,"data_compressed_original":68009984,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706442,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":126828,"kb_used_data":5596,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94245012,"statfs":{"total":96636764160,"available":96506892288,"internally_reserved":0,"allocated":5730304,"data_stored":79523209,"data_compressed":3762408,"data_compressed_allocated":4952064,"data_compressed_original":79233024,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706441,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":135588,"kb_used_data":6032,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94236252,"statfs":{"total":96636764160,"available":96497922048,"internally_reserved":0,"allocated":6176768,"data_stored":86273961,"data_compressed":4084968,"data_compressed_allocated":5378048,"data_compressed_original":85966848,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4800512,"data_stored":76742680,"data_compressed":3644152,"data_compressed_allocated":4796416,"data_compressed_original":76742656,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4820992,"data_stored":77070360,"data_compressed":3659712,"data_compressed_allocated":4816896,"data_compressed_original":77070336,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4087808,"data_stored":65404928,"data_compressed":3105776,"data_compressed_allocated":4087808,"data_compressed_original":65404928,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":3633152,"data_stored":58064920,"data_compressed":2757232,"data_compressed_allocated":3629056,"data_compressed_original":58064896,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:31:56.333 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'unique_pool_3' removed 2024-09-15T12:31:56.353 INFO:teuthology.task.full_sequential:In full_sequential, running task radosbench... 2024-09-15T12:31:56.354 INFO:tasks.radosbench:Beginning radosbench... 2024-09-15T12:31:56.355 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_4 2024-09-15T12:31:56.355 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_4 16 2024-09-15T12:31:56.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:56.510+0000 7f4e614bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:56.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:56.524+0000 7f4e614bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:56.899 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:31:57.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:57.037+0000 7fb07e04f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:57.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:57.044+0000 7fb07e04f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:57.335 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'unique_pool_4' created 2024-09-15T12:31:57.355 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_4 rados --yes-i-really-mean-it || true 2024-09-15T12:31:57.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:57.474+0000 7f9af36c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:57.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:57.490+0000 7f9af36c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:58.342 INFO:teuthology.orchestra.run.smithi077.stderr:enabled application 'rados' on pool 'unique_pool_4' 2024-09-15T12:31:59.280 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:31:59.369 DEBUG:teuthology.orchestra.run.smithi077:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_4 bench 90 write' 2024-09-15T12:31:59.372 INFO:tasks.radosbench:joining radosbench (timing out after 3000s) 2024-09-15T12:31:59.372 INFO:teuthology.orchestra.run:waiting for 3000 2024-09-15T12:31:59.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:59.394+0000 7f30472e3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:59.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:31:59.400+0000 7f30472e3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:31:59.438 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:hints = 1 2024-09-15T12:31:59.438 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 90 seconds or 0 objects 2024-09-15T12:31:59.438 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Object prefix: benchmark_data_smithi077_61512 2024-09-15T12:31:59.439 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-15T12:31:59.439 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 0 0 0 0 0 0 - 0 2024-09-15T12:32:00.439 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 1 16 180 164 10.2495 10.25 0.126416 0.0909783 2024-09-15T12:32:00.637 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:32:00.638 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:32:00.638 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:32:00.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:00.771+0000 7f68adb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:00.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:00.781+0000 7f68adb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:01.030 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:32:01.031 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:32:01.049 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":488,"stamp":"2024-09-15T12:31:59.861341+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":518452,"kb_used_data":21040,"kb_used_omap":0,"kb_used_meta":497344,"kb_avail":376968908,"statfs":{"total":386547056640,"available":386016161792,"internally_reserved":0,"allocated":21544960,"data_stored":295025753,"data_compressed":13960280,"data_compressed_allocated":18378752,"data_compressed_original":293814272,"omap_allocated":0,"internal_metadata":509280256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-92209176,"num_objects":-1408,"num_object_clones":0,"num_object_copies":-4224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-34144,"num_write_kb":-1137601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000979"},"pg_stats":[{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:31:57.333072+0000","last_change":"2024-09-15T12:31:57.333072+0000","last_active":"2024-09-15T12:31:57.333072+0000","last_peered":"2024-09-15T12:31:57.333072+0000","last_clean":"2024-09-15T12:31:57.333072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:31:57.333072+0000","last_undegraded":"2024-09-15T12:31:57.333072+0000","last_fullsized":"2024-09-15T12:31:57.333072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:31:57.333072+0000","last_change":"2024-09-15T12:31:57.333072+0000","last_active":"2024-09-15T12:31:57.333072+0000","last_peered":"2024-09-15T12:31:57.333072+0000","last_clean":"2024-09-15T12:31:57.333072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:31:57.333072+0000","last_undegraded":"2024-09-15T12:31:57.333072+0000","last_fullsized":"2024-09-15T12:31:57.333072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:31:57.333072+0000","last_change":"2024-09-15T12:31:57.333072+0000","last_active":"2024-09-15T12:31:57.333072+0000","last_peered":"2024-09-15T12:31:57.333072+0000","last_clean":"2024-09-15T12:31:57.333072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:31:57.333072+0000","last_undegraded":"2024-09-15T12:31:57.333072+0000","last_fullsized":"2024-09-15T12:31:57.333072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:31:57.333072+0000","last_change":"2024-09-15T12:31:57.333072+0000","last_active":"2024-09-15T12:31:57.333072+0000","last_peered":"2024-09-15T12:31:57.333072+0000","last_clean":"2024-09-15T12:31:57.333072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:31:57.333072+0000","last_undegraded":"2024-09-15T12:31:57.333072+0000","last_fullsized":"2024-09-15T12:31:57.333072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:31:57.333072+0000","last_change":"2024-09-15T12:31:57.333072+0000","last_active":"2024-09-15T12:31:57.333072+0000","last_peered":"2024-09-15T12:31:57.333072+0000","last_clean":"2024-09-15T12:31:57.333072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:31:57.333072+0000","last_undegraded":"2024-09-15T12:31:57.333072+0000","last_fullsized":"2024-09-15T12:31:57.333072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:31:57.333072+0000","last_change":"2024-09-15T12:31:57.333072+0000","last_active":"2024-09-15T12:31:57.333072+0000","last_peered":"2024-09-15T12:31:57.333072+0000","last_clean":"2024-09-15T12:31:57.333072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:31:57.333072+0000","last_undegraded":"2024-09-15T12:31:57.333072+0000","last_fullsized":"2024-09-15T12:31:57.333072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:31:57.333072+0000","last_change":"2024-09-15T12:31:57.333072+0000","last_active":"2024-09-15T12:31:57.333072+0000","last_peered":"2024-09-15T12:31:57.333072+0000","last_clean":"2024-09-15T12:31:57.333072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:31:57.333072+0000","last_undegraded":"2024-09-15T12:31:57.333072+0000","last_fullsized":"2024-09-15T12:31:57.333072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:31:57.333072+0000","last_change":"2024-09-15T12:31:57.333072+0000","last_active":"2024-09-15T12:31:57.333072+0000","last_peered":"2024-09-15T12:31:57.333072+0000","last_clean":"2024-09-15T12:31:57.333072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:31:57.333072+0000","last_undegraded":"2024-09-15T12:31:57.333072+0000","last_fullsized":"2024-09-15T12:31:57.333072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:31:57.333072+0000","last_change":"2024-09-15T12:31:57.333072+0000","last_active":"2024-09-15T12:31:57.333072+0000","last_peered":"2024-09-15T12:31:57.333072+0000","last_clean":"2024-09-15T12:31:57.333072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:31:57.333072+0000","last_undegraded":"2024-09-15T12:31:57.333072+0000","last_fullsized":"2024-09-15T12:31:57.333072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":319,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.347895+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:30:58.347895+0000","last_peered":"2024-09-15T12:30:58.347895+0000","last_clean":"2024-09-15T12:30:58.347895+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:30:58.347895+0000","last_undegraded":"2024-09-15T12:30:58.347895+0000","last_fullsized":"2024-09-15T12:30:58.347895+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":248,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.357144+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:30:58.357144+0000","last_peered":"2024-09-15T12:30:58.357144+0000","last_clean":"2024-09-15T12:30:58.357144+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:30:58.357144+0000","last_undegraded":"2024-09-15T12:30:58.357144+0000","last_fullsized":"2024-09-15T12:30:58.357144+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:31:57.333072+0000","last_change":"2024-09-15T12:31:57.333072+0000","last_active":"2024-09-15T12:31:57.333072+0000","last_peered":"2024-09-15T12:31:57.333072+0000","last_clean":"2024-09-15T12:31:57.333072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:31:57.333072+0000","last_undegraded":"2024-09-15T12:31:57.333072+0000","last_fullsized":"2024-09-15T12:31:57.333072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.364558+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:30:58.364558+0000","last_peered":"2024-09-15T12:30:58.364558+0000","last_clean":"2024-09-15T12:30:58.364558+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:30:58.364558+0000","last_undegraded":"2024-09-15T12:30:58.364558+0000","last_fullsized":"2024-09-15T12:30:58.364558+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:31:57.333072+0000","last_change":"2024-09-15T12:31:57.333072+0000","last_active":"2024-09-15T12:31:57.333072+0000","last_peered":"2024-09-15T12:31:57.333072+0000","last_clean":"2024-09-15T12:31:57.333072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:31:57.333072+0000","last_undegraded":"2024-09-15T12:31:57.333072+0000","last_fullsized":"2024-09-15T12:31:57.333072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.339624+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:30:58.339624+0000","last_peered":"2024-09-15T12:30:58.339624+0000","last_clean":"2024-09-15T12:30:58.339624+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:30:58.339624+0000","last_undegraded":"2024-09-15T12:30:58.339624+0000","last_fullsized":"2024-09-15T12:30:58.339624+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:31:57.333072+0000","last_change":"2024-09-15T12:31:57.333072+0000","last_active":"2024-09-15T12:31:57.333072+0000","last_peered":"2024-09-15T12:31:57.333072+0000","last_clean":"2024-09-15T12:31:57.333072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:31:57.333072+0000","last_undegraded":"2024-09-15T12:31:57.333072+0000","last_fullsized":"2024-09-15T12:31:57.333072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":249,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.357439+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:30:58.357439+0000","last_peered":"2024-09-15T12:30:58.357439+0000","last_clean":"2024-09-15T12:30:58.357439+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:30:58.357439+0000","last_undegraded":"2024-09-15T12:30:58.357439+0000","last_fullsized":"2024-09-15T12:30:58.357439+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:31:57.333072+0000","last_change":"2024-09-15T12:31:57.333072+0000","last_active":"2024-09-15T12:31:57.333072+0000","last_peered":"2024-09-15T12:31:57.333072+0000","last_clean":"2024-09-15T12:31:57.333072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:31:57.333072+0000","last_undegraded":"2024-09-15T12:31:57.333072+0000","last_fullsized":"2024-09-15T12:31:57.333072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.341995+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:30:58.341995+0000","last_peered":"2024-09-15T12:30:58.341995+0000","last_clean":"2024-09-15T12:30:58.341995+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:30:58.341995+0000","last_undegraded":"2024-09-15T12:30:58.341995+0000","last_fullsized":"2024-09-15T12:30:58.341995+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:31:57.333072+0000","last_change":"2024-09-15T12:31:57.333072+0000","last_active":"2024-09-15T12:31:57.333072+0000","last_peered":"2024-09-15T12:31:57.333072+0000","last_clean":"2024-09-15T12:31:57.333072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:31:57.333072+0000","last_undegraded":"2024-09-15T12:31:57.333072+0000","last_fullsized":"2024-09-15T12:31:57.333072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.353747+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:30:58.353747+0000","last_peered":"2024-09-15T12:30:58.353747+0000","last_clean":"2024-09-15T12:30:58.353747+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:30:58.353747+0000","last_undegraded":"2024-09-15T12:30:58.353747+0000","last_fullsized":"2024-09-15T12:30:58.353747+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:31:57.333072+0000","last_change":"2024-09-15T12:31:57.333072+0000","last_active":"2024-09-15T12:31:57.333072+0000","last_peered":"2024-09-15T12:31:57.333072+0000","last_clean":"2024-09-15T12:31:57.333072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:31:57.333072+0000","last_undegraded":"2024-09-15T12:31:57.333072+0000","last_fullsized":"2024-09-15T12:31:57.333072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.328638+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:30:58.328638+0000","last_peered":"2024-09-15T12:30:58.328638+0000","last_clean":"2024-09-15T12:30:58.328638+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:30:58.328638+0000","last_undegraded":"2024-09-15T12:30:58.328638+0000","last_fullsized":"2024-09-15T12:30:58.328638+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-15T12:31:57.333072+0000","last_change":"2024-09-15T12:31:57.333072+0000","last_active":"2024-09-15T12:31:57.333072+0000","last_peered":"2024-09-15T12:31:57.333072+0000","last_clean":"2024-09-15T12:31:57.333072+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T12:31:57.333072+0000","last_undegraded":"2024-09-15T12:31:57.333072+0000","last_fullsized":"2024-09-15T12:31:57.333072+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":247,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-15T12:30:58.354596+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:30:58.354596+0000","last_peered":"2024-09-15T12:30:58.354596+0000","last_clean":"2024-09-15T12:30:58.354596+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:30:58.354596+0000","last_undegraded":"2024-09-15T12:30:58.354596+0000","last_fullsized":"2024-09-15T12:30:58.354596+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673738,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":121552,"kb_used_data":4480,"kb_used_omap":0,"kb_used_meta":117056,"kb_avail":94250288,"statfs":{"total":96636764160,"available":96512294912,"internally_reserved":0,"allocated":4587520,"data_stored":60911510,"data_compressed":2880624,"data_compressed_allocated":3792896,"data_compressed_original":60604416,"omap_allocated":0,"internal_metadata":119865344},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706442,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":134484,"kb_used_data":4932,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94237356,"statfs":{"total":96636764160,"available":96499052544,"internally_reserved":0,"allocated":5050368,"data_stored":68317073,"data_compressed":3232280,"data_compressed_allocated":4255744,"data_compressed_original":68009984,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706442,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":126828,"kb_used_data":5596,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94245012,"statfs":{"total":96636764160,"available":96506892288,"internally_reserved":0,"allocated":5730304,"data_stored":79523209,"data_compressed":3762408,"data_compressed_allocated":4952064,"data_compressed_original":79233024,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706441,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":135588,"kb_used_data":6032,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94236252,"statfs":{"total":96636764160,"available":96497922048,"internally_reserved":0,"allocated":6176768,"data_stored":86273961,"data_compressed":4084968,"data_compressed_allocated":5378048,"data_compressed_original":85966848,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:32:01.439 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 2 16 360 344 10.7493 11.25 0.0965311 0.0903671 2024-09-15T12:32:01.747 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:32:01.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:01.869+0000 7f20b78bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:01.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:01.879+0000 7f20b78bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:02.439 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 3 15 541 526 10.9576 11.375 0.0989706 0.0897381 2024-09-15T12:32:03.439 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 4 16 737 721 11.2648 12.1875 0.0662716 0.087636 2024-09-15T12:32:04.237 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:32:04.375 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:04.371+0000 7f21d329c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:04.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:04.377+0000 7f21d329c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:04.439 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 5 16 933 917 11.4616 12.25 0.0717861 0.0867609 2024-09-15T12:32:05.439 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 6 16 1112 1096 11.4158 11.1875 0.104145 0.0869821 2024-09-15T12:32:06.051 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:32:06.051 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:32:06.051 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:32:06.051 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:32:06.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:06.169+0000 7efe00ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:06.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:06.184+0000 7efe00ad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:06.219 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:32:06.219 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:32:06.219 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:32:06.219 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:32:06.219 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:32:06.219 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:32:06.219 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:32:06.219 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:32:06.219 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:32:06.220 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:32:06.220 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:32:06.220 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:32:06.223 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:32:06.223 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:32:06.223 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:32:06.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:06.368+0000 7f47c9293640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:06.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:06.380+0000 7f47c9293640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:06.439 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 7 16 1298 1282 11.4455 11.625 0.0349597 0.0867978 2024-09-15T12:32:06.514 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:32:06.515 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:32:06.515 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:32:06.515 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:32:06.515 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:32:06.515 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:32:06.515 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:32:06.515 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:32:06.515 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:32:06.515 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:32:06.515 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:32:06.515 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:32:06.518 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:32:06.518 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:32:06.519 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:32:06.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:06.640+0000 7ff25e46c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:06.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:06.653+0000 7ff25e46c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:06.667 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:32:06.727 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:32:06.727 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:32:06.727 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:32:06.727 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:32:06.728 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:32:06.728 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:32:06.728 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:32:06.728 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:32:06.728 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:32:06.728 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:32:06.728 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:32:06.728 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:32:06.733 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:32:06.733 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:32:06.734 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:32:06.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:06.810+0000 7faf41991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:06.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:06.820+0000 7faf41991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:06.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:06.881+0000 7f3047791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:06.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:06.894+0000 7f3047791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:06.990 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:32:06.990 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:32:06.991 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:32:06.991 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:32:06.991 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:32:06.991 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:32:06.991 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:32:06.991 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:32:06.991 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:32:06.991 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:32:06.991 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:32:06.991 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:32:06.994 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:32:06.995 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:32:07.439 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 8 16 1465 1449 11.3194 10.4375 0.0388775 0.0876916 2024-09-15T12:32:08.439 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 9 16 1647 1631 11.3255 11.375 0.0463638 0.0878319 2024-09-15T12:32:09.214 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:32:09.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:09.346+0000 7ffa25591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:09.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:09.354+0000 7ffa25591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:09.439 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 10 16 1836 1820 11.3741 11.8125 0.0734234 0.0875657 2024-09-15T12:32:10.439 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 11 16 2008 1992 11.3173 10.75 0.0976984 0.0879057 2024-09-15T12:32:11.440 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 12 16 2187 2171 11.3064 11.1875 0.133482 0.0880045 2024-09-15T12:32:11.655 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:32:11.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:11.793+0000 7f711b0fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:11.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:11.802+0000 7f711b0fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:11.996 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:32:11.996 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:32:11.997 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:32:12.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:12.137+0000 7ff207591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:12.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:12.149+0000 7ff207591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:12.433 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:32:12.433 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:32:12.440 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 13 16 2375 2359 11.3404 11.75 0.0569682 0.0879475 2024-09-15T12:32:12.450 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":494,"stamp":"2024-09-15T12:32:11.863618+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":140509747,"num_objects":2139,"num_object_clones":0,"num_object_copies":6417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2216,"num_write_kb":137748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2190,"ondisk_log_size":2190,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":533840,"kb_used_data":28108,"kb_used_omap":0,"kb_used_meta":505664,"kb_avail":376953520,"statfs":{"total":386547056640,"available":386000404480,"internally_reserved":0,"allocated":28782592,"data_stored":408721533,"data_compressed":19353158,"data_compressed_allocated":25481216,"data_compressed_original":407453696,"omap_allocated":0,"internal_metadata":517799936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":139919360,"num_objects":2135,"num_object_clones":0,"num_object_copies":6405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2135,"num_write_kb":136640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002277"},"pg_stats":[{"pgid":"7.f","version":"96'140","reported_seq":152,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:11.717598+0000","last_change":"2024-09-15T12:31:58.539371+0000","last_active":"2024-09-15T12:32:11.717598+0000","last_peered":"2024-09-15T12:32:11.717598+0000","last_clean":"2024-09-15T12:32:11.717598+0000","last_became_active":"2024-09-15T12:31:58.529616+0000","last_became_peered":"2024-09-15T12:31:58.529616+0000","last_unstale":"2024-09-15T12:32:11.717598+0000","last_undegraded":"2024-09-15T12:32:11.717598+0000","last_fullsized":"2024-09-15T12:32:11.717598+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9175040,"num_objects":140,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":8960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"96'117","reported_seq":129,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:10.417109+0000","last_change":"2024-09-15T12:31:58.494396+0000","last_active":"2024-09-15T12:32:10.417109+0000","last_peered":"2024-09-15T12:32:10.417109+0000","last_clean":"2024-09-15T12:32:10.417109+0000","last_became_active":"2024-09-15T12:31:58.482932+0000","last_became_peered":"2024-09-15T12:31:58.482932+0000","last_unstale":"2024-09-15T12:32:10.417109+0000","last_undegraded":"2024-09-15T12:32:10.417109+0000","last_fullsized":"2024-09-15T12:32:10.417109+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":7488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"96'122","reported_seq":134,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:10.737977+0000","last_change":"2024-09-15T12:31:58.494069+0000","last_active":"2024-09-15T12:32:10.737977+0000","last_peered":"2024-09-15T12:32:10.737977+0000","last_clean":"2024-09-15T12:32:10.737977+0000","last_became_active":"2024-09-15T12:31:58.483561+0000","last_became_peered":"2024-09-15T12:31:58.483561+0000","last_unstale":"2024-09-15T12:32:10.737977+0000","last_undegraded":"2024-09-15T12:32:10.737977+0000","last_fullsized":"2024-09-15T12:32:10.737977+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"96'116","reported_seq":128,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:10.668982+0000","last_change":"2024-09-15T12:31:58.531562+0000","last_active":"2024-09-15T12:32:10.668982+0000","last_peered":"2024-09-15T12:32:10.668982+0000","last_clean":"2024-09-15T12:32:10.668982+0000","last_became_active":"2024-09-15T12:31:58.525598+0000","last_became_peered":"2024-09-15T12:31:58.525598+0000","last_unstale":"2024-09-15T12:32:10.668982+0000","last_undegraded":"2024-09-15T12:32:10.668982+0000","last_fullsized":"2024-09-15T12:32:10.668982+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7602176,"num_objects":116,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":7424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"96'124","reported_seq":136,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:11.713677+0000","last_change":"2024-09-15T12:31:58.544695+0000","last_active":"2024-09-15T12:32:11.713677+0000","last_peered":"2024-09-15T12:32:11.713677+0000","last_clean":"2024-09-15T12:32:11.713677+0000","last_became_active":"2024-09-15T12:31:58.536224+0000","last_became_peered":"2024-09-15T12:31:58.536224+0000","last_unstale":"2024-09-15T12:32:11.713677+0000","last_undegraded":"2024-09-15T12:32:11.713677+0000","last_fullsized":"2024-09-15T12:32:11.713677+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"96'147","reported_seq":159,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:11.647539+0000","last_change":"2024-09-15T12:31:58.503374+0000","last_active":"2024-09-15T12:32:11.647539+0000","last_peered":"2024-09-15T12:32:11.647539+0000","last_clean":"2024-09-15T12:32:11.647539+0000","last_became_active":"2024-09-15T12:31:58.483732+0000","last_became_peered":"2024-09-15T12:31:58.483732+0000","last_unstale":"2024-09-15T12:32:11.647539+0000","last_undegraded":"2024-09-15T12:32:11.647539+0000","last_fullsized":"2024-09-15T12:32:11.647539+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9633792,"num_objects":147,"num_object_clones":0,"num_object_copies":441,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":9408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"96'149","reported_seq":161,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:10.702204+0000","last_change":"2024-09-15T12:31:58.497018+0000","last_active":"2024-09-15T12:32:10.702204+0000","last_peered":"2024-09-15T12:32:10.702204+0000","last_clean":"2024-09-15T12:32:10.702204+0000","last_became_active":"2024-09-15T12:31:58.489173+0000","last_became_peered":"2024-09-15T12:31:58.489173+0000","last_unstale":"2024-09-15T12:32:10.702204+0000","last_undegraded":"2024-09-15T12:32:10.702204+0000","last_fullsized":"2024-09-15T12:32:10.702204+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9764864,"num_objects":149,"num_object_clones":0,"num_object_copies":447,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":9536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"96'121","reported_seq":133,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:10.622029+0000","last_change":"2024-09-15T12:31:58.524969+0000","last_active":"2024-09-15T12:32:10.622029+0000","last_peered":"2024-09-15T12:32:10.622029+0000","last_clean":"2024-09-15T12:32:10.622029+0000","last_became_active":"2024-09-15T12:31:58.516994+0000","last_became_peered":"2024-09-15T12:31:58.516994+0000","last_unstale":"2024-09-15T12:32:10.622029+0000","last_undegraded":"2024-09-15T12:32:10.622029+0000","last_fullsized":"2024-09-15T12:32:10.622029+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7929856,"num_objects":121,"num_object_clones":0,"num_object_copies":363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":7744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"96'146","reported_seq":158,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:11.403541+0000","last_change":"2024-09-15T12:31:58.495776+0000","last_active":"2024-09-15T12:32:11.403541+0000","last_peered":"2024-09-15T12:32:11.403541+0000","last_clean":"2024-09-15T12:32:11.403541+0000","last_became_active":"2024-09-15T12:31:58.474993+0000","last_became_peered":"2024-09-15T12:31:58.474993+0000","last_unstale":"2024-09-15T12:32:11.403541+0000","last_undegraded":"2024-09-15T12:32:11.403541+0000","last_fullsized":"2024-09-15T12:32:11.403541+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9568256,"num_objects":146,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":9344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":331,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.358933+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:31:59.358933+0000","last_peered":"2024-09-15T12:31:59.358933+0000","last_clean":"2024-09-15T12:31:59.358933+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:31:59.358933+0000","last_undegraded":"2024-09-15T12:31:59.358933+0000","last_fullsized":"2024-09-15T12:31:59.358933+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":260,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.365124+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:31:59.365124+0000","last_peered":"2024-09-15T12:31:59.365124+0000","last_clean":"2024-09-15T12:31:59.365124+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:31:59.365124+0000","last_undegraded":"2024-09-15T12:31:59.365124+0000","last_fullsized":"2024-09-15T12:31:59.365124+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"96'159","reported_seq":171,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:10.511662+0000","last_change":"2024-09-15T12:31:58.498915+0000","last_active":"2024-09-15T12:32:10.511662+0000","last_peered":"2024-09-15T12:32:10.511662+0000","last_clean":"2024-09-15T12:32:10.511662+0000","last_became_active":"2024-09-15T12:31:58.487521+0000","last_became_peered":"2024-09-15T12:31:58.487521+0000","last_unstale":"2024-09-15T12:32:10.511662+0000","last_undegraded":"2024-09-15T12:32:10.511662+0000","last_fullsized":"2024-09-15T12:32:10.511662+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10420224,"num_objects":159,"num_object_clones":0,"num_object_copies":477,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":10176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.364819+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:31:59.364819+0000","last_peered":"2024-09-15T12:31:59.364819+0000","last_clean":"2024-09-15T12:31:59.364819+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:31:59.364819+0000","last_undegraded":"2024-09-15T12:31:59.364819+0000","last_fullsized":"2024-09-15T12:31:59.364819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"96'120","reported_seq":132,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:10.741751+0000","last_change":"2024-09-15T12:31:58.468104+0000","last_active":"2024-09-15T12:32:10.741751+0000","last_peered":"2024-09-15T12:32:10.741751+0000","last_clean":"2024-09-15T12:32:10.741751+0000","last_became_active":"2024-09-15T12:31:58.462443+0000","last_became_peered":"2024-09-15T12:31:58.462443+0000","last_unstale":"2024-09-15T12:32:10.741751+0000","last_undegraded":"2024-09-15T12:32:10.741751+0000","last_fullsized":"2024-09-15T12:32:10.741751+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7864320,"num_objects":120,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":7680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.356572+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:31:59.356572+0000","last_peered":"2024-09-15T12:31:59.356572+0000","last_clean":"2024-09-15T12:31:59.356572+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:31:59.356572+0000","last_undegraded":"2024-09-15T12:31:59.356572+0000","last_fullsized":"2024-09-15T12:31:59.356572+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"96'120","reported_seq":132,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:10.496409+0000","last_change":"2024-09-15T12:31:58.480532+0000","last_active":"2024-09-15T12:32:10.496409+0000","last_peered":"2024-09-15T12:32:10.496409+0000","last_clean":"2024-09-15T12:32:10.496409+0000","last_became_active":"2024-09-15T12:31:58.468452+0000","last_became_peered":"2024-09-15T12:31:58.468452+0000","last_unstale":"2024-09-15T12:32:10.496409+0000","last_undegraded":"2024-09-15T12:32:10.496409+0000","last_fullsized":"2024-09-15T12:32:10.496409+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7864320,"num_objects":120,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":7680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":261,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.358054+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:31:59.358054+0000","last_peered":"2024-09-15T12:31:59.358054+0000","last_clean":"2024-09-15T12:31:59.358054+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:31:59.358054+0000","last_undegraded":"2024-09-15T12:31:59.358054+0000","last_fullsized":"2024-09-15T12:31:59.358054+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"96'134","reported_seq":146,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:10.734900+0000","last_change":"2024-09-15T12:31:58.472814+0000","last_active":"2024-09-15T12:32:10.734900+0000","last_peered":"2024-09-15T12:32:10.734900+0000","last_clean":"2024-09-15T12:32:10.734900+0000","last_became_active":"2024-09-15T12:31:58.466600+0000","last_became_peered":"2024-09-15T12:31:58.466600+0000","last_unstale":"2024-09-15T12:32:10.734900+0000","last_undegraded":"2024-09-15T12:32:10.734900+0000","last_fullsized":"2024-09-15T12:32:10.734900+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8781824,"num_objects":134,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":8576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.362774+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:31:59.362774+0000","last_peered":"2024-09-15T12:31:59.362774+0000","last_clean":"2024-09-15T12:31:59.362774+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:31:59.362774+0000","last_undegraded":"2024-09-15T12:31:59.362774+0000","last_fullsized":"2024-09-15T12:31:59.362774+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"96'138","reported_seq":150,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:10.673383+0000","last_change":"2024-09-15T12:31:58.435605+0000","last_active":"2024-09-15T12:32:10.673383+0000","last_peered":"2024-09-15T12:32:10.673383+0000","last_clean":"2024-09-15T12:32:10.673383+0000","last_became_active":"2024-09-15T12:31:58.429332+0000","last_became_peered":"2024-09-15T12:31:58.429332+0000","last_unstale":"2024-09-15T12:32:10.673383+0000","last_undegraded":"2024-09-15T12:32:10.673383+0000","last_fullsized":"2024-09-15T12:32:10.673383+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9043968,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":8832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.360240+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:31:59.360240+0000","last_peered":"2024-09-15T12:31:59.360240+0000","last_clean":"2024-09-15T12:31:59.360240+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:31:59.360240+0000","last_undegraded":"2024-09-15T12:31:59.360240+0000","last_fullsized":"2024-09-15T12:31:59.360240+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"96'149","reported_seq":161,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:11.694587+0000","last_change":"2024-09-15T12:31:58.492392+0000","last_active":"2024-09-15T12:32:11.694587+0000","last_peered":"2024-09-15T12:32:11.694587+0000","last_clean":"2024-09-15T12:32:11.694587+0000","last_became_active":"2024-09-15T12:31:58.466633+0000","last_became_peered":"2024-09-15T12:31:58.466633+0000","last_unstale":"2024-09-15T12:32:11.694587+0000","last_undegraded":"2024-09-15T12:32:11.694587+0000","last_fullsized":"2024-09-15T12:32:11.694587+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9764864,"num_objects":149,"num_object_clones":0,"num_object_copies":447,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":9536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.360118+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:31:59.360118+0000","last_peered":"2024-09-15T12:31:59.360118+0000","last_clean":"2024-09-15T12:31:59.360118+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:31:59.360118+0000","last_undegraded":"2024-09-15T12:31:59.360118+0000","last_fullsized":"2024-09-15T12:31:59.360118+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"96'133","reported_seq":145,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:11.730997+0000","last_change":"2024-09-15T12:31:58.524245+0000","last_active":"2024-09-15T12:32:11.730997+0000","last_peered":"2024-09-15T12:32:11.730997+0000","last_clean":"2024-09-15T12:32:11.730997+0000","last_became_active":"2024-09-15T12:31:58.516700+0000","last_became_peered":"2024-09-15T12:31:58.516700+0000","last_unstale":"2024-09-15T12:32:11.730997+0000","last_undegraded":"2024-09-15T12:32:11.730997+0000","last_fullsized":"2024-09-15T12:32:11.730997+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.363584+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:31:59.363584+0000","last_peered":"2024-09-15T12:31:59.363584+0000","last_clean":"2024-09-15T12:31:59.363584+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:31:59.363584+0000","last_undegraded":"2024-09-15T12:31:59.363584+0000","last_fullsized":"2024-09-15T12:31:59.363584+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":139919360,"num_objects":2135,"num_object_clones":0,"num_object_copies":6405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2135,"num_write_kb":136640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":26157056,"data_stored":418512896,"data_compressed":19869902,"data_compressed_allocated":26157056,"data_compressed_original":418512896,"omap_allocated":0,"internal_metadata":0},"log_size":2135,"ondisk_log_size":2135,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673768,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":138808,"kb_used_data":9256,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94233032,"statfs":{"total":96636764160,"available":96494624768,"internally_reserved":0,"allocated":9478144,"data_stored":138651289,"data_compressed":6570410,"data_compressed_allocated":8650752,"data_compressed_original":138330112,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":126752,"kb_used_data":5520,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94245088,"statfs":{"total":96636764160,"available":96506970112,"internally_reserved":0,"allocated":5652480,"data_stored":77375148,"data_compressed":3661090,"data_compressed_allocated":4820992,"data_compressed_original":77053952,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":141148,"kb_used_data":7432,"kb_used_omap":0,"kb_used_meta":133696,"kb_avail":94230692,"statfs":{"total":96636764160,"available":96492228608,"internally_reserved":0,"allocated":7610368,"data_stored":109094028,"data_compressed":5165014,"data_compressed_allocated":6799360,"data_compressed_original":108789760,"omap_allocated":0,"internal_metadata":136904704},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706471,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":127132,"kb_used_data":5900,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94244708,"statfs":{"total":96636764160,"available":96506580992,"internally_reserved":0,"allocated":6041600,"data_stored":83601068,"data_compressed":3956644,"data_compressed_allocated":5210112,"data_compressed_original":83279872,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5677056,"data_stored":90832896,"data_compressed":4312500,"data_compressed_allocated":5677056,"data_compressed_original":90832896,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6893568,"data_stored":110297088,"data_compressed":5236590,"data_compressed_allocated":6893568,"data_compressed_original":110297088,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4874240,"data_stored":77987840,"data_compressed":3702634,"data_compressed_allocated":4874240,"data_compressed_original":77987840,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":139395072,"data_compressed":6618178,"data_compressed_allocated":8712192,"data_compressed_original":139395072,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:32:13.440 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 14 16 2572 2556 11.4098 12.3125 0.0879792 0.0873273 2024-09-15T12:32:14.171 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:32:14.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:14.294+0000 7fa784911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:14.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:14.303+0000 7fa784911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:14.440 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 15 16 2759 2743 11.4282 11.6875 0.0673823 0.0873113 2024-09-15T12:32:15.440 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 16 16 2939 2923 11.417 11.25 0.0873147 0.087356 2024-09-15T12:32:16.440 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 17 16 3122 3106 11.4182 11.4375 0.0524919 0.0873874 2024-09-15T12:32:16.641 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:32:16.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:16.788+0000 7f0f77151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:16.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:16.796+0000 7f0f77151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:17.440 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 18 16 3302 3286 11.4088 11.25 0.065885 0.0874243 2024-09-15T12:32:17.452 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:32:17.452 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:32:17.452 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:32:17.453 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:32:17.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:17.593+0000 7f7d8ff11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:17.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:17.605+0000 7f7d8ff11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:17.628 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:32:17.628 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:32:17.628 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:32:17.628 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:32:17.629 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:32:17.629 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:32:17.629 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:32:17.629 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:32:17.629 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:32:17.629 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:32:17.629 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:32:17.629 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:32:17.633 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:32:17.634 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:32:17.634 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:32:17.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:17.775+0000 7f3cb5afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:17.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:17.790+0000 7f3cb5afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:17.833 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:32:17.833 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:32:17.833 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:32:17.833 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:32:17.833 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:32:17.833 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:32:17.833 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:32:17.833 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:32:17.833 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:32:17.833 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:32:17.834 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:32:17.834 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:32:17.837 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:32:17.838 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:32:17.838 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:32:17.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:17.981+0000 7fd441551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:17.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:17.995+0000 7fd441551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:18.029 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:32:18.029 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:32:18.029 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:32:18.029 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:32:18.029 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:32:18.029 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:32:18.030 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:32:18.030 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:32:18.030 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:32:18.030 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:32:18.030 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:32:18.030 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:32:18.033 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:32:18.034 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:32:18.034 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:32:18.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:18.177+0000 7f47582c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:18.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:18.190+0000 7f47582c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:18.286 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:32:18.286 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:32:18.286 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:32:18.287 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:32:18.287 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:32:18.287 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:32:18.287 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:32:18.287 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:32:18.287 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:32:18.287 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:32:18.287 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:32:18.287 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:32:18.290 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:32:18.291 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:32:18.440 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 19 16 3473 3457 11.3708 10.6875 0.0981526 0.087703 2024-09-15T12:32:19.088 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:32:19.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:19.236+0000 7fbf61991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:19.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:19.242+0000 7fbf61991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:19.440 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:2024-09-15T12:32:19.439914+0000 min lat: 0.0171244 max lat: 0.181493 avg lat: 0.0878101 2024-09-15T12:32:19.440 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-15T12:32:19.440 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 20 16 3652 3636 11.3615 11.1875 0.0826067 0.0878101 2024-09-15T12:32:20.441 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 21 16 3824 3808 11.3324 10.75 0.126762 0.0879806 2024-09-15T12:32:21.441 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 22 16 4002 3986 11.3229 11.125 0.115814 0.0881539 2024-09-15T12:32:21.642 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:32:21.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:21.789+0000 7fdaccc9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:21.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:21.796+0000 7fdaccc9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:22.440 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 23 16 4172 4156 11.2925 10.625 0.0991418 0.0883717 2024-09-15T12:32:23.291 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:32:23.292 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:32:23.292 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:32:23.292 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:32:23.441 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 24 16 4348 4332 11.2803 11 0.0903575 0.0884002 2024-09-15T12:32:23.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:23.443+0000 7fa425b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:23.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:23.455+0000 7fa425b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:23.523 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:32:23.523 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:32:23.523 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:32:23.523 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:32:23.523 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:32:23.523 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:32:23.523 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:32:23.523 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:32:23.523 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:32:23.523 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:32:23.523 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:32:23.523 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:32:23.527 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:32:23.528 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:32:23.528 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:32:23.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:23.667+0000 7f8f392ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:23.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:23.680+0000 7f8f392ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:23.754 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:32:23.754 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:32:23.754 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:32:23.754 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:32:23.754 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:32:23.754 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:32:23.754 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:32:23.754 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:32:23.754 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:32:23.754 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:32:23.754 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:32:23.754 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:32:23.757 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:32:23.758 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:32:23.758 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:32:23.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:23.885+0000 7f0e52f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:23.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:23.897+0000 7f0e52f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:23.930 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:32:23.930 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:32:23.930 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:32:23.930 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:32:23.930 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:32:23.931 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:32:23.931 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:32:23.931 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:32:23.931 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:32:23.931 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:32:23.931 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:32:23.931 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:32:23.935 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:32:23.935 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:32:23.935 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:32:24.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:24.059+0000 7f035be6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:24.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:24.071+0000 7f035be6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:24.142 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:32:24.161 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:32:24.161 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:32:24.161 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:32:24.161 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:32:24.161 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:32:24.162 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:32:24.162 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:32:24.162 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:32:24.162 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:32:24.162 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:32:24.162 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:32:24.162 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:32:24.165 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:32:24.165 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:32:24.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:24.272+0000 7ffb4d8a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:24.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:24.280+0000 7ffb4d8a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:24.441 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 25 16 4534 4518 11.294 11.625 0.077294 0.0884098 2024-09-15T12:32:25.441 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 26 16 4701 4685 11.2611 10.4375 0.0769158 0.088523 2024-09-15T12:32:26.441 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 27 16 4875 4859 11.2467 10.875 0.0920886 0.0886957 2024-09-15T12:32:26.580 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:32:26.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:26.748+0000 7fc5af663640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:26.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:26.755+0000 7fc5af663640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:27.441 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 28 16 5020 5004 11.1687 9.0625 0.0451896 0.0893888 2024-09-15T12:32:28.441 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 29 16 5202 5186 11.1758 11.375 0.0984734 0.089369 2024-09-15T12:32:29.032 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:32:29.165 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:32:29.165 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:32:29.166 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:32:29.166 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:32:29.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:29.175+0000 7f2e45d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:29.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:29.185+0000 7f2e45d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:29.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:29.303+0000 7f8aab151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:29.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:29.320+0000 7f8aab151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:29.365 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:32:29.365 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:32:29.365 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:32:29.365 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:32:29.365 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:32:29.365 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:32:29.365 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:32:29.365 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:32:29.365 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:32:29.366 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:32:29.366 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:32:29.366 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:32:29.368 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:32:29.369 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:32:29.369 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:32:29.441 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 30 16 5362 5346 11.1365 10 0.122889 0.0896174 2024-09-15T12:32:29.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:29.543+0000 7fcf14cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:29.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:29.554+0000 7fcf14cd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:29.697 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:32:29.697 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:32:29.697 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:32:29.697 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:32:29.697 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:32:29.697 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:32:29.697 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:32:29.698 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:32:29.698 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:32:29.698 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:32:29.698 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:32:29.698 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:32:29.701 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:32:29.702 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:32:29.702 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:32:29.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:29.836+0000 7faa5df91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:29.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:29.847+0000 7faa5df91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:29.869 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:32:29.869 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:32:29.869 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:32:29.869 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:32:29.869 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:32:29.869 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:32:29.870 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:32:29.870 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:32:29.870 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:32:29.870 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:32:29.870 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:32:29.870 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:32:29.872 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:32:29.873 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:32:29.873 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:32:30.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:30.021+0000 7f7f3f0bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:30.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:30.035+0000 7f7f3f0bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:30.118 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:32:30.118 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:32:30.118 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:32:30.118 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:32:30.118 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:32:30.119 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:32:30.119 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:32:30.119 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:32:30.119 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:32:30.119 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:32:30.119 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:32:30.119 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:32:30.123 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:32:30.123 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:32:30.441 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 31 16 5544 5528 11.1442 11.375 0.0621648 0.0895956 2024-09-15T12:32:31.442 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 32 16 5719 5703 11.1377 10.9375 0.0966316 0.0896311 2024-09-15T12:32:31.469 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:32:31.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:31.617+0000 7f547dd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:31.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:31.626+0000 7f547dd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:32.441 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 33 16 5903 5887 11.1487 11.5 0.114878 0.0895324 2024-09-15T12:32:33.442 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 34 16 6091 6075 11.1663 11.75 0.0847928 0.0894523 2024-09-15T12:32:34.103 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:32:34.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:34.248+0000 7f89ec791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:34.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:34.255+0000 7f89ec791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:34.442 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 35 16 6256 6240 11.1419 10.3125 0.100513 0.0896212 2024-09-15T12:32:35.124 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:32:35.124 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:32:35.124 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:32:35.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:35.260+0000 7fd29b04f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:35.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:35.269+0000 7fd29b04f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:35.442 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 36 16 6431 6415 11.1362 10.9375 0.142584 0.089651 2024-09-15T12:32:35.537 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:32:35.537 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:32:35.558 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":505,"stamp":"2024-09-15T12:32:33.867704+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":140509747,"num_objects":2139,"num_object_clones":0,"num_object_copies":6417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":2216,"num_write_kb":137748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2190,"ondisk_log_size":2190,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":533840,"kb_used_data":28108,"kb_used_omap":0,"kb_used_meta":505664,"kb_avail":376953520,"statfs":{"total":386547056640,"available":386000404480,"internally_reserved":0,"allocated":28782592,"data_stored":408721533,"data_compressed":19353158,"data_compressed_allocated":25481216,"data_compressed_original":407453696,"omap_allocated":0,"internal_metadata":517799936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002139"},"pg_stats":[{"pgid":"7.f","version":"96'140","reported_seq":152,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:11.717598+0000","last_change":"2024-09-15T12:31:58.539371+0000","last_active":"2024-09-15T12:32:11.717598+0000","last_peered":"2024-09-15T12:32:11.717598+0000","last_clean":"2024-09-15T12:32:11.717598+0000","last_became_active":"2024-09-15T12:31:58.529616+0000","last_became_peered":"2024-09-15T12:31:58.529616+0000","last_unstale":"2024-09-15T12:32:11.717598+0000","last_undegraded":"2024-09-15T12:32:11.717598+0000","last_fullsized":"2024-09-15T12:32:11.717598+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9175040,"num_objects":140,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":140,"num_write_kb":8960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"96'117","reported_seq":129,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:10.417109+0000","last_change":"2024-09-15T12:31:58.494396+0000","last_active":"2024-09-15T12:32:10.417109+0000","last_peered":"2024-09-15T12:32:10.417109+0000","last_clean":"2024-09-15T12:32:10.417109+0000","last_became_active":"2024-09-15T12:31:58.482932+0000","last_became_peered":"2024-09-15T12:31:58.482932+0000","last_unstale":"2024-09-15T12:32:10.417109+0000","last_undegraded":"2024-09-15T12:32:10.417109+0000","last_fullsized":"2024-09-15T12:32:10.417109+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7667712,"num_objects":117,"num_object_clones":0,"num_object_copies":351,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":7488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"96'122","reported_seq":134,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:10.737977+0000","last_change":"2024-09-15T12:31:58.494069+0000","last_active":"2024-09-15T12:32:10.737977+0000","last_peered":"2024-09-15T12:32:10.737977+0000","last_clean":"2024-09-15T12:32:10.737977+0000","last_became_active":"2024-09-15T12:31:58.483561+0000","last_became_peered":"2024-09-15T12:31:58.483561+0000","last_unstale":"2024-09-15T12:32:10.737977+0000","last_undegraded":"2024-09-15T12:32:10.737977+0000","last_fullsized":"2024-09-15T12:32:10.737977+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7995392,"num_objects":122,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":122,"num_write_kb":7808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"96'116","reported_seq":128,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:10.668982+0000","last_change":"2024-09-15T12:31:58.531562+0000","last_active":"2024-09-15T12:32:10.668982+0000","last_peered":"2024-09-15T12:32:10.668982+0000","last_clean":"2024-09-15T12:32:10.668982+0000","last_became_active":"2024-09-15T12:31:58.525598+0000","last_became_peered":"2024-09-15T12:31:58.525598+0000","last_unstale":"2024-09-15T12:32:10.668982+0000","last_undegraded":"2024-09-15T12:32:10.668982+0000","last_fullsized":"2024-09-15T12:32:10.668982+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7602176,"num_objects":116,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":116,"num_write_kb":7424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"96'124","reported_seq":136,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:11.713677+0000","last_change":"2024-09-15T12:31:58.544695+0000","last_active":"2024-09-15T12:32:11.713677+0000","last_peered":"2024-09-15T12:32:11.713677+0000","last_clean":"2024-09-15T12:32:11.713677+0000","last_became_active":"2024-09-15T12:31:58.536224+0000","last_became_peered":"2024-09-15T12:31:58.536224+0000","last_unstale":"2024-09-15T12:32:11.713677+0000","last_undegraded":"2024-09-15T12:32:11.713677+0000","last_fullsized":"2024-09-15T12:32:11.713677+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8126464,"num_objects":124,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":7936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"96'147","reported_seq":159,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:11.647539+0000","last_change":"2024-09-15T12:31:58.503374+0000","last_active":"2024-09-15T12:32:11.647539+0000","last_peered":"2024-09-15T12:32:11.647539+0000","last_clean":"2024-09-15T12:32:11.647539+0000","last_became_active":"2024-09-15T12:31:58.483732+0000","last_became_peered":"2024-09-15T12:31:58.483732+0000","last_unstale":"2024-09-15T12:32:11.647539+0000","last_undegraded":"2024-09-15T12:32:11.647539+0000","last_fullsized":"2024-09-15T12:32:11.647539+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9633792,"num_objects":147,"num_object_clones":0,"num_object_copies":441,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":9408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"96'149","reported_seq":161,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:10.702204+0000","last_change":"2024-09-15T12:31:58.497018+0000","last_active":"2024-09-15T12:32:10.702204+0000","last_peered":"2024-09-15T12:32:10.702204+0000","last_clean":"2024-09-15T12:32:10.702204+0000","last_became_active":"2024-09-15T12:31:58.489173+0000","last_became_peered":"2024-09-15T12:31:58.489173+0000","last_unstale":"2024-09-15T12:32:10.702204+0000","last_undegraded":"2024-09-15T12:32:10.702204+0000","last_fullsized":"2024-09-15T12:32:10.702204+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9764864,"num_objects":149,"num_object_clones":0,"num_object_copies":447,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":9536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"96'121","reported_seq":133,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:10.622029+0000","last_change":"2024-09-15T12:31:58.524969+0000","last_active":"2024-09-15T12:32:10.622029+0000","last_peered":"2024-09-15T12:32:10.622029+0000","last_clean":"2024-09-15T12:32:10.622029+0000","last_became_active":"2024-09-15T12:31:58.516994+0000","last_became_peered":"2024-09-15T12:31:58.516994+0000","last_unstale":"2024-09-15T12:32:10.622029+0000","last_undegraded":"2024-09-15T12:32:10.622029+0000","last_fullsized":"2024-09-15T12:32:10.622029+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":121,"log_dups_size":0,"ondisk_log_size":121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7929856,"num_objects":121,"num_object_clones":0,"num_object_copies":363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":7744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"96'146","reported_seq":158,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:11.403541+0000","last_change":"2024-09-15T12:31:58.495776+0000","last_active":"2024-09-15T12:32:11.403541+0000","last_peered":"2024-09-15T12:32:11.403541+0000","last_clean":"2024-09-15T12:32:11.403541+0000","last_became_active":"2024-09-15T12:31:58.474993+0000","last_became_peered":"2024-09-15T12:31:58.474993+0000","last_unstale":"2024-09-15T12:32:11.403541+0000","last_undegraded":"2024-09-15T12:32:11.403541+0000","last_fullsized":"2024-09-15T12:32:11.403541+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9568256,"num_objects":146,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":146,"num_write_kb":9344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":331,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.358933+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:31:59.358933+0000","last_peered":"2024-09-15T12:31:59.358933+0000","last_clean":"2024-09-15T12:31:59.358933+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:31:59.358933+0000","last_undegraded":"2024-09-15T12:31:59.358933+0000","last_fullsized":"2024-09-15T12:31:59.358933+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":260,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.365124+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:31:59.365124+0000","last_peered":"2024-09-15T12:31:59.365124+0000","last_clean":"2024-09-15T12:31:59.365124+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:31:59.365124+0000","last_undegraded":"2024-09-15T12:31:59.365124+0000","last_fullsized":"2024-09-15T12:31:59.365124+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"96'159","reported_seq":171,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:10.511662+0000","last_change":"2024-09-15T12:31:58.498915+0000","last_active":"2024-09-15T12:32:10.511662+0000","last_peered":"2024-09-15T12:32:10.511662+0000","last_clean":"2024-09-15T12:32:10.511662+0000","last_became_active":"2024-09-15T12:31:58.487521+0000","last_became_peered":"2024-09-15T12:31:58.487521+0000","last_unstale":"2024-09-15T12:32:10.511662+0000","last_undegraded":"2024-09-15T12:32:10.511662+0000","last_fullsized":"2024-09-15T12:32:10.511662+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10420224,"num_objects":159,"num_object_clones":0,"num_object_copies":477,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":10176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.364819+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:31:59.364819+0000","last_peered":"2024-09-15T12:31:59.364819+0000","last_clean":"2024-09-15T12:31:59.364819+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:31:59.364819+0000","last_undegraded":"2024-09-15T12:31:59.364819+0000","last_fullsized":"2024-09-15T12:31:59.364819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"96'120","reported_seq":132,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:10.741751+0000","last_change":"2024-09-15T12:31:58.468104+0000","last_active":"2024-09-15T12:32:10.741751+0000","last_peered":"2024-09-15T12:32:10.741751+0000","last_clean":"2024-09-15T12:32:10.741751+0000","last_became_active":"2024-09-15T12:31:58.462443+0000","last_became_peered":"2024-09-15T12:31:58.462443+0000","last_unstale":"2024-09-15T12:32:10.741751+0000","last_undegraded":"2024-09-15T12:32:10.741751+0000","last_fullsized":"2024-09-15T12:32:10.741751+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7864320,"num_objects":120,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":7680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.356572+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:31:59.356572+0000","last_peered":"2024-09-15T12:31:59.356572+0000","last_clean":"2024-09-15T12:31:59.356572+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:31:59.356572+0000","last_undegraded":"2024-09-15T12:31:59.356572+0000","last_fullsized":"2024-09-15T12:31:59.356572+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"96'120","reported_seq":132,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:10.496409+0000","last_change":"2024-09-15T12:31:58.480532+0000","last_active":"2024-09-15T12:32:10.496409+0000","last_peered":"2024-09-15T12:32:10.496409+0000","last_clean":"2024-09-15T12:32:10.496409+0000","last_became_active":"2024-09-15T12:31:58.468452+0000","last_became_peered":"2024-09-15T12:31:58.468452+0000","last_unstale":"2024-09-15T12:32:10.496409+0000","last_undegraded":"2024-09-15T12:32:10.496409+0000","last_fullsized":"2024-09-15T12:32:10.496409+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7864320,"num_objects":120,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":120,"num_write_kb":7680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":261,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.358054+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:31:59.358054+0000","last_peered":"2024-09-15T12:31:59.358054+0000","last_clean":"2024-09-15T12:31:59.358054+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:31:59.358054+0000","last_undegraded":"2024-09-15T12:31:59.358054+0000","last_fullsized":"2024-09-15T12:31:59.358054+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"96'134","reported_seq":146,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:10.734900+0000","last_change":"2024-09-15T12:31:58.472814+0000","last_active":"2024-09-15T12:32:10.734900+0000","last_peered":"2024-09-15T12:32:10.734900+0000","last_clean":"2024-09-15T12:32:10.734900+0000","last_became_active":"2024-09-15T12:31:58.466600+0000","last_became_peered":"2024-09-15T12:31:58.466600+0000","last_unstale":"2024-09-15T12:32:10.734900+0000","last_undegraded":"2024-09-15T12:32:10.734900+0000","last_fullsized":"2024-09-15T12:32:10.734900+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8781824,"num_objects":134,"num_object_clones":0,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":134,"num_write_kb":8576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.362774+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:31:59.362774+0000","last_peered":"2024-09-15T12:31:59.362774+0000","last_clean":"2024-09-15T12:31:59.362774+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:31:59.362774+0000","last_undegraded":"2024-09-15T12:31:59.362774+0000","last_fullsized":"2024-09-15T12:31:59.362774+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"96'138","reported_seq":150,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:10.673383+0000","last_change":"2024-09-15T12:31:58.435605+0000","last_active":"2024-09-15T12:32:10.673383+0000","last_peered":"2024-09-15T12:32:10.673383+0000","last_clean":"2024-09-15T12:32:10.673383+0000","last_became_active":"2024-09-15T12:31:58.429332+0000","last_became_peered":"2024-09-15T12:31:58.429332+0000","last_unstale":"2024-09-15T12:32:10.673383+0000","last_undegraded":"2024-09-15T12:32:10.673383+0000","last_fullsized":"2024-09-15T12:32:10.673383+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9043968,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":8832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.360240+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:31:59.360240+0000","last_peered":"2024-09-15T12:31:59.360240+0000","last_clean":"2024-09-15T12:31:59.360240+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:31:59.360240+0000","last_undegraded":"2024-09-15T12:31:59.360240+0000","last_fullsized":"2024-09-15T12:31:59.360240+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"96'149","reported_seq":161,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:11.694587+0000","last_change":"2024-09-15T12:31:58.492392+0000","last_active":"2024-09-15T12:32:11.694587+0000","last_peered":"2024-09-15T12:32:11.694587+0000","last_clean":"2024-09-15T12:32:11.694587+0000","last_became_active":"2024-09-15T12:31:58.466633+0000","last_became_peered":"2024-09-15T12:31:58.466633+0000","last_unstale":"2024-09-15T12:32:11.694587+0000","last_undegraded":"2024-09-15T12:32:11.694587+0000","last_fullsized":"2024-09-15T12:32:11.694587+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9764864,"num_objects":149,"num_object_clones":0,"num_object_copies":447,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":149,"num_write_kb":9536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.360118+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:31:59.360118+0000","last_peered":"2024-09-15T12:31:59.360118+0000","last_clean":"2024-09-15T12:31:59.360118+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:31:59.360118+0000","last_undegraded":"2024-09-15T12:31:59.360118+0000","last_fullsized":"2024-09-15T12:31:59.360118+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"96'133","reported_seq":145,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:11.730997+0000","last_change":"2024-09-15T12:31:58.524245+0000","last_active":"2024-09-15T12:32:11.730997+0000","last_peered":"2024-09-15T12:32:11.730997+0000","last_clean":"2024-09-15T12:32:11.730997+0000","last_became_active":"2024-09-15T12:31:58.516700+0000","last_became_peered":"2024-09-15T12:31:58.516700+0000","last_unstale":"2024-09-15T12:32:11.730997+0000","last_undegraded":"2024-09-15T12:32:11.730997+0000","last_fullsized":"2024-09-15T12:32:11.730997+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8716288,"num_objects":133,"num_object_clones":0,"num_object_copies":399,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":133,"num_write_kb":8512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.363584+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:31:59.363584+0000","last_peered":"2024-09-15T12:31:59.363584+0000","last_clean":"2024-09-15T12:31:59.363584+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:31:59.363584+0000","last_undegraded":"2024-09-15T12:31:59.363584+0000","last_fullsized":"2024-09-15T12:31:59.363584+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":139919360,"num_objects":2135,"num_object_clones":0,"num_object_copies":6405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2135,"num_write_kb":136640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":26157056,"data_stored":418512896,"data_compressed":19869902,"data_compressed_allocated":26157056,"data_compressed_original":418512896,"omap_allocated":0,"internal_metadata":0},"log_size":2135,"ondisk_log_size":2135,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673768,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":138808,"kb_used_data":9256,"kb_used_omap":0,"kb_used_meta":129536,"kb_avail":94233032,"statfs":{"total":96636764160,"available":96494624768,"internally_reserved":0,"allocated":9478144,"data_stored":138651289,"data_compressed":6570410,"data_compressed_allocated":8650752,"data_compressed_original":138330112,"omap_allocated":0,"internal_metadata":132644864},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":126752,"kb_used_data":5520,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94245088,"statfs":{"total":96636764160,"available":96506970112,"internally_reserved":0,"allocated":5652480,"data_stored":77375148,"data_compressed":3661090,"data_compressed_allocated":4820992,"data_compressed_original":77053952,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":141148,"kb_used_data":7432,"kb_used_omap":0,"kb_used_meta":133696,"kb_avail":94230692,"statfs":{"total":96636764160,"available":96492228608,"internally_reserved":0,"allocated":7610368,"data_stored":109094028,"data_compressed":5165014,"data_compressed_allocated":6799360,"data_compressed_original":108789760,"omap_allocated":0,"internal_metadata":136904704},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706471,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":127132,"kb_used_data":5900,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94244708,"statfs":{"total":96636764160,"available":96506580992,"internally_reserved":0,"allocated":6041600,"data_stored":83601068,"data_compressed":3956644,"data_compressed_allocated":5210112,"data_compressed_original":83279872,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5677056,"data_stored":90832896,"data_compressed":4312500,"data_compressed_allocated":5677056,"data_compressed_original":90832896,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6893568,"data_stored":110297088,"data_compressed":5236590,"data_compressed_allocated":6893568,"data_compressed_original":110297088,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4874240,"data_stored":77987840,"data_compressed":3702634,"data_compressed_allocated":4874240,"data_compressed_original":77987840,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":139395072,"data_compressed":6618178,"data_compressed_allocated":8712192,"data_compressed_original":139395072,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:32:36.442 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 37 16 6612 6596 11.1409 11.3125 0.100402 0.0896094 2024-09-15T12:32:36.596 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:32:36.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:36.726+0000 7fec01111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:36.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:36.733+0000 7fec01111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:37.442 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 38 16 6785 6769 11.1323 10.8125 0.0837321 0.089724 2024-09-15T12:32:38.442 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 39 16 6977 6961 11.1545 12 0.140996 0.0895548 2024-09-15T12:32:38.970 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:32:39.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:39.113+0000 7ff5e1191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:39.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:39.122+0000 7ff5e1191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:39.442 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:2024-09-15T12:32:39.441685+0000 min lat: 0.0171244 max lat: 0.200277 avg lat: 0.089524 2024-09-15T12:32:39.443 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-15T12:32:39.443 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 40 16 7155 7139 11.1537 11.125 0.108183 0.089524 2024-09-15T12:32:40.442 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 41 16 7320 7304 11.1332 10.3125 0.0865759 0.089684 2024-09-15T12:32:40.560 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:32:40.560 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:32:40.560 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:32:40.561 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:32:40.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:40.692+0000 7fe03a191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:40.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:40.703+0000 7fe03a191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:40.749 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:32:40.749 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:32:40.749 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:32:40.750 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:32:40.750 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:32:40.750 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:32:40.750 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:32:40.750 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:32:40.750 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:32:40.750 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:32:40.750 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:32:40.750 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:32:40.755 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:32:40.756 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:32:40.756 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:32:40.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:40.885+0000 7fc969711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:40.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:40.896+0000 7fc969711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:41.000 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:32:41.000 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:32:41.000 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:32:41.001 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:32:41.001 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:32:41.001 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:32:41.001 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:32:41.001 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:32:41.001 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:32:41.001 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:32:41.001 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:32:41.001 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:32:41.005 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:32:41.005 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:32:41.006 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:32:41.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:41.155+0000 7fc5568ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:41.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:41.171+0000 7fc5568ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:41.215 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:32:41.215 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:32:41.215 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:32:41.215 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:32:41.215 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:32:41.215 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:32:41.215 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:32:41.215 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:32:41.215 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:32:41.215 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:32:41.216 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:32:41.216 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:32:41.219 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:32:41.220 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:32:41.220 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:32:41.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:41.375+0000 7fc9af191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:41.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:41.386+0000 7fc9af191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:41.442 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 42 16 7490 7474 11.1211 10.625 0.0868999 0.0897815 2024-09-15T12:32:41.485 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:32:41.485 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:32:41.485 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:32:41.485 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:32:41.485 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:32:41.485 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:32:41.485 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:32:41.485 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:32:41.485 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:32:41.485 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:32:41.485 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:32:41.485 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:32:41.490 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:32:41.490 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:32:41.558 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:32:41.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:41.710+0000 7f563b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:41.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:41.717+0000 7f563b591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:42.442 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 43 16 7665 7649 11.1168 10.9375 0.0708986 0.0898472 2024-09-15T12:32:43.443 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 44 16 7833 7817 11.1027 10.5 0.102373 0.0899379 2024-09-15T12:32:44.145 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:32:44.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:44.274+0000 7f4cd7d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:44.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:44.281+0000 7f4cd7d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:44.442 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 45 16 8002 7986 11.0907 10.5625 0.0794423 0.0900458 2024-09-15T12:32:45.443 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 46 16 8166 8150 11.0724 10.25 0.0963956 0.0901998 2024-09-15T12:32:46.443 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 47 16 8329 8313 11.0536 10.1875 0.0755874 0.0903712 2024-09-15T12:32:46.491 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:32:46.491 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:32:46.492 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:32:46.635 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:32:46.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:46.638+0000 7fde816bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:46.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:46.649+0000 7fde816bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:46.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:46.787+0000 7f535df91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:46.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:46.794+0000 7f535df91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:46.924 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:32:46.925 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:32:46.947 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":511,"stamp":"2024-09-15T12:32:45.870191+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":487916083,"num_objects":7440,"num_object_clones":0,"num_object_copies":22320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":7517,"num_write_kb":477012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7491,"ondisk_log_size":7491,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":423772,"kb_used_data":91864,"kb_used_omap":0,"kb_used_meta":331840,"kb_avail":377063588,"statfs":{"total":386547056640,"available":386113114112,"internally_reserved":0,"allocated":94068736,"data_stored":1453299837,"data_compressed":68955326,"data_compressed_allocated":90767360,"data_compressed_original":1452032000,"omap_allocated":0,"internal_metadata":339804160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":347406336,"num_objects":5301,"num_object_clones":0,"num_object_copies":15903,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5301,"num_write_kb":339264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002487"},"pg_stats":[{"pgid":"7.f","version":"96'465","reported_seq":477,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:41.663126+0000","last_change":"2024-09-15T12:31:58.539371+0000","last_active":"2024-09-15T12:32:41.663126+0000","last_peered":"2024-09-15T12:32:41.663126+0000","last_clean":"2024-09-15T12:32:41.663126+0000","last_became_active":"2024-09-15T12:31:58.529616+0000","last_became_peered":"2024-09-15T12:31:58.529616+0000","last_unstale":"2024-09-15T12:32:41.663126+0000","last_undegraded":"2024-09-15T12:32:41.663126+0000","last_fullsized":"2024-09-15T12:32:41.663126+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30474240,"num_objects":465,"num_object_clones":0,"num_object_copies":1395,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":465,"num_write_kb":29760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"96'435","reported_seq":447,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.711129+0000","last_change":"2024-09-15T12:31:58.494396+0000","last_active":"2024-09-15T12:32:40.711129+0000","last_peered":"2024-09-15T12:32:40.711129+0000","last_clean":"2024-09-15T12:32:40.711129+0000","last_became_active":"2024-09-15T12:31:58.482932+0000","last_became_peered":"2024-09-15T12:31:58.482932+0000","last_unstale":"2024-09-15T12:32:40.711129+0000","last_undegraded":"2024-09-15T12:32:40.711129+0000","last_fullsized":"2024-09-15T12:32:40.711129+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"96'435","reported_seq":447,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.711493+0000","last_change":"2024-09-15T12:31:58.494069+0000","last_active":"2024-09-15T12:32:40.711493+0000","last_peered":"2024-09-15T12:32:40.711493+0000","last_clean":"2024-09-15T12:32:40.711493+0000","last_became_active":"2024-09-15T12:31:58.483561+0000","last_became_peered":"2024-09-15T12:31:58.483561+0000","last_unstale":"2024-09-15T12:32:40.711493+0000","last_undegraded":"2024-09-15T12:32:40.711493+0000","last_fullsized":"2024-09-15T12:32:40.711493+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"96'417","reported_seq":429,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.699174+0000","last_change":"2024-09-15T12:31:58.531562+0000","last_active":"2024-09-15T12:32:40.699174+0000","last_peered":"2024-09-15T12:32:40.699174+0000","last_clean":"2024-09-15T12:32:40.699174+0000","last_became_active":"2024-09-15T12:31:58.525598+0000","last_became_peered":"2024-09-15T12:31:58.525598+0000","last_unstale":"2024-09-15T12:32:40.699174+0000","last_undegraded":"2024-09-15T12:32:40.699174+0000","last_fullsized":"2024-09-15T12:32:40.699174+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27328512,"num_objects":417,"num_object_clones":0,"num_object_copies":1251,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":417,"num_write_kb":26688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"96'455","reported_seq":467,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:41.720532+0000","last_change":"2024-09-15T12:31:58.544695+0000","last_active":"2024-09-15T12:32:41.720532+0000","last_peered":"2024-09-15T12:32:41.720532+0000","last_clean":"2024-09-15T12:32:41.720532+0000","last_became_active":"2024-09-15T12:31:58.536224+0000","last_became_peered":"2024-09-15T12:31:58.536224+0000","last_unstale":"2024-09-15T12:32:41.720532+0000","last_undegraded":"2024-09-15T12:32:41.720532+0000","last_fullsized":"2024-09-15T12:32:41.720532+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29818880,"num_objects":455,"num_object_clones":0,"num_object_copies":1365,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":455,"num_write_kb":29120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"96'510","reported_seq":522,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:41.581549+0000","last_change":"2024-09-15T12:31:58.503374+0000","last_active":"2024-09-15T12:32:41.581549+0000","last_peered":"2024-09-15T12:32:41.581549+0000","last_clean":"2024-09-15T12:32:41.581549+0000","last_became_active":"2024-09-15T12:31:58.483732+0000","last_became_peered":"2024-09-15T12:31:58.483732+0000","last_unstale":"2024-09-15T12:32:41.581549+0000","last_undegraded":"2024-09-15T12:32:41.581549+0000","last_fullsized":"2024-09-15T12:32:41.581549+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33423360,"num_objects":510,"num_object_clones":0,"num_object_copies":1530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":510,"num_write_kb":32640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"96'488","reported_seq":500,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.371153+0000","last_change":"2024-09-15T12:31:58.497018+0000","last_active":"2024-09-15T12:32:40.371153+0000","last_peered":"2024-09-15T12:32:40.371153+0000","last_clean":"2024-09-15T12:32:40.371153+0000","last_became_active":"2024-09-15T12:31:58.489173+0000","last_became_peered":"2024-09-15T12:31:58.489173+0000","last_unstale":"2024-09-15T12:32:40.371153+0000","last_undegraded":"2024-09-15T12:32:40.371153+0000","last_fullsized":"2024-09-15T12:32:40.371153+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31981568,"num_objects":488,"num_object_clones":0,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"96'472","reported_seq":484,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.608640+0000","last_change":"2024-09-15T12:31:58.524969+0000","last_active":"2024-09-15T12:32:40.608640+0000","last_peered":"2024-09-15T12:32:40.608640+0000","last_clean":"2024-09-15T12:32:40.608640+0000","last_became_active":"2024-09-15T12:31:58.516994+0000","last_became_peered":"2024-09-15T12:31:58.516994+0000","last_unstale":"2024-09-15T12:32:40.608640+0000","last_undegraded":"2024-09-15T12:32:40.608640+0000","last_fullsized":"2024-09-15T12:32:40.608640+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30932992,"num_objects":472,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":30208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"96'445","reported_seq":457,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:41.784572+0000","last_change":"2024-09-15T12:31:58.495776+0000","last_active":"2024-09-15T12:32:41.784572+0000","last_peered":"2024-09-15T12:32:41.784572+0000","last_clean":"2024-09-15T12:32:41.784572+0000","last_became_active":"2024-09-15T12:31:58.474993+0000","last_became_peered":"2024-09-15T12:31:58.474993+0000","last_unstale":"2024-09-15T12:32:41.784572+0000","last_undegraded":"2024-09-15T12:32:41.784572+0000","last_fullsized":"2024-09-15T12:32:41.784572+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":445,"num_write_kb":28480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":331,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.358933+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:31:59.358933+0000","last_peered":"2024-09-15T12:31:59.358933+0000","last_clean":"2024-09-15T12:31:59.358933+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:31:59.358933+0000","last_undegraded":"2024-09-15T12:31:59.358933+0000","last_fullsized":"2024-09-15T12:31:59.358933+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":260,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.365124+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:31:59.365124+0000","last_peered":"2024-09-15T12:31:59.365124+0000","last_clean":"2024-09-15T12:31:59.365124+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:31:59.365124+0000","last_undegraded":"2024-09-15T12:31:59.365124+0000","last_fullsized":"2024-09-15T12:31:59.365124+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"96'489","reported_seq":501,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.727538+0000","last_change":"2024-09-15T12:31:58.498915+0000","last_active":"2024-09-15T12:32:40.727538+0000","last_peered":"2024-09-15T12:32:40.727538+0000","last_clean":"2024-09-15T12:32:40.727538+0000","last_became_active":"2024-09-15T12:31:58.487521+0000","last_became_peered":"2024-09-15T12:31:58.487521+0000","last_unstale":"2024-09-15T12:32:40.727538+0000","last_undegraded":"2024-09-15T12:32:40.727538+0000","last_fullsized":"2024-09-15T12:32:40.727538+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32047104,"num_objects":489,"num_object_clones":0,"num_object_copies":1467,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":489,"num_write_kb":31296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.364819+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:31:59.364819+0000","last_peered":"2024-09-15T12:31:59.364819+0000","last_clean":"2024-09-15T12:31:59.364819+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:31:59.364819+0000","last_undegraded":"2024-09-15T12:31:59.364819+0000","last_fullsized":"2024-09-15T12:31:59.364819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"96'467","reported_seq":479,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.750722+0000","last_change":"2024-09-15T12:31:58.468104+0000","last_active":"2024-09-15T12:32:40.750722+0000","last_peered":"2024-09-15T12:32:40.750722+0000","last_clean":"2024-09-15T12:32:40.750722+0000","last_became_active":"2024-09-15T12:31:58.462443+0000","last_became_peered":"2024-09-15T12:31:58.462443+0000","last_unstale":"2024-09-15T12:32:40.750722+0000","last_undegraded":"2024-09-15T12:32:40.750722+0000","last_fullsized":"2024-09-15T12:32:40.750722+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30605312,"num_objects":467,"num_object_clones":0,"num_object_copies":1401,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":467,"num_write_kb":29888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.356572+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:31:59.356572+0000","last_peered":"2024-09-15T12:31:59.356572+0000","last_clean":"2024-09-15T12:31:59.356572+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:31:59.356572+0000","last_undegraded":"2024-09-15T12:31:59.356572+0000","last_fullsized":"2024-09-15T12:31:59.356572+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"96'440","reported_seq":452,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.657567+0000","last_change":"2024-09-15T12:31:58.480532+0000","last_active":"2024-09-15T12:32:40.657567+0000","last_peered":"2024-09-15T12:32:40.657567+0000","last_clean":"2024-09-15T12:32:40.657567+0000","last_became_active":"2024-09-15T12:31:58.468452+0000","last_became_peered":"2024-09-15T12:31:58.468452+0000","last_unstale":"2024-09-15T12:32:40.657567+0000","last_undegraded":"2024-09-15T12:32:40.657567+0000","last_fullsized":"2024-09-15T12:32:40.657567+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28835840,"num_objects":440,"num_object_clones":0,"num_object_copies":1320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":28160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":261,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.358054+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:31:59.358054+0000","last_peered":"2024-09-15T12:31:59.358054+0000","last_clean":"2024-09-15T12:31:59.358054+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:31:59.358054+0000","last_undegraded":"2024-09-15T12:31:59.358054+0000","last_fullsized":"2024-09-15T12:31:59.358054+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"96'490","reported_seq":502,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.503121+0000","last_change":"2024-09-15T12:31:58.472814+0000","last_active":"2024-09-15T12:32:40.503121+0000","last_peered":"2024-09-15T12:32:40.503121+0000","last_clean":"2024-09-15T12:32:40.503121+0000","last_became_active":"2024-09-15T12:31:58.466600+0000","last_became_peered":"2024-09-15T12:31:58.466600+0000","last_unstale":"2024-09-15T12:32:40.503121+0000","last_undegraded":"2024-09-15T12:32:40.503121+0000","last_fullsized":"2024-09-15T12:32:40.503121+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":490,"num_write_kb":31360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.362774+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:31:59.362774+0000","last_peered":"2024-09-15T12:31:59.362774+0000","last_clean":"2024-09-15T12:31:59.362774+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:31:59.362774+0000","last_undegraded":"2024-09-15T12:31:59.362774+0000","last_fullsized":"2024-09-15T12:31:59.362774+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"96'489","reported_seq":501,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.447008+0000","last_change":"2024-09-15T12:31:58.435605+0000","last_active":"2024-09-15T12:32:40.447008+0000","last_peered":"2024-09-15T12:32:40.447008+0000","last_clean":"2024-09-15T12:32:40.447008+0000","last_became_active":"2024-09-15T12:31:58.429332+0000","last_became_peered":"2024-09-15T12:31:58.429332+0000","last_unstale":"2024-09-15T12:32:40.447008+0000","last_undegraded":"2024-09-15T12:32:40.447008+0000","last_fullsized":"2024-09-15T12:32:40.447008+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32047104,"num_objects":489,"num_object_clones":0,"num_object_copies":1467,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":489,"num_write_kb":31296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.360240+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:31:59.360240+0000","last_peered":"2024-09-15T12:31:59.360240+0000","last_clean":"2024-09-15T12:31:59.360240+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:31:59.360240+0000","last_undegraded":"2024-09-15T12:31:59.360240+0000","last_fullsized":"2024-09-15T12:31:59.360240+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"96'462","reported_seq":474,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:41.604188+0000","last_change":"2024-09-15T12:31:58.492392+0000","last_active":"2024-09-15T12:32:41.604188+0000","last_peered":"2024-09-15T12:32:41.604188+0000","last_clean":"2024-09-15T12:32:41.604188+0000","last_became_active":"2024-09-15T12:31:58.466633+0000","last_became_peered":"2024-09-15T12:31:58.466633+0000","last_unstale":"2024-09-15T12:32:41.604188+0000","last_undegraded":"2024-09-15T12:32:41.604188+0000","last_fullsized":"2024-09-15T12:32:41.604188+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":462,"num_write_kb":29568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.360118+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:31:59.360118+0000","last_peered":"2024-09-15T12:31:59.360118+0000","last_clean":"2024-09-15T12:31:59.360118+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:31:59.360118+0000","last_undegraded":"2024-09-15T12:31:59.360118+0000","last_fullsized":"2024-09-15T12:31:59.360118+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"96'477","reported_seq":489,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:41.495004+0000","last_change":"2024-09-15T12:31:58.524245+0000","last_active":"2024-09-15T12:32:41.495004+0000","last_peered":"2024-09-15T12:32:41.495004+0000","last_clean":"2024-09-15T12:32:41.495004+0000","last_became_active":"2024-09-15T12:31:58.516700+0000","last_became_peered":"2024-09-15T12:31:58.516700+0000","last_unstale":"2024-09-15T12:32:41.495004+0000","last_undegraded":"2024-09-15T12:32:41.495004+0000","last_fullsized":"2024-09-15T12:32:41.495004+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31260672,"num_objects":477,"num_object_clones":0,"num_object_copies":1431,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":477,"num_write_kb":30528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.363584+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:31:59.363584+0000","last_peered":"2024-09-15T12:31:59.363584+0000","last_clean":"2024-09-15T12:31:59.363584+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:31:59.363584+0000","last_undegraded":"2024-09-15T12:31:59.363584+0000","last_fullsized":"2024-09-15T12:31:59.363584+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":487325696,"num_objects":7436,"num_object_clones":0,"num_object_copies":22308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7436,"num_write_kb":475904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":91279360,"data_stored":1460469760,"data_compressed":69347590,"data_compressed_allocated":91279360,"data_compressed_original":1460469760,"omap_allocated":0,"internal_metadata":0},"log_size":7436,"ondisk_log_size":7436,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673798,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59456,"kb_used_data":29232,"kb_used_omap":0,"kb_used_meta":30208,"kb_avail":94312384,"statfs":{"total":96636764160,"available":96575881216,"internally_reserved":0,"allocated":29933568,"data_stored":465938073,"data_compressed":22111738,"data_compressed_allocated":29106176,"data_compressed_original":465616896,"omap_allocated":0,"internal_metadata":30932992},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706502,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":151196,"kb_used_data":17484,"kb_used_omap":0,"kb_used_meta":133696,"kb_avail":94220644,"statfs":{"total":96636764160,"available":96481939456,"internally_reserved":0,"allocated":17903616,"data_stored":273393324,"data_compressed":12969082,"data_compressed_allocated":17072128,"data_compressed_original":273072128,"omap_allocated":0,"internal_metadata":136904704},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706502,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":158236,"kb_used_data":24524,"kb_used_omap":0,"kb_used_meta":133696,"kb_avail":94213604,"statfs":{"total":96636764160,"available":96474730496,"internally_reserved":0,"allocated":25112576,"data_stored":389129356,"data_compressed":18462590,"data_compressed_allocated":24301568,"data_compressed_original":388825088,"omap_allocated":0,"internal_metadata":136904704},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706501,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54884,"kb_used_data":20624,"kb_used_omap":0,"kb_used_meta":34240,"kb_avail":94316956,"statfs":{"total":96636764160,"available":96580562944,"internally_reserved":0,"allocated":21118976,"data_stored":324839084,"data_compressed":15411916,"data_compressed_allocated":20287488,"data_compressed_original":324517888,"omap_allocated":0,"internal_metadata":35061760},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20709376,"data_stored":331350016,"data_compressed":15733540,"data_compressed_allocated":20709376,"data_compressed_original":331350016,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24379392,"data_stored":390070272,"data_compressed":18521718,"data_compressed_allocated":24379392,"data_compressed_original":390070272,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17088512,"data_stored":273416192,"data_compressed":12982618,"data_compressed_allocated":17088512,"data_compressed_original":273416192,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29102080,"data_stored":465633280,"data_compressed":22109714,"data_compressed_allocated":29102080,"data_compressed_original":465633280,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:32:47.443 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 48 16 8492 8476 11.0355 10.1875 0.0775138 0.0905138 2024-09-15T12:32:48.443 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 49 16 8673 8657 11.0411 11.3125 0.0661216 0.0904639 2024-09-15T12:32:49.093 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:32:49.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:49.220+0000 7f14aea46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:49.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:49.229+0000 7f14aea46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:49.443 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 50 16 8843 8827 11.0328 10.625 0.0744648 0.0905361 2024-09-15T12:32:50.443 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 51 16 9027 9011 11.0419 11.5 0.0632551 0.0904633 2024-09-15T12:32:51.443 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 52 16 9212 9196 11.0519 11.5625 0.107425 0.0903878 2024-09-15T12:32:51.496 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:32:51.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:51.638+0000 7f029b65a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:51.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:51.649+0000 7f029b65a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:51.949 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:32:51.949 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:32:51.949 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:32:52.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:52.080+0000 7f7564151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:52.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:52.089+0000 7f7564151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:52.363 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:32:52.363 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:32:52.383 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":514,"stamp":"2024-09-15T12:32:51.871414+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":487916083,"num_objects":7440,"num_object_clones":0,"num_object_copies":22320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":7517,"num_write_kb":477012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7491,"ondisk_log_size":7491,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":423772,"kb_used_data":91864,"kb_used_omap":0,"kb_used_meta":331840,"kb_avail":377063588,"statfs":{"total":386547056640,"available":386113114112,"internally_reserved":0,"allocated":94068736,"data_stored":1453299837,"data_compressed":68955326,"data_compressed_allocated":90767360,"data_compressed_original":1452032000,"omap_allocated":0,"internal_metadata":339804160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":347406336,"num_objects":5301,"num_object_clones":0,"num_object_copies":15903,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5301,"num_write_kb":339264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002484"},"pg_stats":[{"pgid":"7.f","version":"96'465","reported_seq":477,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:41.663126+0000","last_change":"2024-09-15T12:31:58.539371+0000","last_active":"2024-09-15T12:32:41.663126+0000","last_peered":"2024-09-15T12:32:41.663126+0000","last_clean":"2024-09-15T12:32:41.663126+0000","last_became_active":"2024-09-15T12:31:58.529616+0000","last_became_peered":"2024-09-15T12:31:58.529616+0000","last_unstale":"2024-09-15T12:32:41.663126+0000","last_undegraded":"2024-09-15T12:32:41.663126+0000","last_fullsized":"2024-09-15T12:32:41.663126+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30474240,"num_objects":465,"num_object_clones":0,"num_object_copies":1395,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":465,"num_write_kb":29760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"96'435","reported_seq":447,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.711129+0000","last_change":"2024-09-15T12:31:58.494396+0000","last_active":"2024-09-15T12:32:40.711129+0000","last_peered":"2024-09-15T12:32:40.711129+0000","last_clean":"2024-09-15T12:32:40.711129+0000","last_became_active":"2024-09-15T12:31:58.482932+0000","last_became_peered":"2024-09-15T12:31:58.482932+0000","last_unstale":"2024-09-15T12:32:40.711129+0000","last_undegraded":"2024-09-15T12:32:40.711129+0000","last_fullsized":"2024-09-15T12:32:40.711129+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"96'435","reported_seq":447,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.711493+0000","last_change":"2024-09-15T12:31:58.494069+0000","last_active":"2024-09-15T12:32:40.711493+0000","last_peered":"2024-09-15T12:32:40.711493+0000","last_clean":"2024-09-15T12:32:40.711493+0000","last_became_active":"2024-09-15T12:31:58.483561+0000","last_became_peered":"2024-09-15T12:31:58.483561+0000","last_unstale":"2024-09-15T12:32:40.711493+0000","last_undegraded":"2024-09-15T12:32:40.711493+0000","last_fullsized":"2024-09-15T12:32:40.711493+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"96'417","reported_seq":429,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.699174+0000","last_change":"2024-09-15T12:31:58.531562+0000","last_active":"2024-09-15T12:32:40.699174+0000","last_peered":"2024-09-15T12:32:40.699174+0000","last_clean":"2024-09-15T12:32:40.699174+0000","last_became_active":"2024-09-15T12:31:58.525598+0000","last_became_peered":"2024-09-15T12:31:58.525598+0000","last_unstale":"2024-09-15T12:32:40.699174+0000","last_undegraded":"2024-09-15T12:32:40.699174+0000","last_fullsized":"2024-09-15T12:32:40.699174+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27328512,"num_objects":417,"num_object_clones":0,"num_object_copies":1251,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":417,"num_write_kb":26688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"96'455","reported_seq":467,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:41.720532+0000","last_change":"2024-09-15T12:31:58.544695+0000","last_active":"2024-09-15T12:32:41.720532+0000","last_peered":"2024-09-15T12:32:41.720532+0000","last_clean":"2024-09-15T12:32:41.720532+0000","last_became_active":"2024-09-15T12:31:58.536224+0000","last_became_peered":"2024-09-15T12:31:58.536224+0000","last_unstale":"2024-09-15T12:32:41.720532+0000","last_undegraded":"2024-09-15T12:32:41.720532+0000","last_fullsized":"2024-09-15T12:32:41.720532+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29818880,"num_objects":455,"num_object_clones":0,"num_object_copies":1365,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":455,"num_write_kb":29120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"96'510","reported_seq":522,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:41.581549+0000","last_change":"2024-09-15T12:31:58.503374+0000","last_active":"2024-09-15T12:32:41.581549+0000","last_peered":"2024-09-15T12:32:41.581549+0000","last_clean":"2024-09-15T12:32:41.581549+0000","last_became_active":"2024-09-15T12:31:58.483732+0000","last_became_peered":"2024-09-15T12:31:58.483732+0000","last_unstale":"2024-09-15T12:32:41.581549+0000","last_undegraded":"2024-09-15T12:32:41.581549+0000","last_fullsized":"2024-09-15T12:32:41.581549+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33423360,"num_objects":510,"num_object_clones":0,"num_object_copies":1530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":510,"num_write_kb":32640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"96'488","reported_seq":500,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.371153+0000","last_change":"2024-09-15T12:31:58.497018+0000","last_active":"2024-09-15T12:32:40.371153+0000","last_peered":"2024-09-15T12:32:40.371153+0000","last_clean":"2024-09-15T12:32:40.371153+0000","last_became_active":"2024-09-15T12:31:58.489173+0000","last_became_peered":"2024-09-15T12:31:58.489173+0000","last_unstale":"2024-09-15T12:32:40.371153+0000","last_undegraded":"2024-09-15T12:32:40.371153+0000","last_fullsized":"2024-09-15T12:32:40.371153+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31981568,"num_objects":488,"num_object_clones":0,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"96'472","reported_seq":484,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.608640+0000","last_change":"2024-09-15T12:31:58.524969+0000","last_active":"2024-09-15T12:32:40.608640+0000","last_peered":"2024-09-15T12:32:40.608640+0000","last_clean":"2024-09-15T12:32:40.608640+0000","last_became_active":"2024-09-15T12:31:58.516994+0000","last_became_peered":"2024-09-15T12:31:58.516994+0000","last_unstale":"2024-09-15T12:32:40.608640+0000","last_undegraded":"2024-09-15T12:32:40.608640+0000","last_fullsized":"2024-09-15T12:32:40.608640+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30932992,"num_objects":472,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":30208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"96'445","reported_seq":457,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:41.784572+0000","last_change":"2024-09-15T12:31:58.495776+0000","last_active":"2024-09-15T12:32:41.784572+0000","last_peered":"2024-09-15T12:32:41.784572+0000","last_clean":"2024-09-15T12:32:41.784572+0000","last_became_active":"2024-09-15T12:31:58.474993+0000","last_became_peered":"2024-09-15T12:31:58.474993+0000","last_unstale":"2024-09-15T12:32:41.784572+0000","last_undegraded":"2024-09-15T12:32:41.784572+0000","last_fullsized":"2024-09-15T12:32:41.784572+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":445,"num_write_kb":28480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":331,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.358933+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:31:59.358933+0000","last_peered":"2024-09-15T12:31:59.358933+0000","last_clean":"2024-09-15T12:31:59.358933+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:31:59.358933+0000","last_undegraded":"2024-09-15T12:31:59.358933+0000","last_fullsized":"2024-09-15T12:31:59.358933+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":260,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.365124+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:31:59.365124+0000","last_peered":"2024-09-15T12:31:59.365124+0000","last_clean":"2024-09-15T12:31:59.365124+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:31:59.365124+0000","last_undegraded":"2024-09-15T12:31:59.365124+0000","last_fullsized":"2024-09-15T12:31:59.365124+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"96'489","reported_seq":501,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.727538+0000","last_change":"2024-09-15T12:31:58.498915+0000","last_active":"2024-09-15T12:32:40.727538+0000","last_peered":"2024-09-15T12:32:40.727538+0000","last_clean":"2024-09-15T12:32:40.727538+0000","last_became_active":"2024-09-15T12:31:58.487521+0000","last_became_peered":"2024-09-15T12:31:58.487521+0000","last_unstale":"2024-09-15T12:32:40.727538+0000","last_undegraded":"2024-09-15T12:32:40.727538+0000","last_fullsized":"2024-09-15T12:32:40.727538+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32047104,"num_objects":489,"num_object_clones":0,"num_object_copies":1467,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":489,"num_write_kb":31296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.364819+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:31:59.364819+0000","last_peered":"2024-09-15T12:31:59.364819+0000","last_clean":"2024-09-15T12:31:59.364819+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:31:59.364819+0000","last_undegraded":"2024-09-15T12:31:59.364819+0000","last_fullsized":"2024-09-15T12:31:59.364819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"96'467","reported_seq":479,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.750722+0000","last_change":"2024-09-15T12:31:58.468104+0000","last_active":"2024-09-15T12:32:40.750722+0000","last_peered":"2024-09-15T12:32:40.750722+0000","last_clean":"2024-09-15T12:32:40.750722+0000","last_became_active":"2024-09-15T12:31:58.462443+0000","last_became_peered":"2024-09-15T12:31:58.462443+0000","last_unstale":"2024-09-15T12:32:40.750722+0000","last_undegraded":"2024-09-15T12:32:40.750722+0000","last_fullsized":"2024-09-15T12:32:40.750722+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30605312,"num_objects":467,"num_object_clones":0,"num_object_copies":1401,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":467,"num_write_kb":29888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.356572+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:31:59.356572+0000","last_peered":"2024-09-15T12:31:59.356572+0000","last_clean":"2024-09-15T12:31:59.356572+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:31:59.356572+0000","last_undegraded":"2024-09-15T12:31:59.356572+0000","last_fullsized":"2024-09-15T12:31:59.356572+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"96'440","reported_seq":452,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.657567+0000","last_change":"2024-09-15T12:31:58.480532+0000","last_active":"2024-09-15T12:32:40.657567+0000","last_peered":"2024-09-15T12:32:40.657567+0000","last_clean":"2024-09-15T12:32:40.657567+0000","last_became_active":"2024-09-15T12:31:58.468452+0000","last_became_peered":"2024-09-15T12:31:58.468452+0000","last_unstale":"2024-09-15T12:32:40.657567+0000","last_undegraded":"2024-09-15T12:32:40.657567+0000","last_fullsized":"2024-09-15T12:32:40.657567+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28835840,"num_objects":440,"num_object_clones":0,"num_object_copies":1320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":28160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":261,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.358054+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:31:59.358054+0000","last_peered":"2024-09-15T12:31:59.358054+0000","last_clean":"2024-09-15T12:31:59.358054+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:31:59.358054+0000","last_undegraded":"2024-09-15T12:31:59.358054+0000","last_fullsized":"2024-09-15T12:31:59.358054+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"96'490","reported_seq":502,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.503121+0000","last_change":"2024-09-15T12:31:58.472814+0000","last_active":"2024-09-15T12:32:40.503121+0000","last_peered":"2024-09-15T12:32:40.503121+0000","last_clean":"2024-09-15T12:32:40.503121+0000","last_became_active":"2024-09-15T12:31:58.466600+0000","last_became_peered":"2024-09-15T12:31:58.466600+0000","last_unstale":"2024-09-15T12:32:40.503121+0000","last_undegraded":"2024-09-15T12:32:40.503121+0000","last_fullsized":"2024-09-15T12:32:40.503121+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":490,"num_write_kb":31360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.362774+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:31:59.362774+0000","last_peered":"2024-09-15T12:31:59.362774+0000","last_clean":"2024-09-15T12:31:59.362774+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:31:59.362774+0000","last_undegraded":"2024-09-15T12:31:59.362774+0000","last_fullsized":"2024-09-15T12:31:59.362774+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"96'489","reported_seq":501,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.447008+0000","last_change":"2024-09-15T12:31:58.435605+0000","last_active":"2024-09-15T12:32:40.447008+0000","last_peered":"2024-09-15T12:32:40.447008+0000","last_clean":"2024-09-15T12:32:40.447008+0000","last_became_active":"2024-09-15T12:31:58.429332+0000","last_became_peered":"2024-09-15T12:31:58.429332+0000","last_unstale":"2024-09-15T12:32:40.447008+0000","last_undegraded":"2024-09-15T12:32:40.447008+0000","last_fullsized":"2024-09-15T12:32:40.447008+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32047104,"num_objects":489,"num_object_clones":0,"num_object_copies":1467,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":489,"num_write_kb":31296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.360240+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:31:59.360240+0000","last_peered":"2024-09-15T12:31:59.360240+0000","last_clean":"2024-09-15T12:31:59.360240+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:31:59.360240+0000","last_undegraded":"2024-09-15T12:31:59.360240+0000","last_fullsized":"2024-09-15T12:31:59.360240+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"96'462","reported_seq":474,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:41.604188+0000","last_change":"2024-09-15T12:31:58.492392+0000","last_active":"2024-09-15T12:32:41.604188+0000","last_peered":"2024-09-15T12:32:41.604188+0000","last_clean":"2024-09-15T12:32:41.604188+0000","last_became_active":"2024-09-15T12:31:58.466633+0000","last_became_peered":"2024-09-15T12:31:58.466633+0000","last_unstale":"2024-09-15T12:32:41.604188+0000","last_undegraded":"2024-09-15T12:32:41.604188+0000","last_fullsized":"2024-09-15T12:32:41.604188+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":462,"num_write_kb":29568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.360118+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:31:59.360118+0000","last_peered":"2024-09-15T12:31:59.360118+0000","last_clean":"2024-09-15T12:31:59.360118+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:31:59.360118+0000","last_undegraded":"2024-09-15T12:31:59.360118+0000","last_fullsized":"2024-09-15T12:31:59.360118+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"96'477","reported_seq":489,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:41.495004+0000","last_change":"2024-09-15T12:31:58.524245+0000","last_active":"2024-09-15T12:32:41.495004+0000","last_peered":"2024-09-15T12:32:41.495004+0000","last_clean":"2024-09-15T12:32:41.495004+0000","last_became_active":"2024-09-15T12:31:58.516700+0000","last_became_peered":"2024-09-15T12:31:58.516700+0000","last_unstale":"2024-09-15T12:32:41.495004+0000","last_undegraded":"2024-09-15T12:32:41.495004+0000","last_fullsized":"2024-09-15T12:32:41.495004+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31260672,"num_objects":477,"num_object_clones":0,"num_object_copies":1431,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":477,"num_write_kb":30528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.363584+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:31:59.363584+0000","last_peered":"2024-09-15T12:31:59.363584+0000","last_clean":"2024-09-15T12:31:59.363584+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:31:59.363584+0000","last_undegraded":"2024-09-15T12:31:59.363584+0000","last_fullsized":"2024-09-15T12:31:59.363584+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":487325696,"num_objects":7436,"num_object_clones":0,"num_object_copies":22308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7436,"num_write_kb":475904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":91279360,"data_stored":1460469760,"data_compressed":69347590,"data_compressed_allocated":91279360,"data_compressed_original":1460469760,"omap_allocated":0,"internal_metadata":0},"log_size":7436,"ondisk_log_size":7436,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673798,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59456,"kb_used_data":29232,"kb_used_omap":0,"kb_used_meta":30208,"kb_avail":94312384,"statfs":{"total":96636764160,"available":96575881216,"internally_reserved":0,"allocated":29933568,"data_stored":465938073,"data_compressed":22111738,"data_compressed_allocated":29106176,"data_compressed_original":465616896,"omap_allocated":0,"internal_metadata":30932992},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706502,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":151196,"kb_used_data":17484,"kb_used_omap":0,"kb_used_meta":133696,"kb_avail":94220644,"statfs":{"total":96636764160,"available":96481939456,"internally_reserved":0,"allocated":17903616,"data_stored":273393324,"data_compressed":12969082,"data_compressed_allocated":17072128,"data_compressed_original":273072128,"omap_allocated":0,"internal_metadata":136904704},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706502,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":158236,"kb_used_data":24524,"kb_used_omap":0,"kb_used_meta":133696,"kb_avail":94213604,"statfs":{"total":96636764160,"available":96474730496,"internally_reserved":0,"allocated":25112576,"data_stored":389129356,"data_compressed":18462590,"data_compressed_allocated":24301568,"data_compressed_original":388825088,"omap_allocated":0,"internal_metadata":136904704},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706501,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54884,"kb_used_data":20624,"kb_used_omap":0,"kb_used_meta":34240,"kb_avail":94316956,"statfs":{"total":96636764160,"available":96580562944,"internally_reserved":0,"allocated":21118976,"data_stored":324839084,"data_compressed":15411916,"data_compressed_allocated":20287488,"data_compressed_original":324517888,"omap_allocated":0,"internal_metadata":35061760},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20709376,"data_stored":331350016,"data_compressed":15733540,"data_compressed_allocated":20709376,"data_compressed_original":331350016,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24379392,"data_stored":390070272,"data_compressed":18521718,"data_compressed_allocated":24379392,"data_compressed_original":390070272,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17088512,"data_stored":273416192,"data_compressed":12982618,"data_compressed_allocated":17088512,"data_compressed_original":273416192,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29102080,"data_stored":465633280,"data_compressed":22109714,"data_compressed_allocated":29102080,"data_compressed_original":465633280,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:32:52.443 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 53 16 9372 9356 11.0321 10 0.0962851 0.0905615 2024-09-15T12:32:53.443 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 54 16 9545 9529 11.028 10.8125 0.0757276 0.0905498 2024-09-15T12:32:53.862 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:32:54.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:54.000+0000 7f6f28551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:54.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:54.010+0000 7f6f28551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:54.443 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 55 16 9707 9691 11.0115 10.125 0.127856 0.09068 2024-09-15T12:32:55.443 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 56 16 9871 9855 10.9979 10.25 0.136363 0.0908106 2024-09-15T12:32:56.387 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:32:56.443 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 57 16 10038 10022 10.9881 10.4375 0.0472097 0.0909202 2024-09-15T12:32:56.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:56.519+0000 7f0ef2111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:56.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:56.527+0000 7f0ef2111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:57.385 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:32:57.385 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:32:57.386 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:32:57.443 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 58 16 10212 10196 10.9861 10.875 0.0695666 0.0909441 2024-09-15T12:32:57.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:57.542+0000 7f58d9191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:57.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:57.552+0000 7f58d9191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:57.822 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:32:57.822 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:32:57.838 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":516,"stamp":"2024-09-15T12:32:55.872313+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":487916083,"num_objects":7440,"num_object_clones":0,"num_object_copies":22320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":7517,"num_write_kb":477012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7491,"ondisk_log_size":7491,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":423772,"kb_used_data":91864,"kb_used_omap":0,"kb_used_meta":331840,"kb_avail":377063588,"statfs":{"total":386547056640,"available":386113114112,"internally_reserved":0,"allocated":94068736,"data_stored":1453299837,"data_compressed":68955326,"data_compressed_allocated":90767360,"data_compressed_original":1452032000,"omap_allocated":0,"internal_metadata":339804160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002540"},"pg_stats":[{"pgid":"7.f","version":"96'465","reported_seq":477,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:41.663126+0000","last_change":"2024-09-15T12:31:58.539371+0000","last_active":"2024-09-15T12:32:41.663126+0000","last_peered":"2024-09-15T12:32:41.663126+0000","last_clean":"2024-09-15T12:32:41.663126+0000","last_became_active":"2024-09-15T12:31:58.529616+0000","last_became_peered":"2024-09-15T12:31:58.529616+0000","last_unstale":"2024-09-15T12:32:41.663126+0000","last_undegraded":"2024-09-15T12:32:41.663126+0000","last_fullsized":"2024-09-15T12:32:41.663126+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30474240,"num_objects":465,"num_object_clones":0,"num_object_copies":1395,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":465,"num_write_kb":29760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"96'435","reported_seq":447,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.711129+0000","last_change":"2024-09-15T12:31:58.494396+0000","last_active":"2024-09-15T12:32:40.711129+0000","last_peered":"2024-09-15T12:32:40.711129+0000","last_clean":"2024-09-15T12:32:40.711129+0000","last_became_active":"2024-09-15T12:31:58.482932+0000","last_became_peered":"2024-09-15T12:31:58.482932+0000","last_unstale":"2024-09-15T12:32:40.711129+0000","last_undegraded":"2024-09-15T12:32:40.711129+0000","last_fullsized":"2024-09-15T12:32:40.711129+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"96'435","reported_seq":447,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.711493+0000","last_change":"2024-09-15T12:31:58.494069+0000","last_active":"2024-09-15T12:32:40.711493+0000","last_peered":"2024-09-15T12:32:40.711493+0000","last_clean":"2024-09-15T12:32:40.711493+0000","last_became_active":"2024-09-15T12:31:58.483561+0000","last_became_peered":"2024-09-15T12:31:58.483561+0000","last_unstale":"2024-09-15T12:32:40.711493+0000","last_undegraded":"2024-09-15T12:32:40.711493+0000","last_fullsized":"2024-09-15T12:32:40.711493+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"96'417","reported_seq":429,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.699174+0000","last_change":"2024-09-15T12:31:58.531562+0000","last_active":"2024-09-15T12:32:40.699174+0000","last_peered":"2024-09-15T12:32:40.699174+0000","last_clean":"2024-09-15T12:32:40.699174+0000","last_became_active":"2024-09-15T12:31:58.525598+0000","last_became_peered":"2024-09-15T12:31:58.525598+0000","last_unstale":"2024-09-15T12:32:40.699174+0000","last_undegraded":"2024-09-15T12:32:40.699174+0000","last_fullsized":"2024-09-15T12:32:40.699174+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27328512,"num_objects":417,"num_object_clones":0,"num_object_copies":1251,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":417,"num_write_kb":26688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"96'455","reported_seq":467,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:41.720532+0000","last_change":"2024-09-15T12:31:58.544695+0000","last_active":"2024-09-15T12:32:41.720532+0000","last_peered":"2024-09-15T12:32:41.720532+0000","last_clean":"2024-09-15T12:32:41.720532+0000","last_became_active":"2024-09-15T12:31:58.536224+0000","last_became_peered":"2024-09-15T12:31:58.536224+0000","last_unstale":"2024-09-15T12:32:41.720532+0000","last_undegraded":"2024-09-15T12:32:41.720532+0000","last_fullsized":"2024-09-15T12:32:41.720532+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29818880,"num_objects":455,"num_object_clones":0,"num_object_copies":1365,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":455,"num_write_kb":29120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"96'510","reported_seq":522,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:41.581549+0000","last_change":"2024-09-15T12:31:58.503374+0000","last_active":"2024-09-15T12:32:41.581549+0000","last_peered":"2024-09-15T12:32:41.581549+0000","last_clean":"2024-09-15T12:32:41.581549+0000","last_became_active":"2024-09-15T12:31:58.483732+0000","last_became_peered":"2024-09-15T12:31:58.483732+0000","last_unstale":"2024-09-15T12:32:41.581549+0000","last_undegraded":"2024-09-15T12:32:41.581549+0000","last_fullsized":"2024-09-15T12:32:41.581549+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33423360,"num_objects":510,"num_object_clones":0,"num_object_copies":1530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":510,"num_write_kb":32640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"96'488","reported_seq":500,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.371153+0000","last_change":"2024-09-15T12:31:58.497018+0000","last_active":"2024-09-15T12:32:40.371153+0000","last_peered":"2024-09-15T12:32:40.371153+0000","last_clean":"2024-09-15T12:32:40.371153+0000","last_became_active":"2024-09-15T12:31:58.489173+0000","last_became_peered":"2024-09-15T12:31:58.489173+0000","last_unstale":"2024-09-15T12:32:40.371153+0000","last_undegraded":"2024-09-15T12:32:40.371153+0000","last_fullsized":"2024-09-15T12:32:40.371153+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31981568,"num_objects":488,"num_object_clones":0,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"96'472","reported_seq":484,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.608640+0000","last_change":"2024-09-15T12:31:58.524969+0000","last_active":"2024-09-15T12:32:40.608640+0000","last_peered":"2024-09-15T12:32:40.608640+0000","last_clean":"2024-09-15T12:32:40.608640+0000","last_became_active":"2024-09-15T12:31:58.516994+0000","last_became_peered":"2024-09-15T12:31:58.516994+0000","last_unstale":"2024-09-15T12:32:40.608640+0000","last_undegraded":"2024-09-15T12:32:40.608640+0000","last_fullsized":"2024-09-15T12:32:40.608640+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30932992,"num_objects":472,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":30208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"96'445","reported_seq":457,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:41.784572+0000","last_change":"2024-09-15T12:31:58.495776+0000","last_active":"2024-09-15T12:32:41.784572+0000","last_peered":"2024-09-15T12:32:41.784572+0000","last_clean":"2024-09-15T12:32:41.784572+0000","last_became_active":"2024-09-15T12:31:58.474993+0000","last_became_peered":"2024-09-15T12:31:58.474993+0000","last_unstale":"2024-09-15T12:32:41.784572+0000","last_undegraded":"2024-09-15T12:32:41.784572+0000","last_fullsized":"2024-09-15T12:32:41.784572+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":445,"num_write_kb":28480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":331,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.358933+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:31:59.358933+0000","last_peered":"2024-09-15T12:31:59.358933+0000","last_clean":"2024-09-15T12:31:59.358933+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:31:59.358933+0000","last_undegraded":"2024-09-15T12:31:59.358933+0000","last_fullsized":"2024-09-15T12:31:59.358933+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":260,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.365124+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:31:59.365124+0000","last_peered":"2024-09-15T12:31:59.365124+0000","last_clean":"2024-09-15T12:31:59.365124+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:31:59.365124+0000","last_undegraded":"2024-09-15T12:31:59.365124+0000","last_fullsized":"2024-09-15T12:31:59.365124+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"96'489","reported_seq":501,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.727538+0000","last_change":"2024-09-15T12:31:58.498915+0000","last_active":"2024-09-15T12:32:40.727538+0000","last_peered":"2024-09-15T12:32:40.727538+0000","last_clean":"2024-09-15T12:32:40.727538+0000","last_became_active":"2024-09-15T12:31:58.487521+0000","last_became_peered":"2024-09-15T12:31:58.487521+0000","last_unstale":"2024-09-15T12:32:40.727538+0000","last_undegraded":"2024-09-15T12:32:40.727538+0000","last_fullsized":"2024-09-15T12:32:40.727538+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32047104,"num_objects":489,"num_object_clones":0,"num_object_copies":1467,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":489,"num_write_kb":31296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.364819+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:31:59.364819+0000","last_peered":"2024-09-15T12:31:59.364819+0000","last_clean":"2024-09-15T12:31:59.364819+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:31:59.364819+0000","last_undegraded":"2024-09-15T12:31:59.364819+0000","last_fullsized":"2024-09-15T12:31:59.364819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"96'467","reported_seq":479,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.750722+0000","last_change":"2024-09-15T12:31:58.468104+0000","last_active":"2024-09-15T12:32:40.750722+0000","last_peered":"2024-09-15T12:32:40.750722+0000","last_clean":"2024-09-15T12:32:40.750722+0000","last_became_active":"2024-09-15T12:31:58.462443+0000","last_became_peered":"2024-09-15T12:31:58.462443+0000","last_unstale":"2024-09-15T12:32:40.750722+0000","last_undegraded":"2024-09-15T12:32:40.750722+0000","last_fullsized":"2024-09-15T12:32:40.750722+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30605312,"num_objects":467,"num_object_clones":0,"num_object_copies":1401,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":467,"num_write_kb":29888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.356572+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:31:59.356572+0000","last_peered":"2024-09-15T12:31:59.356572+0000","last_clean":"2024-09-15T12:31:59.356572+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:31:59.356572+0000","last_undegraded":"2024-09-15T12:31:59.356572+0000","last_fullsized":"2024-09-15T12:31:59.356572+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"96'440","reported_seq":452,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.657567+0000","last_change":"2024-09-15T12:31:58.480532+0000","last_active":"2024-09-15T12:32:40.657567+0000","last_peered":"2024-09-15T12:32:40.657567+0000","last_clean":"2024-09-15T12:32:40.657567+0000","last_became_active":"2024-09-15T12:31:58.468452+0000","last_became_peered":"2024-09-15T12:31:58.468452+0000","last_unstale":"2024-09-15T12:32:40.657567+0000","last_undegraded":"2024-09-15T12:32:40.657567+0000","last_fullsized":"2024-09-15T12:32:40.657567+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28835840,"num_objects":440,"num_object_clones":0,"num_object_copies":1320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":28160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":261,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.358054+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:31:59.358054+0000","last_peered":"2024-09-15T12:31:59.358054+0000","last_clean":"2024-09-15T12:31:59.358054+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:31:59.358054+0000","last_undegraded":"2024-09-15T12:31:59.358054+0000","last_fullsized":"2024-09-15T12:31:59.358054+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"96'490","reported_seq":502,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.503121+0000","last_change":"2024-09-15T12:31:58.472814+0000","last_active":"2024-09-15T12:32:40.503121+0000","last_peered":"2024-09-15T12:32:40.503121+0000","last_clean":"2024-09-15T12:32:40.503121+0000","last_became_active":"2024-09-15T12:31:58.466600+0000","last_became_peered":"2024-09-15T12:31:58.466600+0000","last_unstale":"2024-09-15T12:32:40.503121+0000","last_undegraded":"2024-09-15T12:32:40.503121+0000","last_fullsized":"2024-09-15T12:32:40.503121+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":490,"num_write_kb":31360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.362774+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:31:59.362774+0000","last_peered":"2024-09-15T12:31:59.362774+0000","last_clean":"2024-09-15T12:31:59.362774+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:31:59.362774+0000","last_undegraded":"2024-09-15T12:31:59.362774+0000","last_fullsized":"2024-09-15T12:31:59.362774+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"96'489","reported_seq":501,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.447008+0000","last_change":"2024-09-15T12:31:58.435605+0000","last_active":"2024-09-15T12:32:40.447008+0000","last_peered":"2024-09-15T12:32:40.447008+0000","last_clean":"2024-09-15T12:32:40.447008+0000","last_became_active":"2024-09-15T12:31:58.429332+0000","last_became_peered":"2024-09-15T12:31:58.429332+0000","last_unstale":"2024-09-15T12:32:40.447008+0000","last_undegraded":"2024-09-15T12:32:40.447008+0000","last_fullsized":"2024-09-15T12:32:40.447008+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32047104,"num_objects":489,"num_object_clones":0,"num_object_copies":1467,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":489,"num_write_kb":31296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.360240+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:31:59.360240+0000","last_peered":"2024-09-15T12:31:59.360240+0000","last_clean":"2024-09-15T12:31:59.360240+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:31:59.360240+0000","last_undegraded":"2024-09-15T12:31:59.360240+0000","last_fullsized":"2024-09-15T12:31:59.360240+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"96'462","reported_seq":474,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:41.604188+0000","last_change":"2024-09-15T12:31:58.492392+0000","last_active":"2024-09-15T12:32:41.604188+0000","last_peered":"2024-09-15T12:32:41.604188+0000","last_clean":"2024-09-15T12:32:41.604188+0000","last_became_active":"2024-09-15T12:31:58.466633+0000","last_became_peered":"2024-09-15T12:31:58.466633+0000","last_unstale":"2024-09-15T12:32:41.604188+0000","last_undegraded":"2024-09-15T12:32:41.604188+0000","last_fullsized":"2024-09-15T12:32:41.604188+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":462,"num_write_kb":29568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.360118+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:31:59.360118+0000","last_peered":"2024-09-15T12:31:59.360118+0000","last_clean":"2024-09-15T12:31:59.360118+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:31:59.360118+0000","last_undegraded":"2024-09-15T12:31:59.360118+0000","last_fullsized":"2024-09-15T12:31:59.360118+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"96'477","reported_seq":489,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:41.495004+0000","last_change":"2024-09-15T12:31:58.524245+0000","last_active":"2024-09-15T12:32:41.495004+0000","last_peered":"2024-09-15T12:32:41.495004+0000","last_clean":"2024-09-15T12:32:41.495004+0000","last_became_active":"2024-09-15T12:31:58.516700+0000","last_became_peered":"2024-09-15T12:31:58.516700+0000","last_unstale":"2024-09-15T12:32:41.495004+0000","last_undegraded":"2024-09-15T12:32:41.495004+0000","last_fullsized":"2024-09-15T12:32:41.495004+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31260672,"num_objects":477,"num_object_clones":0,"num_object_copies":1431,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":477,"num_write_kb":30528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.363584+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:31:59.363584+0000","last_peered":"2024-09-15T12:31:59.363584+0000","last_clean":"2024-09-15T12:31:59.363584+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:31:59.363584+0000","last_undegraded":"2024-09-15T12:31:59.363584+0000","last_fullsized":"2024-09-15T12:31:59.363584+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":487325696,"num_objects":7436,"num_object_clones":0,"num_object_copies":22308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7436,"num_write_kb":475904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":91279360,"data_stored":1460469760,"data_compressed":69347590,"data_compressed_allocated":91279360,"data_compressed_original":1460469760,"omap_allocated":0,"internal_metadata":0},"log_size":7436,"ondisk_log_size":7436,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673798,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59456,"kb_used_data":29232,"kb_used_omap":0,"kb_used_meta":30208,"kb_avail":94312384,"statfs":{"total":96636764160,"available":96575881216,"internally_reserved":0,"allocated":29933568,"data_stored":465938073,"data_compressed":22111738,"data_compressed_allocated":29106176,"data_compressed_original":465616896,"omap_allocated":0,"internal_metadata":30932992},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706502,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":151196,"kb_used_data":17484,"kb_used_omap":0,"kb_used_meta":133696,"kb_avail":94220644,"statfs":{"total":96636764160,"available":96481939456,"internally_reserved":0,"allocated":17903616,"data_stored":273393324,"data_compressed":12969082,"data_compressed_allocated":17072128,"data_compressed_original":273072128,"omap_allocated":0,"internal_metadata":136904704},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706502,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":158236,"kb_used_data":24524,"kb_used_omap":0,"kb_used_meta":133696,"kb_avail":94213604,"statfs":{"total":96636764160,"available":96474730496,"internally_reserved":0,"allocated":25112576,"data_stored":389129356,"data_compressed":18462590,"data_compressed_allocated":24301568,"data_compressed_original":388825088,"omap_allocated":0,"internal_metadata":136904704},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706501,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54884,"kb_used_data":20624,"kb_used_omap":0,"kb_used_meta":34240,"kb_avail":94316956,"statfs":{"total":96636764160,"available":96580562944,"internally_reserved":0,"allocated":21118976,"data_stored":324839084,"data_compressed":15411916,"data_compressed_allocated":20287488,"data_compressed_original":324517888,"omap_allocated":0,"internal_metadata":35061760},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20709376,"data_stored":331350016,"data_compressed":15733540,"data_compressed_allocated":20709376,"data_compressed_original":331350016,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24379392,"data_stored":390070272,"data_compressed":18521718,"data_compressed_allocated":24379392,"data_compressed_original":390070272,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17088512,"data_stored":273416192,"data_compressed":12982618,"data_compressed_allocated":17088512,"data_compressed_original":273416192,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29102080,"data_stored":465633280,"data_compressed":22109714,"data_compressed_allocated":29102080,"data_compressed_original":465633280,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:32:58.444 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 59 16 10394 10378 10.9927 11.375 0.049036 0.0909075 2024-09-15T12:32:58.921 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:32:59.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:59.061+0000 7fafb9f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:59.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:32:59.070+0000 7fafb9f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:32:59.444 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:2024-09-15T12:32:59.443417+0000 min lat: 0.0171244 max lat: 0.210036 avg lat: 0.0908493 2024-09-15T12:32:59.444 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-15T12:32:59.444 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 60 16 10574 10558 10.997 11.25 0.0789902 0.0908493 2024-09-15T12:33:00.444 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 61 16 10743 10727 10.9898 10.5625 0.0928305 0.090902 2024-09-15T12:33:01.444 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 62 16 10909 10893 10.9799 10.375 0.0758413 0.0910067 2024-09-15T12:33:01.557 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:33:01.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:01.704+0000 7fb1cc6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:01.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:01.710+0000 7fb1cc6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:02.444 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 63 16 11065 11049 10.9604 9.75 0.144413 0.0911534 2024-09-15T12:33:02.839 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:33:02.840 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:33:02.840 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:33:02.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:02.960+0000 7f9000046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:02.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:02.969+0000 7f9000046640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:03.225 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:33:03.225 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:33:03.247 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":519,"stamp":"2024-09-15T12:33:01.873581+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":487916083,"num_objects":7440,"num_object_clones":0,"num_object_copies":22320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":7517,"num_write_kb":477012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7491,"ondisk_log_size":7491,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":423772,"kb_used_data":91864,"kb_used_omap":0,"kb_used_meta":331840,"kb_avail":377063588,"statfs":{"total":386547056640,"available":386113114112,"internally_reserved":0,"allocated":94068736,"data_stored":1453299837,"data_compressed":68955326,"data_compressed_allocated":90767360,"data_compressed_original":1452032000,"omap_allocated":0,"internal_metadata":339804160},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002612"},"pg_stats":[{"pgid":"7.f","version":"96'465","reported_seq":477,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:41.663126+0000","last_change":"2024-09-15T12:31:58.539371+0000","last_active":"2024-09-15T12:32:41.663126+0000","last_peered":"2024-09-15T12:32:41.663126+0000","last_clean":"2024-09-15T12:32:41.663126+0000","last_became_active":"2024-09-15T12:31:58.529616+0000","last_became_peered":"2024-09-15T12:31:58.529616+0000","last_unstale":"2024-09-15T12:32:41.663126+0000","last_undegraded":"2024-09-15T12:32:41.663126+0000","last_fullsized":"2024-09-15T12:32:41.663126+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30474240,"num_objects":465,"num_object_clones":0,"num_object_copies":1395,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":465,"num_write_kb":29760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"96'435","reported_seq":447,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.711129+0000","last_change":"2024-09-15T12:31:58.494396+0000","last_active":"2024-09-15T12:32:40.711129+0000","last_peered":"2024-09-15T12:32:40.711129+0000","last_clean":"2024-09-15T12:32:40.711129+0000","last_became_active":"2024-09-15T12:31:58.482932+0000","last_became_peered":"2024-09-15T12:31:58.482932+0000","last_unstale":"2024-09-15T12:32:40.711129+0000","last_undegraded":"2024-09-15T12:32:40.711129+0000","last_fullsized":"2024-09-15T12:32:40.711129+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"96'435","reported_seq":447,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.711493+0000","last_change":"2024-09-15T12:31:58.494069+0000","last_active":"2024-09-15T12:32:40.711493+0000","last_peered":"2024-09-15T12:32:40.711493+0000","last_clean":"2024-09-15T12:32:40.711493+0000","last_became_active":"2024-09-15T12:31:58.483561+0000","last_became_peered":"2024-09-15T12:31:58.483561+0000","last_unstale":"2024-09-15T12:32:40.711493+0000","last_undegraded":"2024-09-15T12:32:40.711493+0000","last_fullsized":"2024-09-15T12:32:40.711493+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"96'417","reported_seq":429,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.699174+0000","last_change":"2024-09-15T12:31:58.531562+0000","last_active":"2024-09-15T12:32:40.699174+0000","last_peered":"2024-09-15T12:32:40.699174+0000","last_clean":"2024-09-15T12:32:40.699174+0000","last_became_active":"2024-09-15T12:31:58.525598+0000","last_became_peered":"2024-09-15T12:31:58.525598+0000","last_unstale":"2024-09-15T12:32:40.699174+0000","last_undegraded":"2024-09-15T12:32:40.699174+0000","last_fullsized":"2024-09-15T12:32:40.699174+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27328512,"num_objects":417,"num_object_clones":0,"num_object_copies":1251,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":417,"num_write_kb":26688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"96'455","reported_seq":467,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:41.720532+0000","last_change":"2024-09-15T12:31:58.544695+0000","last_active":"2024-09-15T12:32:41.720532+0000","last_peered":"2024-09-15T12:32:41.720532+0000","last_clean":"2024-09-15T12:32:41.720532+0000","last_became_active":"2024-09-15T12:31:58.536224+0000","last_became_peered":"2024-09-15T12:31:58.536224+0000","last_unstale":"2024-09-15T12:32:41.720532+0000","last_undegraded":"2024-09-15T12:32:41.720532+0000","last_fullsized":"2024-09-15T12:32:41.720532+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29818880,"num_objects":455,"num_object_clones":0,"num_object_copies":1365,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":455,"num_write_kb":29120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"96'510","reported_seq":522,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:41.581549+0000","last_change":"2024-09-15T12:31:58.503374+0000","last_active":"2024-09-15T12:32:41.581549+0000","last_peered":"2024-09-15T12:32:41.581549+0000","last_clean":"2024-09-15T12:32:41.581549+0000","last_became_active":"2024-09-15T12:31:58.483732+0000","last_became_peered":"2024-09-15T12:31:58.483732+0000","last_unstale":"2024-09-15T12:32:41.581549+0000","last_undegraded":"2024-09-15T12:32:41.581549+0000","last_fullsized":"2024-09-15T12:32:41.581549+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33423360,"num_objects":510,"num_object_clones":0,"num_object_copies":1530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":510,"num_write_kb":32640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"96'488","reported_seq":500,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.371153+0000","last_change":"2024-09-15T12:31:58.497018+0000","last_active":"2024-09-15T12:32:40.371153+0000","last_peered":"2024-09-15T12:32:40.371153+0000","last_clean":"2024-09-15T12:32:40.371153+0000","last_became_active":"2024-09-15T12:31:58.489173+0000","last_became_peered":"2024-09-15T12:31:58.489173+0000","last_unstale":"2024-09-15T12:32:40.371153+0000","last_undegraded":"2024-09-15T12:32:40.371153+0000","last_fullsized":"2024-09-15T12:32:40.371153+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31981568,"num_objects":488,"num_object_clones":0,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":488,"num_write_kb":31232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"96'472","reported_seq":484,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.608640+0000","last_change":"2024-09-15T12:31:58.524969+0000","last_active":"2024-09-15T12:32:40.608640+0000","last_peered":"2024-09-15T12:32:40.608640+0000","last_clean":"2024-09-15T12:32:40.608640+0000","last_became_active":"2024-09-15T12:31:58.516994+0000","last_became_peered":"2024-09-15T12:31:58.516994+0000","last_unstale":"2024-09-15T12:32:40.608640+0000","last_undegraded":"2024-09-15T12:32:40.608640+0000","last_fullsized":"2024-09-15T12:32:40.608640+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30932992,"num_objects":472,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":30208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"96'445","reported_seq":457,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:41.784572+0000","last_change":"2024-09-15T12:31:58.495776+0000","last_active":"2024-09-15T12:32:41.784572+0000","last_peered":"2024-09-15T12:32:41.784572+0000","last_clean":"2024-09-15T12:32:41.784572+0000","last_became_active":"2024-09-15T12:31:58.474993+0000","last_became_peered":"2024-09-15T12:31:58.474993+0000","last_unstale":"2024-09-15T12:32:41.784572+0000","last_undegraded":"2024-09-15T12:32:41.784572+0000","last_fullsized":"2024-09-15T12:32:41.784572+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":445,"num_write_kb":28480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":331,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.358933+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:31:59.358933+0000","last_peered":"2024-09-15T12:31:59.358933+0000","last_clean":"2024-09-15T12:31:59.358933+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:31:59.358933+0000","last_undegraded":"2024-09-15T12:31:59.358933+0000","last_fullsized":"2024-09-15T12:31:59.358933+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":260,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.365124+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:31:59.365124+0000","last_peered":"2024-09-15T12:31:59.365124+0000","last_clean":"2024-09-15T12:31:59.365124+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:31:59.365124+0000","last_undegraded":"2024-09-15T12:31:59.365124+0000","last_fullsized":"2024-09-15T12:31:59.365124+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"96'489","reported_seq":501,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.727538+0000","last_change":"2024-09-15T12:31:58.498915+0000","last_active":"2024-09-15T12:32:40.727538+0000","last_peered":"2024-09-15T12:32:40.727538+0000","last_clean":"2024-09-15T12:32:40.727538+0000","last_became_active":"2024-09-15T12:31:58.487521+0000","last_became_peered":"2024-09-15T12:31:58.487521+0000","last_unstale":"2024-09-15T12:32:40.727538+0000","last_undegraded":"2024-09-15T12:32:40.727538+0000","last_fullsized":"2024-09-15T12:32:40.727538+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32047104,"num_objects":489,"num_object_clones":0,"num_object_copies":1467,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":489,"num_write_kb":31296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.364819+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:31:59.364819+0000","last_peered":"2024-09-15T12:31:59.364819+0000","last_clean":"2024-09-15T12:31:59.364819+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:31:59.364819+0000","last_undegraded":"2024-09-15T12:31:59.364819+0000","last_fullsized":"2024-09-15T12:31:59.364819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"96'467","reported_seq":479,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.750722+0000","last_change":"2024-09-15T12:31:58.468104+0000","last_active":"2024-09-15T12:32:40.750722+0000","last_peered":"2024-09-15T12:32:40.750722+0000","last_clean":"2024-09-15T12:32:40.750722+0000","last_became_active":"2024-09-15T12:31:58.462443+0000","last_became_peered":"2024-09-15T12:31:58.462443+0000","last_unstale":"2024-09-15T12:32:40.750722+0000","last_undegraded":"2024-09-15T12:32:40.750722+0000","last_fullsized":"2024-09-15T12:32:40.750722+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30605312,"num_objects":467,"num_object_clones":0,"num_object_copies":1401,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":467,"num_write_kb":29888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.356572+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:31:59.356572+0000","last_peered":"2024-09-15T12:31:59.356572+0000","last_clean":"2024-09-15T12:31:59.356572+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:31:59.356572+0000","last_undegraded":"2024-09-15T12:31:59.356572+0000","last_fullsized":"2024-09-15T12:31:59.356572+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"96'440","reported_seq":452,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.657567+0000","last_change":"2024-09-15T12:31:58.480532+0000","last_active":"2024-09-15T12:32:40.657567+0000","last_peered":"2024-09-15T12:32:40.657567+0000","last_clean":"2024-09-15T12:32:40.657567+0000","last_became_active":"2024-09-15T12:31:58.468452+0000","last_became_peered":"2024-09-15T12:31:58.468452+0000","last_unstale":"2024-09-15T12:32:40.657567+0000","last_undegraded":"2024-09-15T12:32:40.657567+0000","last_fullsized":"2024-09-15T12:32:40.657567+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28835840,"num_objects":440,"num_object_clones":0,"num_object_copies":1320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":28160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":261,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.358054+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:31:59.358054+0000","last_peered":"2024-09-15T12:31:59.358054+0000","last_clean":"2024-09-15T12:31:59.358054+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:31:59.358054+0000","last_undegraded":"2024-09-15T12:31:59.358054+0000","last_fullsized":"2024-09-15T12:31:59.358054+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"96'490","reported_seq":502,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.503121+0000","last_change":"2024-09-15T12:31:58.472814+0000","last_active":"2024-09-15T12:32:40.503121+0000","last_peered":"2024-09-15T12:32:40.503121+0000","last_clean":"2024-09-15T12:32:40.503121+0000","last_became_active":"2024-09-15T12:31:58.466600+0000","last_became_peered":"2024-09-15T12:31:58.466600+0000","last_unstale":"2024-09-15T12:32:40.503121+0000","last_undegraded":"2024-09-15T12:32:40.503121+0000","last_fullsized":"2024-09-15T12:32:40.503121+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32112640,"num_objects":490,"num_object_clones":0,"num_object_copies":1470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":490,"num_write_kb":31360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.362774+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:31:59.362774+0000","last_peered":"2024-09-15T12:31:59.362774+0000","last_clean":"2024-09-15T12:31:59.362774+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:31:59.362774+0000","last_undegraded":"2024-09-15T12:31:59.362774+0000","last_fullsized":"2024-09-15T12:31:59.362774+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"96'489","reported_seq":501,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:40.447008+0000","last_change":"2024-09-15T12:31:58.435605+0000","last_active":"2024-09-15T12:32:40.447008+0000","last_peered":"2024-09-15T12:32:40.447008+0000","last_clean":"2024-09-15T12:32:40.447008+0000","last_became_active":"2024-09-15T12:31:58.429332+0000","last_became_peered":"2024-09-15T12:31:58.429332+0000","last_unstale":"2024-09-15T12:32:40.447008+0000","last_undegraded":"2024-09-15T12:32:40.447008+0000","last_fullsized":"2024-09-15T12:32:40.447008+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32047104,"num_objects":489,"num_object_clones":0,"num_object_copies":1467,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":489,"num_write_kb":31296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.360240+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:31:59.360240+0000","last_peered":"2024-09-15T12:31:59.360240+0000","last_clean":"2024-09-15T12:31:59.360240+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:31:59.360240+0000","last_undegraded":"2024-09-15T12:31:59.360240+0000","last_fullsized":"2024-09-15T12:31:59.360240+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"96'462","reported_seq":474,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:41.604188+0000","last_change":"2024-09-15T12:31:58.492392+0000","last_active":"2024-09-15T12:32:41.604188+0000","last_peered":"2024-09-15T12:32:41.604188+0000","last_clean":"2024-09-15T12:32:41.604188+0000","last_became_active":"2024-09-15T12:31:58.466633+0000","last_became_peered":"2024-09-15T12:31:58.466633+0000","last_unstale":"2024-09-15T12:32:41.604188+0000","last_undegraded":"2024-09-15T12:32:41.604188+0000","last_fullsized":"2024-09-15T12:32:41.604188+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":462,"num_write_kb":29568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.360118+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:31:59.360118+0000","last_peered":"2024-09-15T12:31:59.360118+0000","last_clean":"2024-09-15T12:31:59.360118+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:31:59.360118+0000","last_undegraded":"2024-09-15T12:31:59.360118+0000","last_fullsized":"2024-09-15T12:31:59.360118+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"96'477","reported_seq":489,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:32:41.495004+0000","last_change":"2024-09-15T12:31:58.524245+0000","last_active":"2024-09-15T12:32:41.495004+0000","last_peered":"2024-09-15T12:32:41.495004+0000","last_clean":"2024-09-15T12:32:41.495004+0000","last_became_active":"2024-09-15T12:31:58.516700+0000","last_became_peered":"2024-09-15T12:31:58.516700+0000","last_unstale":"2024-09-15T12:32:41.495004+0000","last_undegraded":"2024-09-15T12:32:41.495004+0000","last_fullsized":"2024-09-15T12:32:41.495004+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31260672,"num_objects":477,"num_object_clones":0,"num_object_copies":1431,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":477,"num_write_kb":30528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.363584+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:31:59.363584+0000","last_peered":"2024-09-15T12:31:59.363584+0000","last_clean":"2024-09-15T12:31:59.363584+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:31:59.363584+0000","last_undegraded":"2024-09-15T12:31:59.363584+0000","last_fullsized":"2024-09-15T12:31:59.363584+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":487325696,"num_objects":7436,"num_object_clones":0,"num_object_copies":22308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7436,"num_write_kb":475904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":91279360,"data_stored":1460469760,"data_compressed":69347590,"data_compressed_allocated":91279360,"data_compressed_original":1460469760,"omap_allocated":0,"internal_metadata":0},"log_size":7436,"ondisk_log_size":7436,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673798,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":59456,"kb_used_data":29232,"kb_used_omap":0,"kb_used_meta":30208,"kb_avail":94312384,"statfs":{"total":96636764160,"available":96575881216,"internally_reserved":0,"allocated":29933568,"data_stored":465938073,"data_compressed":22111738,"data_compressed_allocated":29106176,"data_compressed_original":465616896,"omap_allocated":0,"internal_metadata":30932992},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706502,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":151196,"kb_used_data":17484,"kb_used_omap":0,"kb_used_meta":133696,"kb_avail":94220644,"statfs":{"total":96636764160,"available":96481939456,"internally_reserved":0,"allocated":17903616,"data_stored":273393324,"data_compressed":12969082,"data_compressed_allocated":17072128,"data_compressed_original":273072128,"omap_allocated":0,"internal_metadata":136904704},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706502,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":158236,"kb_used_data":24524,"kb_used_omap":0,"kb_used_meta":133696,"kb_avail":94213604,"statfs":{"total":96636764160,"available":96474730496,"internally_reserved":0,"allocated":25112576,"data_stored":389129356,"data_compressed":18462590,"data_compressed_allocated":24301568,"data_compressed_original":388825088,"omap_allocated":0,"internal_metadata":136904704},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706501,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54884,"kb_used_data":20624,"kb_used_omap":0,"kb_used_meta":34240,"kb_avail":94316956,"statfs":{"total":96636764160,"available":96580562944,"internally_reserved":0,"allocated":21118976,"data_stored":324839084,"data_compressed":15411916,"data_compressed_allocated":20287488,"data_compressed_original":324517888,"omap_allocated":0,"internal_metadata":35061760},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20709376,"data_stored":331350016,"data_compressed":15733540,"data_compressed_allocated":20709376,"data_compressed_original":331350016,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24379392,"data_stored":390070272,"data_compressed":18521718,"data_compressed_allocated":24379392,"data_compressed_original":390070272,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":17088512,"data_stored":273416192,"data_compressed":12982618,"data_compressed_allocated":17088512,"data_compressed_original":273416192,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29102080,"data_stored":465633280,"data_compressed":22109714,"data_compressed_allocated":29102080,"data_compressed_original":465633280,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:33:03.444 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 64 16 11230 11214 10.9502 10.3125 0.0729717 0.0912434 2024-09-15T12:33:04.062 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:33:04.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:04.210+0000 7f2ccd6ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:04.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:04.219+0000 7f2ccd6ec640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:04.444 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 65 16 11402 11386 10.9471 10.75 0.102586 0.0912759 2024-09-15T12:33:05.444 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 66 16 11571 11555 10.9413 10.5625 0.118059 0.0912969 2024-09-15T12:33:06.445 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 67 16 11742 11726 10.9375 10.6875 0.0924256 0.091335 2024-09-15T12:33:06.579 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:33:06.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:06.723+0000 7faa27111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:06.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:06.729+0000 7faa27111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:07.445 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 68 16 11918 11902 10.9384 11 0.149465 0.0913513 2024-09-15T12:33:08.248 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:33:08.248 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:33:08.249 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:33:08.249 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:33:08.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:08.391+0000 7febd2d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:08.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:08.407+0000 7febd2d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:08.445 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 69 16 12092 12076 10.9375 10.875 0.0812445 0.0913372 2024-09-15T12:33:08.453 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:33:08.453 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:33:08.453 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:33:08.453 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:33:08.453 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:33:08.453 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:33:08.453 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:33:08.453 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:33:08.454 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:33:08.454 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:33:08.454 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:33:08.454 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:33:08.456 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:33:08.457 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:33:08.457 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:33:08.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:08.583+0000 7f017a551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:08.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:08.594+0000 7f017a551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:08.736 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:33:08.736 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:33:08.736 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:33:08.736 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:33:08.736 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:33:08.736 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:33:08.736 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:33:08.736 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:33:08.736 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:33:08.736 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:33:08.736 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:33:08.737 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:33:08.740 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:33:08.741 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:33:08.741 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:33:08.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:08.879+0000 7f02bfad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:08.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:08.891+0000 7f02bfad1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:08.917 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:33:08.917 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:33:08.917 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:33:08.917 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:33:08.917 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:33:08.917 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:33:08.917 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:33:08.917 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:33:08.918 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:33:08.918 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:33:08.918 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:33:08.918 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:33:08.921 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:33:08.921 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:33:08.922 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:33:09.070 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:33:09.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:09.066+0000 7fcf9b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:09.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:09.081+0000 7fcf9b791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:09.174 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:33:09.174 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:33:09.174 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:33:09.174 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:33:09.174 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:33:09.174 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:33:09.174 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:33:09.174 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:33:09.174 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:33:09.175 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:33:09.175 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:33:09.175 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:33:09.179 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:33:09.180 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:33:09.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:09.205+0000 7f6700791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:09.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:09.212+0000 7f6700791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:09.445 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 70 16 12262 12246 10.933 10.625 0.0631929 0.0914011 2024-09-15T12:33:10.445 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 71 16 12431 12415 10.9278 10.5625 0.0840025 0.091423 2024-09-15T12:33:11.445 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 72 16 12589 12573 10.9131 9.875 0.12453 0.0915575 2024-09-15T12:33:11.602 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:33:11.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:11.739+0000 7f1d2f191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:11.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:11.747+0000 7f1d2f191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:12.445 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 73 16 12760 12744 10.91 10.6875 0.101146 0.0915624 2024-09-15T12:33:13.445 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 74 16 12925 12909 10.9019 10.3125 0.0741558 0.0916503 2024-09-15T12:33:14.032 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:33:14.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:14.167+0000 7fcbc8951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:14.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:14.172+0000 7fcbc8951640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:14.180 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:33:14.180 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:33:14.181 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:33:14.181 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:33:14.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:14.338+0000 7f0ff1b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:14.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:14.355+0000 7f0ff1b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:14.386 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:33:14.387 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:33:14.387 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:33:14.387 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:33:14.387 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:33:14.387 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:33:14.387 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:33:14.387 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:33:14.387 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:33:14.387 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:33:14.387 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:33:14.387 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:33:14.390 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:33:14.391 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:33:14.391 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:33:14.445 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 75 16 13076 13060 10.8824 9.4375 0.125846 0.0918153 2024-09-15T12:33:14.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:14.533+0000 7f45a92c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:14.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:14.552+0000 7f45a92c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:14.667 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:33:14.667 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:33:14.667 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:33:14.667 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:33:14.667 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:33:14.667 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:33:14.667 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:33:14.667 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:33:14.667 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:33:14.668 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:33:14.668 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:33:14.668 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:33:14.670 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:33:14.670 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:33:14.670 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:33:14.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:14.815+0000 7f039e47d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:14.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:14.832+0000 7f039e47d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:14.859 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:33:14.859 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:33:14.859 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:33:14.859 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:33:14.859 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:33:14.859 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:33:14.859 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:33:14.859 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:33:14.859 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:33:14.859 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:33:14.860 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:33:14.860 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:33:14.864 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:33:14.865 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:33:14.865 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:33:15.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:15.005+0000 7f34b42d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:15.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:15.017+0000 7f34b42d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:15.097 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:33:15.097 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:33:15.097 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:33:15.097 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:33:15.098 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:33:15.098 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:33:15.098 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:33:15.098 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:33:15.098 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:33:15.098 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:33:15.098 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:33:15.098 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:33:15.101 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:33:15.102 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:33:15.445 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 76 16 13246 13230 10.879 10.625 0.0911189 0.0918437 2024-09-15T12:33:16.445 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 77 16 13414 13398 10.8741 10.5 0.0949369 0.0919105 2024-09-15T12:33:16.567 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:33:16.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:16.714+0000 7f5001391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:16.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:16.722+0000 7f5001391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:17.445 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 78 16 13587 13571 10.8733 10.8125 0.0721733 0.0919121 2024-09-15T12:33:18.446 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 79 16 13764 13748 10.8756 11.0625 0.13659 0.0918834 2024-09-15T12:33:19.218 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:33:19.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:19.353+0000 7f3352991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:19.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:19.361+0000 7f3352991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:19.445 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:2024-09-15T12:33:19.445198+0000 min lat: 0.0171244 max lat: 0.234131 avg lat: 0.0919612 2024-09-15T12:33:19.446 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-15T12:33:19.446 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 80 16 13925 13909 10.8655 10.0625 0.139186 0.0919612 2024-09-15T12:33:20.102 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:33:20.103 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:33:20.103 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:33:20.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:20.240+0000 7f1fe429c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:20.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:20.249+0000 7f1fe429c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:20.446 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 81 16 14089 14073 10.8578 10.25 0.104318 0.0920433 2024-09-15T12:33:20.605 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:33:20.606 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:33:20.624 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":528,"stamp":"2024-09-15T12:33:19.876980+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":822870579,"num_objects":12551,"num_object_clones":0,"num_object_copies":37653,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":12628,"num_write_kb":804116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12602,"ondisk_log_size":12602,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":385508,"kb_used_data":152676,"kb_used_omap":0,"kb_used_meta":232768,"kb_avail":377101852,"statfs":{"total":386547056640,"available":386152296448,"internally_reserved":0,"allocated":156340224,"data_stored":2449643645,"data_compressed":116267059,"data_compressed_allocated":153038848,"data_compressed_original":2448375808,"omap_allocated":0,"internal_metadata":238354432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":334954496,"num_objects":5111,"num_object_clones":0,"num_object_copies":15333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5111,"num_write_kb":327104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002260"},"pg_stats":[{"pgid":"7.f","version":"96'796","reported_seq":808,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:11.661850+0000","last_change":"2024-09-15T12:31:58.539371+0000","last_active":"2024-09-15T12:33:11.661850+0000","last_peered":"2024-09-15T12:33:11.661850+0000","last_clean":"2024-09-15T12:33:11.661850+0000","last_became_active":"2024-09-15T12:31:58.529616+0000","last_became_peered":"2024-09-15T12:31:58.529616+0000","last_unstale":"2024-09-15T12:33:11.661850+0000","last_undegraded":"2024-09-15T12:33:11.661850+0000","last_fullsized":"2024-09-15T12:33:11.661850+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":796,"log_dups_size":0,"ondisk_log_size":796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52166656,"num_objects":796,"num_object_clones":0,"num_object_copies":2388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":796,"num_write_kb":50944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"96'758","reported_seq":770,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:10.694091+0000","last_change":"2024-09-15T12:31:58.494396+0000","last_active":"2024-09-15T12:33:10.694091+0000","last_peered":"2024-09-15T12:33:10.694091+0000","last_clean":"2024-09-15T12:33:10.694091+0000","last_became_active":"2024-09-15T12:31:58.482932+0000","last_became_peered":"2024-09-15T12:31:58.482932+0000","last_unstale":"2024-09-15T12:33:10.694091+0000","last_undegraded":"2024-09-15T12:33:10.694091+0000","last_fullsized":"2024-09-15T12:33:10.694091+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49676288,"num_objects":758,"num_object_clones":0,"num_object_copies":2274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":758,"num_write_kb":48512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"96'747","reported_seq":759,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:10.663187+0000","last_change":"2024-09-15T12:31:58.494069+0000","last_active":"2024-09-15T12:33:10.663187+0000","last_peered":"2024-09-15T12:33:10.663187+0000","last_clean":"2024-09-15T12:33:10.663187+0000","last_became_active":"2024-09-15T12:31:58.483561+0000","last_became_peered":"2024-09-15T12:31:58.483561+0000","last_unstale":"2024-09-15T12:33:10.663187+0000","last_undegraded":"2024-09-15T12:33:10.663187+0000","last_fullsized":"2024-09-15T12:33:10.663187+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48955392,"num_objects":747,"num_object_clones":0,"num_object_copies":2241,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":747,"num_write_kb":47808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"96'730","reported_seq":742,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:10.625383+0000","last_change":"2024-09-15T12:31:58.531562+0000","last_active":"2024-09-15T12:33:10.625383+0000","last_peered":"2024-09-15T12:33:10.625383+0000","last_clean":"2024-09-15T12:33:10.625383+0000","last_became_active":"2024-09-15T12:31:58.525598+0000","last_became_peered":"2024-09-15T12:31:58.525598+0000","last_unstale":"2024-09-15T12:33:10.625383+0000","last_undegraded":"2024-09-15T12:33:10.625383+0000","last_fullsized":"2024-09-15T12:33:10.625383+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":730,"log_dups_size":0,"ondisk_log_size":730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47841280,"num_objects":730,"num_object_clones":0,"num_object_copies":2190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":730,"num_write_kb":46720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"96'765","reported_seq":777,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:11.481011+0000","last_change":"2024-09-15T12:31:58.544695+0000","last_active":"2024-09-15T12:33:11.481011+0000","last_peered":"2024-09-15T12:33:11.481011+0000","last_clean":"2024-09-15T12:33:11.481011+0000","last_became_active":"2024-09-15T12:31:58.536224+0000","last_became_peered":"2024-09-15T12:31:58.536224+0000","last_unstale":"2024-09-15T12:33:11.481011+0000","last_undegraded":"2024-09-15T12:33:11.481011+0000","last_fullsized":"2024-09-15T12:33:11.481011+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50135040,"num_objects":765,"num_object_clones":0,"num_object_copies":2295,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":765,"num_write_kb":48960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"96'805","reported_seq":817,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:11.584707+0000","last_change":"2024-09-15T12:31:58.503374+0000","last_active":"2024-09-15T12:33:11.584707+0000","last_peered":"2024-09-15T12:33:11.584707+0000","last_clean":"2024-09-15T12:33:11.584707+0000","last_became_active":"2024-09-15T12:31:58.483732+0000","last_became_peered":"2024-09-15T12:31:58.483732+0000","last_unstale":"2024-09-15T12:33:11.584707+0000","last_undegraded":"2024-09-15T12:33:11.584707+0000","last_fullsized":"2024-09-15T12:33:11.584707+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52756480,"num_objects":805,"num_object_clones":0,"num_object_copies":2415,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":805,"num_write_kb":51520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"96'809","reported_seq":821,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:10.430646+0000","last_change":"2024-09-15T12:31:58.497018+0000","last_active":"2024-09-15T12:33:10.430646+0000","last_peered":"2024-09-15T12:33:10.430646+0000","last_clean":"2024-09-15T12:33:10.430646+0000","last_became_active":"2024-09-15T12:31:58.489173+0000","last_became_peered":"2024-09-15T12:31:58.489173+0000","last_unstale":"2024-09-15T12:33:10.430646+0000","last_undegraded":"2024-09-15T12:33:10.430646+0000","last_fullsized":"2024-09-15T12:33:10.430646+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53018624,"num_objects":809,"num_object_clones":0,"num_object_copies":2427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":51776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"96'781","reported_seq":793,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:10.657954+0000","last_change":"2024-09-15T12:31:58.524969+0000","last_active":"2024-09-15T12:33:10.657954+0000","last_peered":"2024-09-15T12:33:10.657954+0000","last_clean":"2024-09-15T12:33:10.657954+0000","last_became_active":"2024-09-15T12:31:58.516994+0000","last_became_peered":"2024-09-15T12:31:58.516994+0000","last_unstale":"2024-09-15T12:33:10.657954+0000","last_undegraded":"2024-09-15T12:33:10.657954+0000","last_fullsized":"2024-09-15T12:33:10.657954+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51183616,"num_objects":781,"num_object_clones":0,"num_object_copies":2343,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":781,"num_write_kb":49984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"96'788","reported_seq":800,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:11.564596+0000","last_change":"2024-09-15T12:31:58.495776+0000","last_active":"2024-09-15T12:33:11.564596+0000","last_peered":"2024-09-15T12:33:11.564596+0000","last_clean":"2024-09-15T12:33:11.564596+0000","last_became_active":"2024-09-15T12:31:58.474993+0000","last_became_peered":"2024-09-15T12:31:58.474993+0000","last_unstale":"2024-09-15T12:33:11.564596+0000","last_undegraded":"2024-09-15T12:33:11.564596+0000","last_fullsized":"2024-09-15T12:33:11.564596+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51642368,"num_objects":788,"num_object_clones":0,"num_object_copies":2364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":788,"num_write_kb":50432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":331,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.358933+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:31:59.358933+0000","last_peered":"2024-09-15T12:31:59.358933+0000","last_clean":"2024-09-15T12:31:59.358933+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:31:59.358933+0000","last_undegraded":"2024-09-15T12:31:59.358933+0000","last_fullsized":"2024-09-15T12:31:59.358933+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":260,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.365124+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:31:59.365124+0000","last_peered":"2024-09-15T12:31:59.365124+0000","last_clean":"2024-09-15T12:31:59.365124+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:31:59.365124+0000","last_undegraded":"2024-09-15T12:31:59.365124+0000","last_fullsized":"2024-09-15T12:31:59.365124+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"96'791","reported_seq":803,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:10.577206+0000","last_change":"2024-09-15T12:31:58.498915+0000","last_active":"2024-09-15T12:33:10.577206+0000","last_peered":"2024-09-15T12:33:10.577206+0000","last_clean":"2024-09-15T12:33:10.577206+0000","last_became_active":"2024-09-15T12:31:58.487521+0000","last_became_peered":"2024-09-15T12:31:58.487521+0000","last_unstale":"2024-09-15T12:33:10.577206+0000","last_undegraded":"2024-09-15T12:33:10.577206+0000","last_fullsized":"2024-09-15T12:33:10.577206+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51838976,"num_objects":791,"num_object_clones":0,"num_object_copies":2373,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":791,"num_write_kb":50624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.364819+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:31:59.364819+0000","last_peered":"2024-09-15T12:31:59.364819+0000","last_clean":"2024-09-15T12:31:59.364819+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:31:59.364819+0000","last_undegraded":"2024-09-15T12:31:59.364819+0000","last_fullsized":"2024-09-15T12:31:59.364819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"96'804","reported_seq":816,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:10.566065+0000","last_change":"2024-09-15T12:31:58.468104+0000","last_active":"2024-09-15T12:33:10.566065+0000","last_peered":"2024-09-15T12:33:10.566065+0000","last_clean":"2024-09-15T12:33:10.566065+0000","last_became_active":"2024-09-15T12:31:58.462443+0000","last_became_peered":"2024-09-15T12:31:58.462443+0000","last_unstale":"2024-09-15T12:33:10.566065+0000","last_undegraded":"2024-09-15T12:33:10.566065+0000","last_fullsized":"2024-09-15T12:33:10.566065+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":804,"log_dups_size":0,"ondisk_log_size":804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52690944,"num_objects":804,"num_object_clones":0,"num_object_copies":2412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":804,"num_write_kb":51456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.356572+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:31:59.356572+0000","last_peered":"2024-09-15T12:31:59.356572+0000","last_clean":"2024-09-15T12:31:59.356572+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:31:59.356572+0000","last_undegraded":"2024-09-15T12:31:59.356572+0000","last_fullsized":"2024-09-15T12:31:59.356572+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"96'771","reported_seq":783,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:10.521825+0000","last_change":"2024-09-15T12:31:58.480532+0000","last_active":"2024-09-15T12:33:10.521825+0000","last_peered":"2024-09-15T12:33:10.521825+0000","last_clean":"2024-09-15T12:33:10.521825+0000","last_became_active":"2024-09-15T12:31:58.468452+0000","last_became_peered":"2024-09-15T12:31:58.468452+0000","last_unstale":"2024-09-15T12:33:10.521825+0000","last_undegraded":"2024-09-15T12:33:10.521825+0000","last_fullsized":"2024-09-15T12:33:10.521825+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50528256,"num_objects":771,"num_object_clones":0,"num_object_copies":2313,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":771,"num_write_kb":49344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":261,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.358054+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:31:59.358054+0000","last_peered":"2024-09-15T12:31:59.358054+0000","last_clean":"2024-09-15T12:31:59.358054+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:31:59.358054+0000","last_undegraded":"2024-09-15T12:31:59.358054+0000","last_fullsized":"2024-09-15T12:31:59.358054+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"96'806","reported_seq":818,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:10.312423+0000","last_change":"2024-09-15T12:31:58.472814+0000","last_active":"2024-09-15T12:33:10.312423+0000","last_peered":"2024-09-15T12:33:10.312423+0000","last_clean":"2024-09-15T12:33:10.312423+0000","last_became_active":"2024-09-15T12:31:58.466600+0000","last_became_peered":"2024-09-15T12:31:58.466600+0000","last_unstale":"2024-09-15T12:33:10.312423+0000","last_undegraded":"2024-09-15T12:33:10.312423+0000","last_fullsized":"2024-09-15T12:33:10.312423+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52822016,"num_objects":806,"num_object_clones":0,"num_object_copies":2418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":806,"num_write_kb":51584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.362774+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:31:59.362774+0000","last_peered":"2024-09-15T12:31:59.362774+0000","last_clean":"2024-09-15T12:31:59.362774+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:31:59.362774+0000","last_undegraded":"2024-09-15T12:31:59.362774+0000","last_fullsized":"2024-09-15T12:31:59.362774+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"96'815","reported_seq":827,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:10.376467+0000","last_change":"2024-09-15T12:31:58.435605+0000","last_active":"2024-09-15T12:33:10.376467+0000","last_peered":"2024-09-15T12:33:10.376467+0000","last_clean":"2024-09-15T12:33:10.376467+0000","last_became_active":"2024-09-15T12:31:58.429332+0000","last_became_peered":"2024-09-15T12:31:58.429332+0000","last_unstale":"2024-09-15T12:33:10.376467+0000","last_undegraded":"2024-09-15T12:33:10.376467+0000","last_fullsized":"2024-09-15T12:33:10.376467+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53411840,"num_objects":815,"num_object_clones":0,"num_object_copies":2445,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":815,"num_write_kb":52160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.360240+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:31:59.360240+0000","last_peered":"2024-09-15T12:31:59.360240+0000","last_clean":"2024-09-15T12:31:59.360240+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:31:59.360240+0000","last_undegraded":"2024-09-15T12:31:59.360240+0000","last_fullsized":"2024-09-15T12:31:59.360240+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"96'791","reported_seq":803,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:11.700534+0000","last_change":"2024-09-15T12:31:58.492392+0000","last_active":"2024-09-15T12:33:11.700534+0000","last_peered":"2024-09-15T12:33:11.700534+0000","last_clean":"2024-09-15T12:33:11.700534+0000","last_became_active":"2024-09-15T12:31:58.466633+0000","last_became_peered":"2024-09-15T12:31:58.466633+0000","last_unstale":"2024-09-15T12:33:11.700534+0000","last_undegraded":"2024-09-15T12:33:11.700534+0000","last_fullsized":"2024-09-15T12:33:11.700534+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51838976,"num_objects":791,"num_object_clones":0,"num_object_copies":2373,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":791,"num_write_kb":50624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.360118+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:31:59.360118+0000","last_peered":"2024-09-15T12:31:59.360118+0000","last_clean":"2024-09-15T12:31:59.360118+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:31:59.360118+0000","last_undegraded":"2024-09-15T12:31:59.360118+0000","last_fullsized":"2024-09-15T12:31:59.360118+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"96'790","reported_seq":802,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:11.795070+0000","last_change":"2024-09-15T12:31:58.524245+0000","last_active":"2024-09-15T12:33:11.795070+0000","last_peered":"2024-09-15T12:33:11.795070+0000","last_clean":"2024-09-15T12:33:11.795070+0000","last_became_active":"2024-09-15T12:31:58.516700+0000","last_became_peered":"2024-09-15T12:31:58.516700+0000","last_unstale":"2024-09-15T12:33:11.795070+0000","last_undegraded":"2024-09-15T12:33:11.795070+0000","last_fullsized":"2024-09-15T12:33:11.795070+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":790,"log_dups_size":0,"ondisk_log_size":790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51773440,"num_objects":790,"num_object_clones":0,"num_object_copies":2370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":790,"num_write_kb":50560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.363584+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:31:59.363584+0000","last_peered":"2024-09-15T12:31:59.363584+0000","last_clean":"2024-09-15T12:31:59.363584+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:31:59.363584+0000","last_undegraded":"2024-09-15T12:31:59.363584+0000","last_fullsized":"2024-09-15T12:31:59.363584+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":822280192,"num_objects":12547,"num_object_clones":0,"num_object_copies":37641,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12547,"num_write_kb":803008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":154030080,"data_stored":2464481280,"data_compressed":117023427,"data_compressed_allocated":154030080,"data_compressed_original":2464481280,"omap_allocated":0,"internal_metadata":0},"log_size":12547,"ondisk_log_size":12547,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673827,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":77984,"kb_used_data":47760,"kb_used_omap":0,"kb_used_meta":30208,"kb_avail":94293856,"statfs":{"total":96636764160,"available":96556908544,"internally_reserved":0,"allocated":48906240,"data_stored":769500825,"data_compressed":36526521,"data_compressed_allocated":48078848,"data_compressed_original":769179648,"omap_allocated":0,"internal_metadata":30932992},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706532,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":154340,"kb_used_data":28948,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94217500,"statfs":{"total":96636764160,"available":96478720000,"internally_reserved":0,"allocated":29642752,"data_stored":461219500,"data_compressed":21888073,"data_compressed_allocated":28811264,"data_compressed_original":460898304,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706532,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":88288,"kb_used_data":41168,"kb_used_omap":0,"kb_used_meta":47104,"kb_avail":94283552,"statfs":{"total":96636764160,"available":96546357248,"internally_reserved":0,"allocated":42156032,"data_stored":661824652,"data_compressed":31411621,"data_compressed_allocated":41345024,"data_compressed_original":661520384,"omap_allocated":0,"internal_metadata":48234496},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706531,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64896,"kb_used_data":34800,"kb_used_omap":0,"kb_used_meta":30080,"kb_avail":94306944,"statfs":{"total":96636764160,"available":96570310656,"internally_reserved":0,"allocated":35635200,"data_stored":557098668,"data_compressed":26440844,"data_compressed_allocated":34803712,"data_compressed_original":556777472,"omap_allocated":0,"internal_metadata":30801920},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":35184640,"data_stored":562954240,"data_compressed":26731348,"data_compressed_allocated":35184640,"data_compressed_original":562954240,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41369600,"data_stored":661913600,"data_compressed":31430293,"data_compressed_allocated":41369600,"data_compressed_original":661913600,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28794880,"data_stored":460718080,"data_compressed":21876713,"data_compressed_allocated":28794880,"data_compressed_original":460718080,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":48680960,"data_stored":778895360,"data_compressed":36985073,"data_compressed_allocated":48680960,"data_compressed_original":778895360,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:33:21.446 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 82 16 14253 14237 10.8504 10.25 0.159118 0.0920808 2024-09-15T12:33:21.789 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:33:21.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:21.927+0000 7f4cc0b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:21.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:21.935+0000 7f4cc0b11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:22.446 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 83 16 14415 14399 10.8417 10.125 0.0559373 0.0921712 2024-09-15T12:33:23.446 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 84 16 14580 14564 10.8354 10.3125 0.0668522 0.0922241 2024-09-15T12:33:24.251 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:33:24.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:24.392+0000 7f8588d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:24.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:24.399+0000 7f8588d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:24.446 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 85 16 14752 14736 10.8344 10.75 0.115133 0.0922216 2024-09-15T12:33:25.446 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 86 16 14905 14889 10.8196 9.5625 0.0554129 0.0923531 2024-09-15T12:33:25.625 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:33:25.626 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:33:25.626 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:33:25.626 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:33:25.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:25.774+0000 7f470bd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:25.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:25.789+0000 7f470bd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:25.813 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:33:25.813 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:33:25.813 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:33:25.813 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:33:25.813 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:33:25.813 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:33:25.813 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:33:25.813 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:33:25.813 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:33:25.814 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:33:25.814 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:33:25.814 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:33:25.817 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:33:25.817 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:33:25.817 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:33:25.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:25.949+0000 7f2def591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:25.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:25.962+0000 7f2def591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:26.038 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:33:26.038 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:33:26.038 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:33:26.038 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:33:26.039 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:33:26.039 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:33:26.039 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:33:26.039 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:33:26.039 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:33:26.039 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:33:26.039 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:33:26.039 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:33:26.042 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:33:26.042 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:33:26.042 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:33:26.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:26.194+0000 7f6a71e46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:26.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:26.208+0000 7f6a71e46640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:26.257 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:33:26.257 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:33:26.257 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:33:26.257 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:33:26.257 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:33:26.257 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:33:26.257 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:33:26.257 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:33:26.257 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:33:26.258 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:33:26.258 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:33:26.258 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:33:26.261 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:33:26.261 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:33:26.261 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:33:26.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:26.408+0000 7f9fadc6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:26.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:26.420+0000 7f9fadc6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:26.446 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 87 16 15073 15057 10.8159 10.5 0.0552274 0.0923818 2024-09-15T12:33:26.508 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:33:26.509 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:33:26.509 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:33:26.509 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:33:26.509 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:33:26.509 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:33:26.509 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:33:26.509 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:33:26.509 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:33:26.509 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:33:26.509 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:33:26.509 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:33:26.512 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:33:26.513 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:33:26.675 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:33:26.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:26.799+0000 7fa4b7f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:26.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:26.807+0000 7fa4b7f51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:27.447 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 88 16 15235 15219 10.808 10.125 0.102494 0.0924662 2024-09-15T12:33:28.446 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 89 16 15398 15382 10.801 10.1875 0.0997316 0.0925385 2024-09-15T12:33:29.159 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:33:29.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:29.313+0000 7fc773751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:29.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:29.321+0000 7fc773751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:29.446 INFO:tasks.radosbench.radosbench.0.smithi077.stdout: 90 14 15559 15545 10.7942 10.1875 0.0532278 0.0925944 2024-09-15T12:33:30.447 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Total time run: 90.0774 2024-09-15T12:33:30.447 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Total writes made: 15559 2024-09-15T12:33:30.447 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Write size: 65536 2024-09-15T12:33:30.447 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Object size: 65536 2024-09-15T12:33:30.447 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Bandwidth (MB/sec): 10.7956 2024-09-15T12:33:30.447 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Stddev Bandwidth: 0.632471 2024-09-15T12:33:30.447 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Max bandwidth (MB/sec): 12.3125 2024-09-15T12:33:30.447 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Min bandwidth (MB/sec): 9.0625 2024-09-15T12:33:30.447 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Average IOPS: 172 2024-09-15T12:33:30.447 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Stddev IOPS: 10.1195 2024-09-15T12:33:30.447 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Max IOPS: 197 2024-09-15T12:33:30.448 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Min IOPS: 145 2024-09-15T12:33:30.448 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Average Latency(s): 0.0925876 2024-09-15T12:33:30.448 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Stddev Latency(s): 0.0283486 2024-09-15T12:33:30.448 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Max latency(s): 0.234131 2024-09-15T12:33:30.448 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Min latency(s): 0.0171244 2024-09-15T12:33:30.476 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Cleaning up (deleting benchmark objects) 2024-09-15T12:33:31.514 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:33:31.514 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:33:31.514 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:33:31.527 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:33:31.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:31.649+0000 7f5581b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:31.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:31.667+0000 7f5581b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:31.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:31.697+0000 7f43a1391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:31.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:31.707+0000 7f43a1391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:32.009 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:33:32.009 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:33:32.029 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":534,"stamp":"2024-09-15T12:33:31.879296+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":822870579,"num_objects":12551,"num_object_clones":0,"num_object_copies":37653,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":12628,"num_write_kb":804116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12602,"ondisk_log_size":12602,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":385508,"kb_used_data":152676,"kb_used_omap":0,"kb_used_meta":232768,"kb_avail":377101852,"statfs":{"total":386547056640,"available":386152296448,"internally_reserved":0,"allocated":156340224,"data_stored":2449643645,"data_compressed":116267059,"data_compressed_allocated":153038848,"data_compressed_original":2448375808,"omap_allocated":0,"internal_metadata":238354432},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002316"},"pg_stats":[{"pgid":"7.f","version":"96'796","reported_seq":808,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:11.661850+0000","last_change":"2024-09-15T12:31:58.539371+0000","last_active":"2024-09-15T12:33:11.661850+0000","last_peered":"2024-09-15T12:33:11.661850+0000","last_clean":"2024-09-15T12:33:11.661850+0000","last_became_active":"2024-09-15T12:31:58.529616+0000","last_became_peered":"2024-09-15T12:31:58.529616+0000","last_unstale":"2024-09-15T12:33:11.661850+0000","last_undegraded":"2024-09-15T12:33:11.661850+0000","last_fullsized":"2024-09-15T12:33:11.661850+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":796,"log_dups_size":0,"ondisk_log_size":796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52166656,"num_objects":796,"num_object_clones":0,"num_object_copies":2388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":796,"num_write_kb":50944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"96'758","reported_seq":770,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:10.694091+0000","last_change":"2024-09-15T12:31:58.494396+0000","last_active":"2024-09-15T12:33:10.694091+0000","last_peered":"2024-09-15T12:33:10.694091+0000","last_clean":"2024-09-15T12:33:10.694091+0000","last_became_active":"2024-09-15T12:31:58.482932+0000","last_became_peered":"2024-09-15T12:31:58.482932+0000","last_unstale":"2024-09-15T12:33:10.694091+0000","last_undegraded":"2024-09-15T12:33:10.694091+0000","last_fullsized":"2024-09-15T12:33:10.694091+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49676288,"num_objects":758,"num_object_clones":0,"num_object_copies":2274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":758,"num_write_kb":48512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"96'747","reported_seq":759,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:10.663187+0000","last_change":"2024-09-15T12:31:58.494069+0000","last_active":"2024-09-15T12:33:10.663187+0000","last_peered":"2024-09-15T12:33:10.663187+0000","last_clean":"2024-09-15T12:33:10.663187+0000","last_became_active":"2024-09-15T12:31:58.483561+0000","last_became_peered":"2024-09-15T12:31:58.483561+0000","last_unstale":"2024-09-15T12:33:10.663187+0000","last_undegraded":"2024-09-15T12:33:10.663187+0000","last_fullsized":"2024-09-15T12:33:10.663187+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48955392,"num_objects":747,"num_object_clones":0,"num_object_copies":2241,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":747,"num_write_kb":47808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"96'730","reported_seq":742,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:10.625383+0000","last_change":"2024-09-15T12:31:58.531562+0000","last_active":"2024-09-15T12:33:10.625383+0000","last_peered":"2024-09-15T12:33:10.625383+0000","last_clean":"2024-09-15T12:33:10.625383+0000","last_became_active":"2024-09-15T12:31:58.525598+0000","last_became_peered":"2024-09-15T12:31:58.525598+0000","last_unstale":"2024-09-15T12:33:10.625383+0000","last_undegraded":"2024-09-15T12:33:10.625383+0000","last_fullsized":"2024-09-15T12:33:10.625383+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":730,"log_dups_size":0,"ondisk_log_size":730,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47841280,"num_objects":730,"num_object_clones":0,"num_object_copies":2190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":730,"num_write_kb":46720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"96'765","reported_seq":777,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:11.481011+0000","last_change":"2024-09-15T12:31:58.544695+0000","last_active":"2024-09-15T12:33:11.481011+0000","last_peered":"2024-09-15T12:33:11.481011+0000","last_clean":"2024-09-15T12:33:11.481011+0000","last_became_active":"2024-09-15T12:31:58.536224+0000","last_became_peered":"2024-09-15T12:31:58.536224+0000","last_unstale":"2024-09-15T12:33:11.481011+0000","last_undegraded":"2024-09-15T12:33:11.481011+0000","last_fullsized":"2024-09-15T12:33:11.481011+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50135040,"num_objects":765,"num_object_clones":0,"num_object_copies":2295,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":765,"num_write_kb":48960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"96'805","reported_seq":817,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:11.584707+0000","last_change":"2024-09-15T12:31:58.503374+0000","last_active":"2024-09-15T12:33:11.584707+0000","last_peered":"2024-09-15T12:33:11.584707+0000","last_clean":"2024-09-15T12:33:11.584707+0000","last_became_active":"2024-09-15T12:31:58.483732+0000","last_became_peered":"2024-09-15T12:31:58.483732+0000","last_unstale":"2024-09-15T12:33:11.584707+0000","last_undegraded":"2024-09-15T12:33:11.584707+0000","last_fullsized":"2024-09-15T12:33:11.584707+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52756480,"num_objects":805,"num_object_clones":0,"num_object_copies":2415,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":805,"num_write_kb":51520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"96'809","reported_seq":821,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:10.430646+0000","last_change":"2024-09-15T12:31:58.497018+0000","last_active":"2024-09-15T12:33:10.430646+0000","last_peered":"2024-09-15T12:33:10.430646+0000","last_clean":"2024-09-15T12:33:10.430646+0000","last_became_active":"2024-09-15T12:31:58.489173+0000","last_became_peered":"2024-09-15T12:31:58.489173+0000","last_unstale":"2024-09-15T12:33:10.430646+0000","last_undegraded":"2024-09-15T12:33:10.430646+0000","last_fullsized":"2024-09-15T12:33:10.430646+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53018624,"num_objects":809,"num_object_clones":0,"num_object_copies":2427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":51776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"96'781","reported_seq":793,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:10.657954+0000","last_change":"2024-09-15T12:31:58.524969+0000","last_active":"2024-09-15T12:33:10.657954+0000","last_peered":"2024-09-15T12:33:10.657954+0000","last_clean":"2024-09-15T12:33:10.657954+0000","last_became_active":"2024-09-15T12:31:58.516994+0000","last_became_peered":"2024-09-15T12:31:58.516994+0000","last_unstale":"2024-09-15T12:33:10.657954+0000","last_undegraded":"2024-09-15T12:33:10.657954+0000","last_fullsized":"2024-09-15T12:33:10.657954+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51183616,"num_objects":781,"num_object_clones":0,"num_object_copies":2343,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":781,"num_write_kb":49984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"96'788","reported_seq":800,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:11.564596+0000","last_change":"2024-09-15T12:31:58.495776+0000","last_active":"2024-09-15T12:33:11.564596+0000","last_peered":"2024-09-15T12:33:11.564596+0000","last_clean":"2024-09-15T12:33:11.564596+0000","last_became_active":"2024-09-15T12:31:58.474993+0000","last_became_peered":"2024-09-15T12:31:58.474993+0000","last_unstale":"2024-09-15T12:33:11.564596+0000","last_undegraded":"2024-09-15T12:33:11.564596+0000","last_fullsized":"2024-09-15T12:33:11.564596+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51642368,"num_objects":788,"num_object_clones":0,"num_object_copies":2364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":788,"num_write_kb":50432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":331,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.358933+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:31:59.358933+0000","last_peered":"2024-09-15T12:31:59.358933+0000","last_clean":"2024-09-15T12:31:59.358933+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:31:59.358933+0000","last_undegraded":"2024-09-15T12:31:59.358933+0000","last_fullsized":"2024-09-15T12:31:59.358933+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":260,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.365124+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:31:59.365124+0000","last_peered":"2024-09-15T12:31:59.365124+0000","last_clean":"2024-09-15T12:31:59.365124+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:31:59.365124+0000","last_undegraded":"2024-09-15T12:31:59.365124+0000","last_fullsized":"2024-09-15T12:31:59.365124+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"96'791","reported_seq":803,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:10.577206+0000","last_change":"2024-09-15T12:31:58.498915+0000","last_active":"2024-09-15T12:33:10.577206+0000","last_peered":"2024-09-15T12:33:10.577206+0000","last_clean":"2024-09-15T12:33:10.577206+0000","last_became_active":"2024-09-15T12:31:58.487521+0000","last_became_peered":"2024-09-15T12:31:58.487521+0000","last_unstale":"2024-09-15T12:33:10.577206+0000","last_undegraded":"2024-09-15T12:33:10.577206+0000","last_fullsized":"2024-09-15T12:33:10.577206+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51838976,"num_objects":791,"num_object_clones":0,"num_object_copies":2373,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":791,"num_write_kb":50624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.364819+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:31:59.364819+0000","last_peered":"2024-09-15T12:31:59.364819+0000","last_clean":"2024-09-15T12:31:59.364819+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:31:59.364819+0000","last_undegraded":"2024-09-15T12:31:59.364819+0000","last_fullsized":"2024-09-15T12:31:59.364819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"96'804","reported_seq":816,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:10.566065+0000","last_change":"2024-09-15T12:31:58.468104+0000","last_active":"2024-09-15T12:33:10.566065+0000","last_peered":"2024-09-15T12:33:10.566065+0000","last_clean":"2024-09-15T12:33:10.566065+0000","last_became_active":"2024-09-15T12:31:58.462443+0000","last_became_peered":"2024-09-15T12:31:58.462443+0000","last_unstale":"2024-09-15T12:33:10.566065+0000","last_undegraded":"2024-09-15T12:33:10.566065+0000","last_fullsized":"2024-09-15T12:33:10.566065+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":804,"log_dups_size":0,"ondisk_log_size":804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52690944,"num_objects":804,"num_object_clones":0,"num_object_copies":2412,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":804,"num_write_kb":51456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.356572+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:31:59.356572+0000","last_peered":"2024-09-15T12:31:59.356572+0000","last_clean":"2024-09-15T12:31:59.356572+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:31:59.356572+0000","last_undegraded":"2024-09-15T12:31:59.356572+0000","last_fullsized":"2024-09-15T12:31:59.356572+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"96'771","reported_seq":783,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:10.521825+0000","last_change":"2024-09-15T12:31:58.480532+0000","last_active":"2024-09-15T12:33:10.521825+0000","last_peered":"2024-09-15T12:33:10.521825+0000","last_clean":"2024-09-15T12:33:10.521825+0000","last_became_active":"2024-09-15T12:31:58.468452+0000","last_became_peered":"2024-09-15T12:31:58.468452+0000","last_unstale":"2024-09-15T12:33:10.521825+0000","last_undegraded":"2024-09-15T12:33:10.521825+0000","last_fullsized":"2024-09-15T12:33:10.521825+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50528256,"num_objects":771,"num_object_clones":0,"num_object_copies":2313,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":771,"num_write_kb":49344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":261,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.358054+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:31:59.358054+0000","last_peered":"2024-09-15T12:31:59.358054+0000","last_clean":"2024-09-15T12:31:59.358054+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:31:59.358054+0000","last_undegraded":"2024-09-15T12:31:59.358054+0000","last_fullsized":"2024-09-15T12:31:59.358054+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"96'806","reported_seq":818,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:10.312423+0000","last_change":"2024-09-15T12:31:58.472814+0000","last_active":"2024-09-15T12:33:10.312423+0000","last_peered":"2024-09-15T12:33:10.312423+0000","last_clean":"2024-09-15T12:33:10.312423+0000","last_became_active":"2024-09-15T12:31:58.466600+0000","last_became_peered":"2024-09-15T12:31:58.466600+0000","last_unstale":"2024-09-15T12:33:10.312423+0000","last_undegraded":"2024-09-15T12:33:10.312423+0000","last_fullsized":"2024-09-15T12:33:10.312423+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52822016,"num_objects":806,"num_object_clones":0,"num_object_copies":2418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":806,"num_write_kb":51584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.362774+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:31:59.362774+0000","last_peered":"2024-09-15T12:31:59.362774+0000","last_clean":"2024-09-15T12:31:59.362774+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:31:59.362774+0000","last_undegraded":"2024-09-15T12:31:59.362774+0000","last_fullsized":"2024-09-15T12:31:59.362774+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"96'815","reported_seq":827,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:10.376467+0000","last_change":"2024-09-15T12:31:58.435605+0000","last_active":"2024-09-15T12:33:10.376467+0000","last_peered":"2024-09-15T12:33:10.376467+0000","last_clean":"2024-09-15T12:33:10.376467+0000","last_became_active":"2024-09-15T12:31:58.429332+0000","last_became_peered":"2024-09-15T12:31:58.429332+0000","last_unstale":"2024-09-15T12:33:10.376467+0000","last_undegraded":"2024-09-15T12:33:10.376467+0000","last_fullsized":"2024-09-15T12:33:10.376467+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53411840,"num_objects":815,"num_object_clones":0,"num_object_copies":2445,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":815,"num_write_kb":52160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.360240+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:31:59.360240+0000","last_peered":"2024-09-15T12:31:59.360240+0000","last_clean":"2024-09-15T12:31:59.360240+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:31:59.360240+0000","last_undegraded":"2024-09-15T12:31:59.360240+0000","last_fullsized":"2024-09-15T12:31:59.360240+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"96'791","reported_seq":803,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:11.700534+0000","last_change":"2024-09-15T12:31:58.492392+0000","last_active":"2024-09-15T12:33:11.700534+0000","last_peered":"2024-09-15T12:33:11.700534+0000","last_clean":"2024-09-15T12:33:11.700534+0000","last_became_active":"2024-09-15T12:31:58.466633+0000","last_became_peered":"2024-09-15T12:31:58.466633+0000","last_unstale":"2024-09-15T12:33:11.700534+0000","last_undegraded":"2024-09-15T12:33:11.700534+0000","last_fullsized":"2024-09-15T12:33:11.700534+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51838976,"num_objects":791,"num_object_clones":0,"num_object_copies":2373,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":791,"num_write_kb":50624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.360118+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:31:59.360118+0000","last_peered":"2024-09-15T12:31:59.360118+0000","last_clean":"2024-09-15T12:31:59.360118+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:31:59.360118+0000","last_undegraded":"2024-09-15T12:31:59.360118+0000","last_fullsized":"2024-09-15T12:31:59.360118+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"96'790","reported_seq":802,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:11.795070+0000","last_change":"2024-09-15T12:31:58.524245+0000","last_active":"2024-09-15T12:33:11.795070+0000","last_peered":"2024-09-15T12:33:11.795070+0000","last_clean":"2024-09-15T12:33:11.795070+0000","last_became_active":"2024-09-15T12:31:58.516700+0000","last_became_peered":"2024-09-15T12:31:58.516700+0000","last_unstale":"2024-09-15T12:33:11.795070+0000","last_undegraded":"2024-09-15T12:33:11.795070+0000","last_fullsized":"2024-09-15T12:33:11.795070+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":790,"log_dups_size":0,"ondisk_log_size":790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51773440,"num_objects":790,"num_object_clones":0,"num_object_copies":2370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":790,"num_write_kb":50560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.363584+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:31:59.363584+0000","last_peered":"2024-09-15T12:31:59.363584+0000","last_clean":"2024-09-15T12:31:59.363584+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:31:59.363584+0000","last_undegraded":"2024-09-15T12:31:59.363584+0000","last_fullsized":"2024-09-15T12:31:59.363584+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":822280192,"num_objects":12547,"num_object_clones":0,"num_object_copies":37641,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12547,"num_write_kb":803008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":154030080,"data_stored":2464481280,"data_compressed":117023427,"data_compressed_allocated":154030080,"data_compressed_original":2464481280,"omap_allocated":0,"internal_metadata":0},"log_size":12547,"ondisk_log_size":12547,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673827,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":77984,"kb_used_data":47760,"kb_used_omap":0,"kb_used_meta":30208,"kb_avail":94293856,"statfs":{"total":96636764160,"available":96556908544,"internally_reserved":0,"allocated":48906240,"data_stored":769500825,"data_compressed":36526521,"data_compressed_allocated":48078848,"data_compressed_original":769179648,"omap_allocated":0,"internal_metadata":30932992},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706532,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":154340,"kb_used_data":28948,"kb_used_omap":0,"kb_used_meta":125376,"kb_avail":94217500,"statfs":{"total":96636764160,"available":96478720000,"internally_reserved":0,"allocated":29642752,"data_stored":461219500,"data_compressed":21888073,"data_compressed_allocated":28811264,"data_compressed_original":460898304,"omap_allocated":0,"internal_metadata":128385024},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706532,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":88288,"kb_used_data":41168,"kb_used_omap":0,"kb_used_meta":47104,"kb_avail":94283552,"statfs":{"total":96636764160,"available":96546357248,"internally_reserved":0,"allocated":42156032,"data_stored":661824652,"data_compressed":31411621,"data_compressed_allocated":41345024,"data_compressed_original":661520384,"omap_allocated":0,"internal_metadata":48234496},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706531,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":64896,"kb_used_data":34800,"kb_used_omap":0,"kb_used_meta":30080,"kb_avail":94306944,"statfs":{"total":96636764160,"available":96570310656,"internally_reserved":0,"allocated":35635200,"data_stored":557098668,"data_compressed":26440844,"data_compressed_allocated":34803712,"data_compressed_original":556777472,"omap_allocated":0,"internal_metadata":30801920},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":35184640,"data_stored":562954240,"data_compressed":26731348,"data_compressed_allocated":35184640,"data_compressed_original":562954240,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41369600,"data_stored":661913600,"data_compressed":31430293,"data_compressed_allocated":41369600,"data_compressed_original":661913600,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28794880,"data_stored":460718080,"data_compressed":21876713,"data_compressed_allocated":28794880,"data_compressed_original":460718080,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":48680960,"data_stored":778895360,"data_compressed":36985073,"data_compressed_allocated":48680960,"data_compressed_original":778895360,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:33:34.072 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:33:34.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:34.232+0000 7fb0b1c23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:34.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:34.240+0000 7fb0b1c23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:36.646 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:33:36.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:36.774+0000 7f36ab2bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:36.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:36.781+0000 7f36ab2bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:37.032 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:33:37.032 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:33:37.032 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:33:37.032 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:33:37.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:37.174+0000 7fd1cb911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:37.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:37.185+0000 7fd1cb911640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:37.270 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:33:37.270 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:33:37.270 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:33:37.270 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:33:37.270 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:33:37.270 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:33:37.270 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:33:37.270 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:33:37.270 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:33:37.270 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:33:37.271 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:33:37.271 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:33:37.275 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:33:37.275 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:33:37.275 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:33:37.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:37.412+0000 7f6324791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:37.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:37.430+0000 7f6324791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:37.555 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:33:37.555 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:33:37.555 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:33:37.555 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:33:37.555 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:33:37.555 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:33:37.555 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:33:37.555 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:33:37.555 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:33:37.555 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:33:37.555 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:33:37.555 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:33:37.559 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:33:37.559 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:33:37.559 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:33:37.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:37.698+0000 7f80a8b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:37.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:37.710+0000 7f80a8b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:37.742 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:33:37.742 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:33:37.742 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:33:37.742 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:33:37.742 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:33:37.742 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:33:37.742 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:33:37.742 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:33:37.742 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:33:37.742 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:33:37.742 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:33:37.742 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:33:37.746 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:33:37.747 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:33:37.747 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:33:37.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:37.885+0000 7fd9b3711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:37.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:37.900+0000 7fd9b3711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:37.998 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:33:37.998 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:33:37.998 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:33:37.998 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:33:37.998 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:33:37.998 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:33:37.998 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:33:37.998 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:33:37.998 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:33:37.998 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:33:37.998 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:33:37.999 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:33:38.002 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:33:38.002 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:33:39.058 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:33:39.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:39.216+0000 7f0db4abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:39.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:39.223+0000 7f0db4abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:41.703 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:33:41.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:41.845+0000 7f4ea3511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:41.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:41.852+0000 7f4ea3511640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:43.003 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:33:43.003 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:33:43.003 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:33:43.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:43.138+0000 7fec5227d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:43.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:43.153+0000 7fec5227d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:43.436 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:33:43.436 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:33:43.458 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":539,"stamp":"2024-09-15T12:33:41.881237+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":887030347,"num_objects":13531,"num_object_clones":0,"num_object_copies":40593,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":17674,"num_write_kb":996885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17648,"ondisk_log_size":17648,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":408616,"kb_used_data":167456,"kb_used_omap":0,"kb_used_meta":241088,"kb_avail":377078744,"statfs":{"total":386547056640,"available":386128633856,"internally_reserved":0,"allocated":171474944,"data_stored":2691602629,"data_compressed":127759893,"data_compressed_allocated":168161280,"data_compressed_original":2690334720,"omap_allocated":0,"internal_metadata":246874112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":64159768,"num_objects":980,"num_object_clones":0,"num_object_copies":2940,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5046,"num_write_kb":192769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002269"},"pg_stats":[{"pgid":"7.f","version":"96'1106","reported_seq":1118,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:41.595885+0000","last_change":"2024-09-15T12:31:58.539371+0000","last_active":"2024-09-15T12:33:41.595885+0000","last_peered":"2024-09-15T12:33:41.595885+0000","last_clean":"2024-09-15T12:33:41.595885+0000","last_became_active":"2024-09-15T12:31:58.529616+0000","last_became_peered":"2024-09-15T12:31:58.529616+0000","last_unstale":"2024-09-15T12:33:41.595885+0000","last_undegraded":"2024-09-15T12:33:41.595885+0000","last_fullsized":"2024-09-15T12:33:41.595885+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1106,"log_dups_size":0,"ondisk_log_size":1106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54919168,"num_objects":838,"num_object_clones":0,"num_object_copies":2514,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1106,"num_write_kb":62208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"96'1067","reported_seq":1079,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:40.758242+0000","last_change":"2024-09-15T12:31:58.494396+0000","last_active":"2024-09-15T12:33:40.758242+0000","last_peered":"2024-09-15T12:33:40.758242+0000","last_clean":"2024-09-15T12:33:40.758242+0000","last_became_active":"2024-09-15T12:31:58.482932+0000","last_became_peered":"2024-09-15T12:31:58.482932+0000","last_unstale":"2024-09-15T12:33:40.758242+0000","last_undegraded":"2024-09-15T12:33:40.758242+0000","last_fullsized":"2024-09-15T12:33:40.758242+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1067,"log_dups_size":0,"ondisk_log_size":1067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55115776,"num_objects":841,"num_object_clones":0,"num_object_copies":2523,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1067,"num_write_kb":61056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"96'1086","reported_seq":1099,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:40.412721+0000","last_change":"2024-09-15T12:31:58.494069+0000","last_active":"2024-09-15T12:33:40.412721+0000","last_peered":"2024-09-15T12:33:40.412721+0000","last_clean":"2024-09-15T12:33:40.412721+0000","last_became_active":"2024-09-15T12:31:58.483561+0000","last_became_peered":"2024-09-15T12:31:58.483561+0000","last_unstale":"2024-09-15T12:33:40.412721+0000","last_undegraded":"2024-09-15T12:33:40.412721+0000","last_fullsized":"2024-09-15T12:33:40.412721+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1086,"log_dups_size":0,"ondisk_log_size":1086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56033304,"num_objects":856,"num_object_clones":0,"num_object_copies":2568,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1086,"num_write_kb":62081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"96'1031","reported_seq":1043,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:40.638049+0000","last_change":"2024-09-15T12:31:58.531562+0000","last_active":"2024-09-15T12:33:40.638049+0000","last_peered":"2024-09-15T12:33:40.638049+0000","last_clean":"2024-09-15T12:33:40.638049+0000","last_became_active":"2024-09-15T12:31:58.525598+0000","last_became_peered":"2024-09-15T12:31:58.525598+0000","last_unstale":"2024-09-15T12:33:40.638049+0000","last_undegraded":"2024-09-15T12:33:40.638049+0000","last_fullsized":"2024-09-15T12:33:40.638049+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1031,"log_dups_size":0,"ondisk_log_size":1031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53149696,"num_objects":811,"num_object_clones":0,"num_object_copies":2433,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1031,"num_write_kb":58944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"96'1067","reported_seq":1079,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:41.680002+0000","last_change":"2024-09-15T12:31:58.544695+0000","last_active":"2024-09-15T12:33:41.680002+0000","last_peered":"2024-09-15T12:33:41.680002+0000","last_clean":"2024-09-15T12:33:41.680002+0000","last_became_active":"2024-09-15T12:31:58.536224+0000","last_became_peered":"2024-09-15T12:31:58.536224+0000","last_unstale":"2024-09-15T12:33:41.680002+0000","last_undegraded":"2024-09-15T12:33:41.680002+0000","last_fullsized":"2024-09-15T12:33:41.680002+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1067,"log_dups_size":0,"ondisk_log_size":1067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54198272,"num_objects":827,"num_object_clones":0,"num_object_copies":2481,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1067,"num_write_kb":60608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"96'1111","reported_seq":1123,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:41.781346+0000","last_change":"2024-09-15T12:31:58.503374+0000","last_active":"2024-09-15T12:33:41.781346+0000","last_peered":"2024-09-15T12:33:41.781346+0000","last_clean":"2024-09-15T12:33:41.781346+0000","last_became_active":"2024-09-15T12:31:58.483732+0000","last_became_peered":"2024-09-15T12:31:58.483732+0000","last_unstale":"2024-09-15T12:33:41.781346+0000","last_undegraded":"2024-09-15T12:33:41.781346+0000","last_fullsized":"2024-09-15T12:33:41.781346+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1111,"log_dups_size":0,"ondisk_log_size":1111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54853632,"num_objects":837,"num_object_clones":0,"num_object_copies":2511,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1111,"num_write_kb":62336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"96'1179","reported_seq":1191,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:40.379228+0000","last_change":"2024-09-15T12:31:58.497018+0000","last_active":"2024-09-15T12:33:40.379228+0000","last_peered":"2024-09-15T12:33:40.379228+0000","last_clean":"2024-09-15T12:33:40.379228+0000","last_became_active":"2024-09-15T12:31:58.489173+0000","last_became_peered":"2024-09-15T12:31:58.489173+0000","last_unstale":"2024-09-15T12:33:40.379228+0000","last_undegraded":"2024-09-15T12:33:40.379228+0000","last_fullsized":"2024-09-15T12:33:40.379228+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1179,"log_dups_size":0,"ondisk_log_size":1179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58261504,"num_objects":889,"num_object_clones":0,"num_object_copies":2667,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1179,"num_write_kb":66176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"96'1075","reported_seq":1087,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:40.628389+0000","last_change":"2024-09-15T12:31:58.524969+0000","last_active":"2024-09-15T12:33:40.628389+0000","last_peered":"2024-09-15T12:33:40.628389+0000","last_clean":"2024-09-15T12:33:40.628389+0000","last_became_active":"2024-09-15T12:31:58.516994+0000","last_became_peered":"2024-09-15T12:31:58.516994+0000","last_unstale":"2024-09-15T12:33:40.628389+0000","last_undegraded":"2024-09-15T12:33:40.628389+0000","last_fullsized":"2024-09-15T12:33:40.628389+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1075,"log_dups_size":0,"ondisk_log_size":1075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55902208,"num_objects":853,"num_object_clones":0,"num_object_copies":2559,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1075,"num_write_kb":61696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"96'1106","reported_seq":1118,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:41.645541+0000","last_change":"2024-09-15T12:31:58.495776+0000","last_active":"2024-09-15T12:33:41.645541+0000","last_peered":"2024-09-15T12:33:41.645541+0000","last_clean":"2024-09-15T12:33:41.645541+0000","last_became_active":"2024-09-15T12:31:58.474993+0000","last_became_peered":"2024-09-15T12:31:58.474993+0000","last_unstale":"2024-09-15T12:33:41.645541+0000","last_undegraded":"2024-09-15T12:33:41.645541+0000","last_fullsized":"2024-09-15T12:33:41.645541+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1106,"log_dups_size":0,"ondisk_log_size":1106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53870592,"num_objects":822,"num_object_clones":0,"num_object_copies":2466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1106,"num_write_kb":61696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":331,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.358933+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:31:59.358933+0000","last_peered":"2024-09-15T12:31:59.358933+0000","last_clean":"2024-09-15T12:31:59.358933+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:31:59.358933+0000","last_undegraded":"2024-09-15T12:31:59.358933+0000","last_fullsized":"2024-09-15T12:31:59.358933+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":260,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.365124+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:31:59.365124+0000","last_peered":"2024-09-15T12:31:59.365124+0000","last_clean":"2024-09-15T12:31:59.365124+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:31:59.365124+0000","last_undegraded":"2024-09-15T12:31:59.365124+0000","last_fullsized":"2024-09-15T12:31:59.365124+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"96'1140","reported_seq":1152,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:40.738744+0000","last_change":"2024-09-15T12:31:58.498915+0000","last_active":"2024-09-15T12:33:40.738744+0000","last_peered":"2024-09-15T12:33:40.738744+0000","last_clean":"2024-09-15T12:33:40.738744+0000","last_became_active":"2024-09-15T12:31:58.487521+0000","last_became_peered":"2024-09-15T12:31:58.487521+0000","last_unstale":"2024-09-15T12:33:40.738744+0000","last_undegraded":"2024-09-15T12:33:40.738744+0000","last_fullsized":"2024-09-15T12:33:40.738744+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1140,"log_dups_size":0,"ondisk_log_size":1140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54657024,"num_objects":834,"num_object_clones":0,"num_object_copies":2502,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":63168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.364819+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:31:59.364819+0000","last_peered":"2024-09-15T12:31:59.364819+0000","last_clean":"2024-09-15T12:31:59.364819+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:31:59.364819+0000","last_undegraded":"2024-09-15T12:31:59.364819+0000","last_fullsized":"2024-09-15T12:31:59.364819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"96'1100","reported_seq":1112,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:40.727583+0000","last_change":"2024-09-15T12:31:58.468104+0000","last_active":"2024-09-15T12:33:40.727583+0000","last_peered":"2024-09-15T12:33:40.727583+0000","last_clean":"2024-09-15T12:33:40.727583+0000","last_became_active":"2024-09-15T12:31:58.462443+0000","last_became_peered":"2024-09-15T12:31:58.462443+0000","last_unstale":"2024-09-15T12:33:40.727583+0000","last_undegraded":"2024-09-15T12:33:40.727583+0000","last_fullsized":"2024-09-15T12:33:40.727583+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1100,"log_dups_size":0,"ondisk_log_size":1100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57409536,"num_objects":876,"num_object_clones":0,"num_object_copies":2628,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1100,"num_write_kb":63232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.356572+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:31:59.356572+0000","last_peered":"2024-09-15T12:31:59.356572+0000","last_clean":"2024-09-15T12:31:59.356572+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:31:59.356572+0000","last_undegraded":"2024-09-15T12:31:59.356572+0000","last_fullsized":"2024-09-15T12:31:59.356572+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"96'1066","reported_seq":1078,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:40.406546+0000","last_change":"2024-09-15T12:31:58.480532+0000","last_active":"2024-09-15T12:33:40.406546+0000","last_peered":"2024-09-15T12:33:40.406546+0000","last_clean":"2024-09-15T12:33:40.406546+0000","last_became_active":"2024-09-15T12:31:58.468452+0000","last_became_peered":"2024-09-15T12:31:58.468452+0000","last_unstale":"2024-09-15T12:33:40.406546+0000","last_undegraded":"2024-09-15T12:33:40.406546+0000","last_fullsized":"2024-09-15T12:33:40.406546+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1066,"log_dups_size":0,"ondisk_log_size":1066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54788096,"num_objects":836,"num_object_clones":0,"num_object_copies":2508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1066,"num_write_kb":60864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":261,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.358054+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:31:59.358054+0000","last_peered":"2024-09-15T12:31:59.358054+0000","last_clean":"2024-09-15T12:31:59.358054+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:31:59.358054+0000","last_undegraded":"2024-09-15T12:31:59.358054+0000","last_fullsized":"2024-09-15T12:31:59.358054+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"96'1126","reported_seq":1138,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:40.770986+0000","last_change":"2024-09-15T12:31:58.472814+0000","last_active":"2024-09-15T12:33:40.770986+0000","last_peered":"2024-09-15T12:33:40.770986+0000","last_clean":"2024-09-15T12:33:40.770986+0000","last_became_active":"2024-09-15T12:31:58.466600+0000","last_became_peered":"2024-09-15T12:31:58.466600+0000","last_unstale":"2024-09-15T12:33:40.770986+0000","last_undegraded":"2024-09-15T12:33:40.770986+0000","last_fullsized":"2024-09-15T12:33:40.770986+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1126,"log_dups_size":0,"ondisk_log_size":1126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57016320,"num_objects":870,"num_object_clones":0,"num_object_copies":2610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1126,"num_write_kb":63872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.362774+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:31:59.362774+0000","last_peered":"2024-09-15T12:31:59.362774+0000","last_clean":"2024-09-15T12:31:59.362774+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:31:59.362774+0000","last_undegraded":"2024-09-15T12:31:59.362774+0000","last_fullsized":"2024-09-15T12:31:59.362774+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"96'1124","reported_seq":1136,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:40.693618+0000","last_change":"2024-09-15T12:31:58.435605+0000","last_active":"2024-09-15T12:33:40.693618+0000","last_peered":"2024-09-15T12:33:40.693618+0000","last_clean":"2024-09-15T12:33:40.693618+0000","last_became_active":"2024-09-15T12:31:58.429332+0000","last_became_peered":"2024-09-15T12:31:58.429332+0000","last_unstale":"2024-09-15T12:33:40.693618+0000","last_undegraded":"2024-09-15T12:33:40.693618+0000","last_fullsized":"2024-09-15T12:33:40.693618+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1124,"log_dups_size":0,"ondisk_log_size":1124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56754176,"num_objects":866,"num_object_clones":0,"num_object_copies":2598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1124,"num_write_kb":63680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.360240+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:31:59.360240+0000","last_peered":"2024-09-15T12:31:59.360240+0000","last_clean":"2024-09-15T12:31:59.360240+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:31:59.360240+0000","last_undegraded":"2024-09-15T12:31:59.360240+0000","last_fullsized":"2024-09-15T12:31:59.360240+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"96'1118","reported_seq":1130,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:41.676457+0000","last_change":"2024-09-15T12:31:58.492392+0000","last_active":"2024-09-15T12:33:41.676457+0000","last_peered":"2024-09-15T12:33:41.676457+0000","last_clean":"2024-09-15T12:33:41.676457+0000","last_became_active":"2024-09-15T12:31:58.466633+0000","last_became_peered":"2024-09-15T12:31:58.466633+0000","last_unstale":"2024-09-15T12:33:41.676457+0000","last_undegraded":"2024-09-15T12:33:41.676457+0000","last_fullsized":"2024-09-15T12:33:41.676457+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1118,"log_dups_size":0,"ondisk_log_size":1118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54788096,"num_objects":836,"num_object_clones":0,"num_object_copies":2508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1118,"num_write_kb":62528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.360118+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:31:59.360118+0000","last_peered":"2024-09-15T12:31:59.360118+0000","last_clean":"2024-09-15T12:31:59.360118+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:31:59.360118+0000","last_undegraded":"2024-09-15T12:31:59.360118+0000","last_fullsized":"2024-09-15T12:31:59.360118+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"96'1091","reported_seq":1103,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:41.651172+0000","last_change":"2024-09-15T12:31:58.524245+0000","last_active":"2024-09-15T12:33:41.651172+0000","last_peered":"2024-09-15T12:33:41.651172+0000","last_clean":"2024-09-15T12:33:41.651172+0000","last_became_active":"2024-09-15T12:31:58.516700+0000","last_became_peered":"2024-09-15T12:31:58.516700+0000","last_unstale":"2024-09-15T12:33:41.651172+0000","last_undegraded":"2024-09-15T12:33:41.651172+0000","last_fullsized":"2024-09-15T12:33:41.651172+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1091,"log_dups_size":0,"ondisk_log_size":1091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54722560,"num_objects":835,"num_object_clones":0,"num_object_copies":2505,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1091,"num_write_kb":61632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.363584+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:31:59.363584+0000","last_peered":"2024-09-15T12:31:59.363584+0000","last_clean":"2024-09-15T12:31:59.363584+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:31:59.363584+0000","last_undegraded":"2024-09-15T12:31:59.363584+0000","last_fullsized":"2024-09-15T12:31:59.363584+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":886439960,"num_objects":13527,"num_object_clones":0,"num_object_copies":40581,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":17593,"num_write_kb":995777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":166313984,"data_stored":2660827208,"data_compressed":126350309,"data_compressed_allocated":166301696,"data_compressed_original":2660827136,"omap_allocated":0,"internal_metadata":0},"log_size":17593,"ondisk_log_size":17593,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673857,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86176,"kb_used_data":51784,"kb_used_omap":0,"kb_used_meta":34368,"kb_avail":94285664,"statfs":{"total":96636764160,"available":96548519936,"internally_reserved":0,"allocated":53026816,"data_stored":835364529,"data_compressed":39655127,"data_compressed_allocated":52195328,"data_compressed_original":835043328,"omap_allocated":0,"internal_metadata":35192832},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706562,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":152808,"kb_used_data":31576,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94219032,"statfs":{"total":96636764160,"available":96480288768,"internally_reserved":0,"allocated":32333824,"data_stored":504211140,"data_compressed":23930191,"data_compressed_allocated":31498240,"data_compressed_original":503889920,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706561,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":88416,"kb_used_data":45456,"kb_used_omap":0,"kb_used_meta":42944,"kb_avail":94283424,"statfs":{"total":96636764160,"available":96546226176,"internally_reserved":0,"allocated":46546944,"data_stored":732013732,"data_compressed":34745479,"data_compressed_allocated":45731840,"data_compressed_original":731709440,"omap_allocated":0,"internal_metadata":43974656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706561,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":81216,"kb_used_data":38640,"kb_used_omap":0,"kb_used_meta":42560,"kb_avail":94290624,"statfs":{"total":96636764160,"available":96553598976,"internally_reserved":0,"allocated":39567360,"data_stored":620013228,"data_compressed":29429096,"data_compressed_allocated":38735872,"data_compressed_original":619692032,"omap_allocated":0,"internal_metadata":43581440},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38248448,"data_stored":611975168,"data_compressed":29059856,"data_compressed_allocated":38248448,"data_compressed_original":611975168,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45146112,"data_stored":722272280,"data_compressed":34297351,"data_compressed_allocated":45142016,"data_compressed_original":722272256,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":31440896,"data_stored":502988824,"data_compressed":23884599,"data_compressed_allocated":31436800,"data_compressed_original":502988800,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":51478528,"data_stored":823590936,"data_compressed":39108503,"data_compressed_allocated":51474432,"data_compressed_original":823590912,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:33:44.107 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:33:44.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:44.252+0000 7faf2bd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:44.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:44.261+0000 7faf2bd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:46.565 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:33:46.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:46.701+0000 7fabfa191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:46.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:46.709+0000 7fabfa191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:48.459 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:33:48.460 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:33:48.460 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:33:48.460 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:33:48.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:48.607+0000 7f12b2088640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:48.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:48.623+0000 7f12b2088640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:48.669 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:33:48.669 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:33:48.669 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:33:48.669 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:33:48.669 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:33:48.669 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:33:48.669 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:33:48.670 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:33:48.670 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:33:48.670 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:33:48.670 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:33:48.670 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:33:48.672 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:33:48.673 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:33:48.673 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:33:48.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:48.835+0000 7f43c76d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:48.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:48.848+0000 7f43c76d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:48.921 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:33:48.931 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:33:48.931 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:33:48.931 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:33:48.931 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:33:48.931 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:33:48.931 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:33:48.931 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:33:48.931 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:33:48.931 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:33:48.931 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:33:48.931 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:33:48.931 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:33:48.934 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:33:48.934 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:33:48.934 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:33:49.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:49.064+0000 7fc37aec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:49.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:49.072+0000 7fc37aec8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:49.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:49.134+0000 7fd087191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:49.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:49.152+0000 7fd087191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:49.183 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:33:49.183 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:33:49.183 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:33:49.183 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:33:49.183 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:33:49.183 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:33:49.184 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:33:49.184 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:33:49.184 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:33:49.184 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:33:49.184 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:33:49.184 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:33:49.188 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:33:49.188 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:33:49.189 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:33:49.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:49.341+0000 7f117cb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:49.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:49.356+0000 7f117cb51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:49.439 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:33:49.439 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:33:49.439 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:33:49.440 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:33:49.440 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:33:49.440 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:33:49.440 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:33:49.440 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:33:49.440 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:33:49.440 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:33:49.440 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:33:49.440 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:33:49.443 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:33:49.443 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:33:51.561 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:33:51.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:51.698+0000 7fda6f711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:51.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:51.705+0000 7fda6f711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:54.070 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:33:54.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:54.225+0000 7f4018b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:54.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:54.232+0000 7f4018b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:54.444 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:33:54.444 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:33:54.444 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:33:54.444 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:33:54.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:54.582+0000 7f0a2527f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:54.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:54.595+0000 7f0a2527f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:54.625 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:33:54.625 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:33:54.626 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:33:54.626 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:33:54.626 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:33:54.626 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:33:54.626 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:33:54.626 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:33:54.626 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:33:54.626 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:33:54.626 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:33:54.626 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:33:54.630 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:33:54.630 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:33:54.630 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:33:54.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:54.783+0000 7f06ae8fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:54.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:54.798+0000 7f06ae8fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:54.862 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:33:54.863 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:33:54.863 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:33:54.863 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:33:54.863 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:33:54.863 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:33:54.863 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:33:54.863 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:33:54.863 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:33:54.863 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:33:54.863 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:33:54.863 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:33:54.867 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:33:54.867 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:33:54.867 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:33:55.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:55.010+0000 7f0fee2d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:55.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:55.025+0000 7f0fed06f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:55.074 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:33:55.075 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:33:55.075 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:33:55.075 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:33:55.075 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:33:55.075 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:33:55.075 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:33:55.075 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:33:55.075 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:33:55.075 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:33:55.075 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:33:55.075 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:33:55.078 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:33:55.079 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:33:55.079 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:33:55.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:55.212+0000 7ff0aca88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:55.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:55.225+0000 7ff0aca88640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:55.257 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:33:55.257 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:33:55.257 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:33:55.257 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:33:55.257 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:33:55.257 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:33:55.257 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:33:55.258 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:33:55.258 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:33:55.258 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:33:55.258 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:33:55.258 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:33:55.261 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:33:55.261 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:33:56.429 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:33:56.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:56.585+0000 7feb43b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:56.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:56.592+0000 7feb43b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:58.882 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:33:59.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:59.013+0000 7f91604d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:33:59.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:33:59.020+0000 7f91604d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:00.262 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:34:00.262 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:34:00.262 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:34:00.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:00.414+0000 7f9d1fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:00.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:00.428+0000 7f9d1fd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:00.819 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:34:00.819 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:34:00.840 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":548,"stamp":"2024-09-15T12:33:59.884830+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":887030347,"num_objects":13531,"num_object_clones":0,"num_object_copies":40593,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":17674,"num_write_kb":996885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17648,"ondisk_log_size":17648,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":408616,"kb_used_data":167456,"kb_used_omap":0,"kb_used_meta":241088,"kb_avail":377078744,"statfs":{"total":386547056640,"available":386128633856,"internally_reserved":0,"allocated":171474944,"data_stored":2691602629,"data_compressed":127759893,"data_compressed_allocated":168161280,"data_compressed_original":2690334720,"omap_allocated":0,"internal_metadata":246874112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002290"},"pg_stats":[{"pgid":"7.f","version":"96'1106","reported_seq":1118,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:41.595885+0000","last_change":"2024-09-15T12:31:58.539371+0000","last_active":"2024-09-15T12:33:41.595885+0000","last_peered":"2024-09-15T12:33:41.595885+0000","last_clean":"2024-09-15T12:33:41.595885+0000","last_became_active":"2024-09-15T12:31:58.529616+0000","last_became_peered":"2024-09-15T12:31:58.529616+0000","last_unstale":"2024-09-15T12:33:41.595885+0000","last_undegraded":"2024-09-15T12:33:41.595885+0000","last_fullsized":"2024-09-15T12:33:41.595885+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1106,"log_dups_size":0,"ondisk_log_size":1106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54919168,"num_objects":838,"num_object_clones":0,"num_object_copies":2514,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1106,"num_write_kb":62208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"96'1067","reported_seq":1079,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:40.758242+0000","last_change":"2024-09-15T12:31:58.494396+0000","last_active":"2024-09-15T12:33:40.758242+0000","last_peered":"2024-09-15T12:33:40.758242+0000","last_clean":"2024-09-15T12:33:40.758242+0000","last_became_active":"2024-09-15T12:31:58.482932+0000","last_became_peered":"2024-09-15T12:31:58.482932+0000","last_unstale":"2024-09-15T12:33:40.758242+0000","last_undegraded":"2024-09-15T12:33:40.758242+0000","last_fullsized":"2024-09-15T12:33:40.758242+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1067,"log_dups_size":0,"ondisk_log_size":1067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55115776,"num_objects":841,"num_object_clones":0,"num_object_copies":2523,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1067,"num_write_kb":61056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"96'1086","reported_seq":1099,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:40.412721+0000","last_change":"2024-09-15T12:31:58.494069+0000","last_active":"2024-09-15T12:33:40.412721+0000","last_peered":"2024-09-15T12:33:40.412721+0000","last_clean":"2024-09-15T12:33:40.412721+0000","last_became_active":"2024-09-15T12:31:58.483561+0000","last_became_peered":"2024-09-15T12:31:58.483561+0000","last_unstale":"2024-09-15T12:33:40.412721+0000","last_undegraded":"2024-09-15T12:33:40.412721+0000","last_fullsized":"2024-09-15T12:33:40.412721+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1086,"log_dups_size":0,"ondisk_log_size":1086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56033304,"num_objects":856,"num_object_clones":0,"num_object_copies":2568,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1086,"num_write_kb":62081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"96'1031","reported_seq":1043,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:40.638049+0000","last_change":"2024-09-15T12:31:58.531562+0000","last_active":"2024-09-15T12:33:40.638049+0000","last_peered":"2024-09-15T12:33:40.638049+0000","last_clean":"2024-09-15T12:33:40.638049+0000","last_became_active":"2024-09-15T12:31:58.525598+0000","last_became_peered":"2024-09-15T12:31:58.525598+0000","last_unstale":"2024-09-15T12:33:40.638049+0000","last_undegraded":"2024-09-15T12:33:40.638049+0000","last_fullsized":"2024-09-15T12:33:40.638049+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1031,"log_dups_size":0,"ondisk_log_size":1031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53149696,"num_objects":811,"num_object_clones":0,"num_object_copies":2433,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1031,"num_write_kb":58944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"96'1067","reported_seq":1079,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:41.680002+0000","last_change":"2024-09-15T12:31:58.544695+0000","last_active":"2024-09-15T12:33:41.680002+0000","last_peered":"2024-09-15T12:33:41.680002+0000","last_clean":"2024-09-15T12:33:41.680002+0000","last_became_active":"2024-09-15T12:31:58.536224+0000","last_became_peered":"2024-09-15T12:31:58.536224+0000","last_unstale":"2024-09-15T12:33:41.680002+0000","last_undegraded":"2024-09-15T12:33:41.680002+0000","last_fullsized":"2024-09-15T12:33:41.680002+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1067,"log_dups_size":0,"ondisk_log_size":1067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54198272,"num_objects":827,"num_object_clones":0,"num_object_copies":2481,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1067,"num_write_kb":60608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"96'1111","reported_seq":1123,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:41.781346+0000","last_change":"2024-09-15T12:31:58.503374+0000","last_active":"2024-09-15T12:33:41.781346+0000","last_peered":"2024-09-15T12:33:41.781346+0000","last_clean":"2024-09-15T12:33:41.781346+0000","last_became_active":"2024-09-15T12:31:58.483732+0000","last_became_peered":"2024-09-15T12:31:58.483732+0000","last_unstale":"2024-09-15T12:33:41.781346+0000","last_undegraded":"2024-09-15T12:33:41.781346+0000","last_fullsized":"2024-09-15T12:33:41.781346+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1111,"log_dups_size":0,"ondisk_log_size":1111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54853632,"num_objects":837,"num_object_clones":0,"num_object_copies":2511,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1111,"num_write_kb":62336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"96'1179","reported_seq":1191,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:40.379228+0000","last_change":"2024-09-15T12:31:58.497018+0000","last_active":"2024-09-15T12:33:40.379228+0000","last_peered":"2024-09-15T12:33:40.379228+0000","last_clean":"2024-09-15T12:33:40.379228+0000","last_became_active":"2024-09-15T12:31:58.489173+0000","last_became_peered":"2024-09-15T12:31:58.489173+0000","last_unstale":"2024-09-15T12:33:40.379228+0000","last_undegraded":"2024-09-15T12:33:40.379228+0000","last_fullsized":"2024-09-15T12:33:40.379228+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1179,"log_dups_size":0,"ondisk_log_size":1179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58261504,"num_objects":889,"num_object_clones":0,"num_object_copies":2667,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1179,"num_write_kb":66176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"96'1075","reported_seq":1087,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:40.628389+0000","last_change":"2024-09-15T12:31:58.524969+0000","last_active":"2024-09-15T12:33:40.628389+0000","last_peered":"2024-09-15T12:33:40.628389+0000","last_clean":"2024-09-15T12:33:40.628389+0000","last_became_active":"2024-09-15T12:31:58.516994+0000","last_became_peered":"2024-09-15T12:31:58.516994+0000","last_unstale":"2024-09-15T12:33:40.628389+0000","last_undegraded":"2024-09-15T12:33:40.628389+0000","last_fullsized":"2024-09-15T12:33:40.628389+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1075,"log_dups_size":0,"ondisk_log_size":1075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55902208,"num_objects":853,"num_object_clones":0,"num_object_copies":2559,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1075,"num_write_kb":61696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"96'1106","reported_seq":1118,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:41.645541+0000","last_change":"2024-09-15T12:31:58.495776+0000","last_active":"2024-09-15T12:33:41.645541+0000","last_peered":"2024-09-15T12:33:41.645541+0000","last_clean":"2024-09-15T12:33:41.645541+0000","last_became_active":"2024-09-15T12:31:58.474993+0000","last_became_peered":"2024-09-15T12:31:58.474993+0000","last_unstale":"2024-09-15T12:33:41.645541+0000","last_undegraded":"2024-09-15T12:33:41.645541+0000","last_fullsized":"2024-09-15T12:33:41.645541+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1106,"log_dups_size":0,"ondisk_log_size":1106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53870592,"num_objects":822,"num_object_clones":0,"num_object_copies":2466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1106,"num_write_kb":61696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":331,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.358933+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:31:59.358933+0000","last_peered":"2024-09-15T12:31:59.358933+0000","last_clean":"2024-09-15T12:31:59.358933+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:31:59.358933+0000","last_undegraded":"2024-09-15T12:31:59.358933+0000","last_fullsized":"2024-09-15T12:31:59.358933+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":260,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.365124+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:31:59.365124+0000","last_peered":"2024-09-15T12:31:59.365124+0000","last_clean":"2024-09-15T12:31:59.365124+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:31:59.365124+0000","last_undegraded":"2024-09-15T12:31:59.365124+0000","last_fullsized":"2024-09-15T12:31:59.365124+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"96'1140","reported_seq":1152,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:40.738744+0000","last_change":"2024-09-15T12:31:58.498915+0000","last_active":"2024-09-15T12:33:40.738744+0000","last_peered":"2024-09-15T12:33:40.738744+0000","last_clean":"2024-09-15T12:33:40.738744+0000","last_became_active":"2024-09-15T12:31:58.487521+0000","last_became_peered":"2024-09-15T12:31:58.487521+0000","last_unstale":"2024-09-15T12:33:40.738744+0000","last_undegraded":"2024-09-15T12:33:40.738744+0000","last_fullsized":"2024-09-15T12:33:40.738744+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1140,"log_dups_size":0,"ondisk_log_size":1140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54657024,"num_objects":834,"num_object_clones":0,"num_object_copies":2502,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1140,"num_write_kb":63168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.364819+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:31:59.364819+0000","last_peered":"2024-09-15T12:31:59.364819+0000","last_clean":"2024-09-15T12:31:59.364819+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:31:59.364819+0000","last_undegraded":"2024-09-15T12:31:59.364819+0000","last_fullsized":"2024-09-15T12:31:59.364819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"96'1100","reported_seq":1112,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:40.727583+0000","last_change":"2024-09-15T12:31:58.468104+0000","last_active":"2024-09-15T12:33:40.727583+0000","last_peered":"2024-09-15T12:33:40.727583+0000","last_clean":"2024-09-15T12:33:40.727583+0000","last_became_active":"2024-09-15T12:31:58.462443+0000","last_became_peered":"2024-09-15T12:31:58.462443+0000","last_unstale":"2024-09-15T12:33:40.727583+0000","last_undegraded":"2024-09-15T12:33:40.727583+0000","last_fullsized":"2024-09-15T12:33:40.727583+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1100,"log_dups_size":0,"ondisk_log_size":1100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57409536,"num_objects":876,"num_object_clones":0,"num_object_copies":2628,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1100,"num_write_kb":63232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.356572+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:31:59.356572+0000","last_peered":"2024-09-15T12:31:59.356572+0000","last_clean":"2024-09-15T12:31:59.356572+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:31:59.356572+0000","last_undegraded":"2024-09-15T12:31:59.356572+0000","last_fullsized":"2024-09-15T12:31:59.356572+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"96'1066","reported_seq":1078,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:40.406546+0000","last_change":"2024-09-15T12:31:58.480532+0000","last_active":"2024-09-15T12:33:40.406546+0000","last_peered":"2024-09-15T12:33:40.406546+0000","last_clean":"2024-09-15T12:33:40.406546+0000","last_became_active":"2024-09-15T12:31:58.468452+0000","last_became_peered":"2024-09-15T12:31:58.468452+0000","last_unstale":"2024-09-15T12:33:40.406546+0000","last_undegraded":"2024-09-15T12:33:40.406546+0000","last_fullsized":"2024-09-15T12:33:40.406546+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1066,"log_dups_size":0,"ondisk_log_size":1066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54788096,"num_objects":836,"num_object_clones":0,"num_object_copies":2508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1066,"num_write_kb":60864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":261,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.358054+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:31:59.358054+0000","last_peered":"2024-09-15T12:31:59.358054+0000","last_clean":"2024-09-15T12:31:59.358054+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:31:59.358054+0000","last_undegraded":"2024-09-15T12:31:59.358054+0000","last_fullsized":"2024-09-15T12:31:59.358054+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"96'1126","reported_seq":1138,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:40.770986+0000","last_change":"2024-09-15T12:31:58.472814+0000","last_active":"2024-09-15T12:33:40.770986+0000","last_peered":"2024-09-15T12:33:40.770986+0000","last_clean":"2024-09-15T12:33:40.770986+0000","last_became_active":"2024-09-15T12:31:58.466600+0000","last_became_peered":"2024-09-15T12:31:58.466600+0000","last_unstale":"2024-09-15T12:33:40.770986+0000","last_undegraded":"2024-09-15T12:33:40.770986+0000","last_fullsized":"2024-09-15T12:33:40.770986+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1126,"log_dups_size":0,"ondisk_log_size":1126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57016320,"num_objects":870,"num_object_clones":0,"num_object_copies":2610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1126,"num_write_kb":63872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.362774+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:31:59.362774+0000","last_peered":"2024-09-15T12:31:59.362774+0000","last_clean":"2024-09-15T12:31:59.362774+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:31:59.362774+0000","last_undegraded":"2024-09-15T12:31:59.362774+0000","last_fullsized":"2024-09-15T12:31:59.362774+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"96'1124","reported_seq":1136,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:40.693618+0000","last_change":"2024-09-15T12:31:58.435605+0000","last_active":"2024-09-15T12:33:40.693618+0000","last_peered":"2024-09-15T12:33:40.693618+0000","last_clean":"2024-09-15T12:33:40.693618+0000","last_became_active":"2024-09-15T12:31:58.429332+0000","last_became_peered":"2024-09-15T12:31:58.429332+0000","last_unstale":"2024-09-15T12:33:40.693618+0000","last_undegraded":"2024-09-15T12:33:40.693618+0000","last_fullsized":"2024-09-15T12:33:40.693618+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1124,"log_dups_size":0,"ondisk_log_size":1124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56754176,"num_objects":866,"num_object_clones":0,"num_object_copies":2598,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1124,"num_write_kb":63680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.360240+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:31:59.360240+0000","last_peered":"2024-09-15T12:31:59.360240+0000","last_clean":"2024-09-15T12:31:59.360240+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:31:59.360240+0000","last_undegraded":"2024-09-15T12:31:59.360240+0000","last_fullsized":"2024-09-15T12:31:59.360240+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"96'1118","reported_seq":1130,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:41.676457+0000","last_change":"2024-09-15T12:31:58.492392+0000","last_active":"2024-09-15T12:33:41.676457+0000","last_peered":"2024-09-15T12:33:41.676457+0000","last_clean":"2024-09-15T12:33:41.676457+0000","last_became_active":"2024-09-15T12:31:58.466633+0000","last_became_peered":"2024-09-15T12:31:58.466633+0000","last_unstale":"2024-09-15T12:33:41.676457+0000","last_undegraded":"2024-09-15T12:33:41.676457+0000","last_fullsized":"2024-09-15T12:33:41.676457+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1118,"log_dups_size":0,"ondisk_log_size":1118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54788096,"num_objects":836,"num_object_clones":0,"num_object_copies":2508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1118,"num_write_kb":62528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.360118+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:31:59.360118+0000","last_peered":"2024-09-15T12:31:59.360118+0000","last_clean":"2024-09-15T12:31:59.360118+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:31:59.360118+0000","last_undegraded":"2024-09-15T12:31:59.360118+0000","last_fullsized":"2024-09-15T12:31:59.360118+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"96'1091","reported_seq":1103,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:33:41.651172+0000","last_change":"2024-09-15T12:31:58.524245+0000","last_active":"2024-09-15T12:33:41.651172+0000","last_peered":"2024-09-15T12:33:41.651172+0000","last_clean":"2024-09-15T12:33:41.651172+0000","last_became_active":"2024-09-15T12:31:58.516700+0000","last_became_peered":"2024-09-15T12:31:58.516700+0000","last_unstale":"2024-09-15T12:33:41.651172+0000","last_undegraded":"2024-09-15T12:33:41.651172+0000","last_fullsized":"2024-09-15T12:33:41.651172+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1091,"log_dups_size":0,"ondisk_log_size":1091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54722560,"num_objects":835,"num_object_clones":0,"num_object_copies":2505,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1091,"num_write_kb":61632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.363584+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:31:59.363584+0000","last_peered":"2024-09-15T12:31:59.363584+0000","last_clean":"2024-09-15T12:31:59.363584+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:31:59.363584+0000","last_undegraded":"2024-09-15T12:31:59.363584+0000","last_fullsized":"2024-09-15T12:31:59.363584+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":886439960,"num_objects":13527,"num_object_clones":0,"num_object_copies":40581,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":17593,"num_write_kb":995777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":166313984,"data_stored":2660827208,"data_compressed":126350309,"data_compressed_allocated":166301696,"data_compressed_original":2660827136,"omap_allocated":0,"internal_metadata":0},"log_size":17593,"ondisk_log_size":17593,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673857,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":86176,"kb_used_data":51784,"kb_used_omap":0,"kb_used_meta":34368,"kb_avail":94285664,"statfs":{"total":96636764160,"available":96548519936,"internally_reserved":0,"allocated":53026816,"data_stored":835364529,"data_compressed":39655127,"data_compressed_allocated":52195328,"data_compressed_original":835043328,"omap_allocated":0,"internal_metadata":35192832},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706562,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":152808,"kb_used_data":31576,"kb_used_omap":0,"kb_used_meta":121216,"kb_avail":94219032,"statfs":{"total":96636764160,"available":96480288768,"internally_reserved":0,"allocated":32333824,"data_stored":504211140,"data_compressed":23930191,"data_compressed_allocated":31498240,"data_compressed_original":503889920,"omap_allocated":0,"internal_metadata":124125184},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706561,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":88416,"kb_used_data":45456,"kb_used_omap":0,"kb_used_meta":42944,"kb_avail":94283424,"statfs":{"total":96636764160,"available":96546226176,"internally_reserved":0,"allocated":46546944,"data_stored":732013732,"data_compressed":34745479,"data_compressed_allocated":45731840,"data_compressed_original":731709440,"omap_allocated":0,"internal_metadata":43974656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706561,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":81216,"kb_used_data":38640,"kb_used_omap":0,"kb_used_meta":42560,"kb_avail":94290624,"statfs":{"total":96636764160,"available":96553598976,"internally_reserved":0,"allocated":39567360,"data_stored":620013228,"data_compressed":29429096,"data_compressed_allocated":38735872,"data_compressed_original":619692032,"omap_allocated":0,"internal_metadata":43581440},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38248448,"data_stored":611975168,"data_compressed":29059856,"data_compressed_allocated":38248448,"data_compressed_original":611975168,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45146112,"data_stored":722272280,"data_compressed":34297351,"data_compressed_allocated":45142016,"data_compressed_original":722272256,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":31440896,"data_stored":502988824,"data_compressed":23884599,"data_compressed_allocated":31436800,"data_compressed_original":502988800,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":51478528,"data_stored":823590936,"data_compressed":39108503,"data_compressed_allocated":51474432,"data_compressed_original":823590912,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:34:01.335 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:34:01.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:01.482+0000 7f68c9551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:01.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:01.490+0000 7f68c9551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:03.805 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:34:03.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:03.946+0000 7f8ad5d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:03.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:03.953+0000 7f8ad5d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:05.842 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:34:05.842 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:34:05.842 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:34:05.843 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:34:06.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:06.001+0000 7f21e6b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:06.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:06.019+0000 7f21e6b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:06.047 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:34:06.047 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:34:06.047 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:34:06.047 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:34:06.047 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:34:06.048 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:34:06.048 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:34:06.048 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:34:06.048 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:34:06.048 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:34:06.048 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:34:06.048 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:34:06.050 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:34:06.051 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:34:06.051 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:34:06.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:06.178+0000 7f8e34b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:06.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:06.195+0000 7f8e34b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:06.214 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:34:06.214 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:34:06.214 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:34:06.214 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:34:06.214 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:34:06.214 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:34:06.214 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:34:06.214 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:34:06.214 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:34:06.214 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:34:06.214 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:34:06.215 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:34:06.218 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:34:06.218 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:34:06.218 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:34:06.331 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:34:06.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:06.368+0000 7f433d191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:06.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:06.388+0000 7f433d191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:06.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:06.476+0000 7f2843a74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:06.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:06.487+0000 7f2843a74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:06.490 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:34:06.490 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:34:06.490 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:34:06.490 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:34:06.490 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:34:06.491 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:34:06.491 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:34:06.491 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:34:06.491 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:34:06.491 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:34:06.491 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:34:06.491 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:34:06.495 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:34:06.495 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:34:06.495 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:34:06.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:06.636+0000 7f9bce991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:06.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:06.653+0000 7f9bce991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:06.752 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:34:06.752 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:34:06.752 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:34:06.753 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:34:06.753 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:34:06.753 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:34:06.753 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:34:06.753 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:34:06.753 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:34:06.753 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:34:06.753 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:34:06.753 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:34:06.756 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:34:06.756 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:34:08.854 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:34:09.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:09.000+0000 7f56fc191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:09.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:09.007+0000 7f56fc191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:11.389 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:34:11.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:11.527+0000 7f99f8b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:11.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:11.535+0000 7f99f8b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:11.757 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:34:11.815 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:34:11.816 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:34:11.816 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:34:11.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:11.965+0000 7fee7ac7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:11.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:11.980+0000 7fee7ac7d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:12.019 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:34:12.020 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:34:12.020 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:34:12.020 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:34:12.020 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:34:12.020 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:34:12.020 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:34:12.020 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:34:12.020 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:34:12.020 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:34:12.020 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:34:12.020 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:34:12.023 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:34:12.023 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:34:12.024 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:34:12.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:12.181+0000 7fd291311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:12.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:12.193+0000 7fd291311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:12.240 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:34:12.241 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:34:12.241 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:34:12.241 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:34:12.241 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:34:12.241 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:34:12.241 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:34:12.241 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:34:12.241 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:34:12.241 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:34:12.241 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:34:12.241 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:34:12.246 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:34:12.246 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:34:12.246 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:34:12.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:12.387+0000 7fe12ab11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:12.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:12.402+0000 7fe12ab11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:12.477 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:34:12.477 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:34:12.477 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:34:12.477 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:34:12.478 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:34:12.478 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:34:12.478 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:34:12.478 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:34:12.478 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:34:12.478 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:34:12.478 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:34:12.478 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:34:12.480 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:34:12.481 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:34:12.481 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:34:12.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:12.616+0000 7fb16cb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:12.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:12.628+0000 7fb16cb11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:12.720 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:34:12.720 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:34:12.720 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:34:12.720 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:34:12.720 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:34:12.720 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:34:12.720 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:34:12.720 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:34:12.720 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:34:12.721 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:34:12.721 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:34:12.721 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:34:12.723 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:34:12.724 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:34:13.878 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:34:14.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:14.006+0000 7f301e391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:14.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:14.014+0000 7f301e391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:16.380 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:34:16.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:16.533+0000 7f4afd191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:16.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:16.540+0000 7f4afd191640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:17.724 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:34:17.724 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:34:17.725 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:34:17.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:17.864+0000 7fcbc4591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:17.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:17.876+0000 7fcbc4591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:18.249 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:34:18.250 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:34:18.266 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":557,"stamp":"2024-09-15T12:34:17.888339+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":530580043,"num_objects":8092,"num_object_clones":0,"num_object_copies":24276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":23113,"num_write_kb":996885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23087,"ondisk_log_size":23087,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":261304,"kb_used_data":102264,"kb_used_omap":0,"kb_used_meta":158976,"kb_avail":377226056,"statfs":{"total":386547056640,"available":386279481344,"internally_reserved":0,"allocated":104718336,"data_stored":1623496901,"data_compressed":77040517,"data_compressed_allocated":101404672,"data_compressed_original":1622228992,"omap_allocated":0,"internal_metadata":162791424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-356450304,"num_objects":-5439,"num_object_clones":0,"num_object_copies":-16317,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5439,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002284"},"pg_stats":[{"pgid":"7.f","version":"96'1442","reported_seq":1454,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:11.719593+0000","last_change":"2024-09-15T12:31:58.539371+0000","last_active":"2024-09-15T12:34:11.719593+0000","last_peered":"2024-09-15T12:34:11.719593+0000","last_clean":"2024-09-15T12:34:11.719593+0000","last_became_active":"2024-09-15T12:31:58.529616+0000","last_became_peered":"2024-09-15T12:31:58.529616+0000","last_unstale":"2024-09-15T12:34:11.719593+0000","last_undegraded":"2024-09-15T12:34:11.719593+0000","last_fullsized":"2024-09-15T12:34:11.719593+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1442,"log_dups_size":0,"ondisk_log_size":1442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32899072,"num_objects":502,"num_object_clones":0,"num_object_copies":1506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1442,"num_write_kb":62208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"96'1390","reported_seq":1402,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.584484+0000","last_change":"2024-09-15T12:31:58.494396+0000","last_active":"2024-09-15T12:34:10.584484+0000","last_peered":"2024-09-15T12:34:10.584484+0000","last_clean":"2024-09-15T12:34:10.584484+0000","last_became_active":"2024-09-15T12:31:58.482932+0000","last_became_peered":"2024-09-15T12:31:58.482932+0000","last_unstale":"2024-09-15T12:34:10.584484+0000","last_undegraded":"2024-09-15T12:34:10.584484+0000","last_fullsized":"2024-09-15T12:34:10.584484+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1390,"log_dups_size":0,"ondisk_log_size":1390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33947648,"num_objects":518,"num_object_clones":0,"num_object_copies":1554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1390,"num_write_kb":61056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"96'1408","reported_seq":1421,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.606835+0000","last_change":"2024-09-15T12:31:58.494069+0000","last_active":"2024-09-15T12:34:10.606835+0000","last_peered":"2024-09-15T12:34:10.606835+0000","last_clean":"2024-09-15T12:34:10.606835+0000","last_became_active":"2024-09-15T12:31:58.483561+0000","last_became_peered":"2024-09-15T12:31:58.483561+0000","last_unstale":"2024-09-15T12:34:10.606835+0000","last_undegraded":"2024-09-15T12:34:10.606835+0000","last_fullsized":"2024-09-15T12:34:10.606835+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1408,"log_dups_size":0,"ondisk_log_size":1408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34930712,"num_objects":534,"num_object_clones":0,"num_object_copies":1602,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1408,"num_write_kb":62081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"96'1343","reported_seq":1355,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.670987+0000","last_change":"2024-09-15T12:31:58.531562+0000","last_active":"2024-09-15T12:34:10.670987+0000","last_peered":"2024-09-15T12:34:10.670987+0000","last_clean":"2024-09-15T12:34:10.670987+0000","last_became_active":"2024-09-15T12:31:58.525598+0000","last_became_peered":"2024-09-15T12:31:58.525598+0000","last_unstale":"2024-09-15T12:34:10.670987+0000","last_undegraded":"2024-09-15T12:34:10.670987+0000","last_fullsized":"2024-09-15T12:34:10.670987+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32702464,"num_objects":499,"num_object_clones":0,"num_object_copies":1497,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1343,"num_write_kb":58944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"96'1403","reported_seq":1415,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:11.506750+0000","last_change":"2024-09-15T12:31:58.544695+0000","last_active":"2024-09-15T12:34:11.506750+0000","last_peered":"2024-09-15T12:34:11.506750+0000","last_clean":"2024-09-15T12:34:11.506750+0000","last_became_active":"2024-09-15T12:31:58.536224+0000","last_became_peered":"2024-09-15T12:31:58.536224+0000","last_unstale":"2024-09-15T12:34:11.506750+0000","last_undegraded":"2024-09-15T12:34:11.506750+0000","last_fullsized":"2024-09-15T12:34:11.506750+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1403,"log_dups_size":0,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32178176,"num_objects":491,"num_object_clones":0,"num_object_copies":1473,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1403,"num_write_kb":60608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"96'1486","reported_seq":1498,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:11.645005+0000","last_change":"2024-09-15T12:31:58.503374+0000","last_active":"2024-09-15T12:34:11.645005+0000","last_peered":"2024-09-15T12:34:11.645005+0000","last_clean":"2024-09-15T12:34:11.645005+0000","last_became_active":"2024-09-15T12:31:58.483732+0000","last_became_peered":"2024-09-15T12:31:58.483732+0000","last_unstale":"2024-09-15T12:34:11.645005+0000","last_undegraded":"2024-09-15T12:34:11.645005+0000","last_fullsized":"2024-09-15T12:34:11.645005+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1486,"log_dups_size":0,"ondisk_log_size":1486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1486,"num_write_kb":62336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"96'1522","reported_seq":1534,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.213754+0000","last_change":"2024-09-15T12:31:58.497018+0000","last_active":"2024-09-15T12:34:10.213754+0000","last_peered":"2024-09-15T12:34:10.213754+0000","last_clean":"2024-09-15T12:34:10.213754+0000","last_became_active":"2024-09-15T12:31:58.489173+0000","last_became_peered":"2024-09-15T12:31:58.489173+0000","last_unstale":"2024-09-15T12:34:10.213754+0000","last_undegraded":"2024-09-15T12:34:10.213754+0000","last_fullsized":"2024-09-15T12:34:10.213754+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1522,"log_dups_size":0,"ondisk_log_size":1522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35782656,"num_objects":546,"num_object_clones":0,"num_object_copies":1638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1522,"num_write_kb":66176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"96'1436","reported_seq":1448,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.417600+0000","last_change":"2024-09-15T12:31:58.524969+0000","last_active":"2024-09-15T12:34:10.417600+0000","last_peered":"2024-09-15T12:34:10.417600+0000","last_clean":"2024-09-15T12:34:10.417600+0000","last_became_active":"2024-09-15T12:31:58.516994+0000","last_became_peered":"2024-09-15T12:31:58.516994+0000","last_unstale":"2024-09-15T12:34:10.417600+0000","last_undegraded":"2024-09-15T12:34:10.417600+0000","last_fullsized":"2024-09-15T12:34:10.417600+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1436,"log_dups_size":0,"ondisk_log_size":1436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32243712,"num_objects":492,"num_object_clones":0,"num_object_copies":1476,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1436,"num_write_kb":61696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"96'1411","reported_seq":1423,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:11.796484+0000","last_change":"2024-09-15T12:31:58.495776+0000","last_active":"2024-09-15T12:34:11.796484+0000","last_peered":"2024-09-15T12:34:11.796484+0000","last_clean":"2024-09-15T12:34:11.796484+0000","last_became_active":"2024-09-15T12:31:58.474993+0000","last_became_peered":"2024-09-15T12:31:58.474993+0000","last_unstale":"2024-09-15T12:34:11.796484+0000","last_undegraded":"2024-09-15T12:34:11.796484+0000","last_fullsized":"2024-09-15T12:34:11.796484+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1411,"log_dups_size":0,"ondisk_log_size":1411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33882112,"num_objects":517,"num_object_clones":0,"num_object_copies":1551,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1411,"num_write_kb":61696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":331,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.358933+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:31:59.358933+0000","last_peered":"2024-09-15T12:31:59.358933+0000","last_clean":"2024-09-15T12:31:59.358933+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:31:59.358933+0000","last_undegraded":"2024-09-15T12:31:59.358933+0000","last_fullsized":"2024-09-15T12:31:59.358933+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":260,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.365124+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:31:59.365124+0000","last_peered":"2024-09-15T12:31:59.365124+0000","last_clean":"2024-09-15T12:31:59.365124+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:31:59.365124+0000","last_undegraded":"2024-09-15T12:31:59.365124+0000","last_fullsized":"2024-09-15T12:31:59.365124+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"96'1479","reported_seq":1491,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.667469+0000","last_change":"2024-09-15T12:31:58.498915+0000","last_active":"2024-09-15T12:34:10.667469+0000","last_peered":"2024-09-15T12:34:10.667469+0000","last_clean":"2024-09-15T12:34:10.667469+0000","last_became_active":"2024-09-15T12:31:58.487521+0000","last_became_peered":"2024-09-15T12:31:58.487521+0000","last_unstale":"2024-09-15T12:34:10.667469+0000","last_undegraded":"2024-09-15T12:34:10.667469+0000","last_fullsized":"2024-09-15T12:34:10.667469+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1479,"log_dups_size":0,"ondisk_log_size":1479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32440320,"num_objects":495,"num_object_clones":0,"num_object_copies":1485,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1479,"num_write_kb":63168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.364819+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:31:59.364819+0000","last_peered":"2024-09-15T12:31:59.364819+0000","last_clean":"2024-09-15T12:31:59.364819+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:31:59.364819+0000","last_undegraded":"2024-09-15T12:31:59.364819+0000","last_fullsized":"2024-09-15T12:31:59.364819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"96'1456","reported_seq":1468,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.571124+0000","last_change":"2024-09-15T12:31:58.468104+0000","last_active":"2024-09-15T12:34:10.571124+0000","last_peered":"2024-09-15T12:34:10.571124+0000","last_clean":"2024-09-15T12:34:10.571124+0000","last_became_active":"2024-09-15T12:31:58.462443+0000","last_became_peered":"2024-09-15T12:31:58.462443+0000","last_unstale":"2024-09-15T12:34:10.571124+0000","last_undegraded":"2024-09-15T12:34:10.571124+0000","last_fullsized":"2024-09-15T12:34:10.571124+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1456,"log_dups_size":0,"ondisk_log_size":1456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34078720,"num_objects":520,"num_object_clones":0,"num_object_copies":1560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1456,"num_write_kb":63232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.356572+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:31:59.356572+0000","last_peered":"2024-09-15T12:31:59.356572+0000","last_clean":"2024-09-15T12:31:59.356572+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:31:59.356572+0000","last_undegraded":"2024-09-15T12:31:59.356572+0000","last_fullsized":"2024-09-15T12:31:59.356572+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"96'1395","reported_seq":1407,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.668010+0000","last_change":"2024-09-15T12:31:58.480532+0000","last_active":"2024-09-15T12:34:10.668010+0000","last_peered":"2024-09-15T12:34:10.668010+0000","last_clean":"2024-09-15T12:34:10.668010+0000","last_became_active":"2024-09-15T12:31:58.468452+0000","last_became_peered":"2024-09-15T12:31:58.468452+0000","last_unstale":"2024-09-15T12:34:10.668010+0000","last_undegraded":"2024-09-15T12:34:10.668010+0000","last_fullsized":"2024-09-15T12:34:10.668010+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1395,"log_dups_size":0,"ondisk_log_size":1395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33226752,"num_objects":507,"num_object_clones":0,"num_object_copies":1521,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1395,"num_write_kb":60864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":261,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.358054+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:31:59.358054+0000","last_peered":"2024-09-15T12:31:59.358054+0000","last_clean":"2024-09-15T12:31:59.358054+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:31:59.358054+0000","last_undegraded":"2024-09-15T12:31:59.358054+0000","last_fullsized":"2024-09-15T12:31:59.358054+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"96'1488","reported_seq":1500,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.325093+0000","last_change":"2024-09-15T12:31:58.472814+0000","last_active":"2024-09-15T12:34:10.325093+0000","last_peered":"2024-09-15T12:34:10.325093+0000","last_clean":"2024-09-15T12:34:10.325093+0000","last_became_active":"2024-09-15T12:31:58.466600+0000","last_became_peered":"2024-09-15T12:31:58.466600+0000","last_unstale":"2024-09-15T12:34:10.325093+0000","last_undegraded":"2024-09-15T12:34:10.325093+0000","last_fullsized":"2024-09-15T12:34:10.325093+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1488,"log_dups_size":0,"ondisk_log_size":1488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33292288,"num_objects":508,"num_object_clones":0,"num_object_copies":1524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1488,"num_write_kb":63872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.362774+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:31:59.362774+0000","last_peered":"2024-09-15T12:31:59.362774+0000","last_clean":"2024-09-15T12:31:59.362774+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:31:59.362774+0000","last_undegraded":"2024-09-15T12:31:59.362774+0000","last_fullsized":"2024-09-15T12:31:59.362774+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"96'1486","reported_seq":1498,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.698415+0000","last_change":"2024-09-15T12:31:58.435605+0000","last_active":"2024-09-15T12:34:10.698415+0000","last_peered":"2024-09-15T12:34:10.698415+0000","last_clean":"2024-09-15T12:34:10.698415+0000","last_became_active":"2024-09-15T12:31:58.429332+0000","last_became_peered":"2024-09-15T12:31:58.429332+0000","last_unstale":"2024-09-15T12:34:10.698415+0000","last_undegraded":"2024-09-15T12:34:10.698415+0000","last_fullsized":"2024-09-15T12:34:10.698415+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1486,"log_dups_size":0,"ondisk_log_size":1486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33030144,"num_objects":504,"num_object_clones":0,"num_object_copies":1512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1486,"num_write_kb":63680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.360240+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:31:59.360240+0000","last_peered":"2024-09-15T12:31:59.360240+0000","last_clean":"2024-09-15T12:31:59.360240+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:31:59.360240+0000","last_undegraded":"2024-09-15T12:31:59.360240+0000","last_fullsized":"2024-09-15T12:31:59.360240+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"96'1444","reported_seq":1456,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:11.750559+0000","last_change":"2024-09-15T12:31:58.492392+0000","last_active":"2024-09-15T12:34:11.750559+0000","last_peered":"2024-09-15T12:34:11.750559+0000","last_clean":"2024-09-15T12:34:11.750559+0000","last_became_active":"2024-09-15T12:31:58.466633+0000","last_became_peered":"2024-09-15T12:31:58.466633+0000","last_unstale":"2024-09-15T12:34:11.750559+0000","last_undegraded":"2024-09-15T12:34:11.750559+0000","last_fullsized":"2024-09-15T12:34:11.750559+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1444,"log_dups_size":0,"ondisk_log_size":1444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33423360,"num_objects":510,"num_object_clones":0,"num_object_copies":1530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1444,"num_write_kb":62528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.360118+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:31:59.360118+0000","last_peered":"2024-09-15T12:31:59.360118+0000","last_clean":"2024-09-15T12:31:59.360118+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:31:59.360118+0000","last_undegraded":"2024-09-15T12:31:59.360118+0000","last_fullsized":"2024-09-15T12:31:59.360118+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"96'1443","reported_seq":1455,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:11.719608+0000","last_change":"2024-09-15T12:31:58.524245+0000","last_active":"2024-09-15T12:34:11.719608+0000","last_peered":"2024-09-15T12:34:11.719608+0000","last_clean":"2024-09-15T12:34:11.719608+0000","last_became_active":"2024-09-15T12:31:58.516700+0000","last_became_peered":"2024-09-15T12:31:58.516700+0000","last_unstale":"2024-09-15T12:34:11.719608+0000","last_undegraded":"2024-09-15T12:34:11.719608+0000","last_fullsized":"2024-09-15T12:34:11.719608+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1443,"log_dups_size":0,"ondisk_log_size":1443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31653888,"num_objects":483,"num_object_clones":0,"num_object_copies":1449,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1443,"num_write_kb":61632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.363584+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:31:59.363584+0000","last_peered":"2024-09-15T12:31:59.363584+0000","last_clean":"2024-09-15T12:31:59.363584+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:31:59.363584+0000","last_undegraded":"2024-09-15T12:31:59.363584+0000","last_fullsized":"2024-09-15T12:31:59.363584+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":529989656,"num_objects":8088,"num_object_clones":0,"num_object_copies":24264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":23032,"num_write_kb":995777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":99479552,"data_stored":1591476296,"data_compressed":75571805,"data_compressed_allocated":99467264,"data_compressed_original":1591476224,"omap_allocated":0,"internal_metadata":0},"log_size":23032,"ondisk_log_size":23032,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69776,"kb_used_data":31232,"kb_used_omap":0,"kb_used_meta":38528,"kb_avail":94302064,"statfs":{"total":96636764160,"available":96565313536,"internally_reserved":0,"allocated":31981568,"data_stored":498640561,"data_compressed":23665671,"data_compressed_allocated":31150080,"data_compressed_original":498319360,"omap_allocated":0,"internal_metadata":39452672},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706591,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50472,"kb_used_data":19672,"kb_used_omap":0,"kb_used_meta":30784,"kb_avail":94321368,"statfs":{"total":96636764160,"available":96585080832,"internally_reserved":0,"allocated":20144128,"data_stored":309176004,"data_compressed":14668879,"data_compressed_allocated":19308544,"data_compressed_original":308854784,"omap_allocated":0,"internal_metadata":31522816},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706591,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74964,"kb_used_data":27844,"kb_used_omap":0,"kb_used_meta":47104,"kb_avail":94296876,"statfs":{"total":96636764160,"available":96560001024,"internally_reserved":0,"allocated":28512256,"data_stored":443458724,"data_compressed":21043343,"data_compressed_allocated":27697152,"data_compressed_original":443154432,"omap_allocated":0,"internal_metadata":48234496},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706591,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66092,"kb_used_data":23516,"kb_used_omap":0,"kb_used_meta":42560,"kb_avail":94305748,"statfs":{"total":96636764160,"available":96569085952,"internally_reserved":0,"allocated":24080384,"data_stored":372221612,"data_compressed":17662624,"data_compressed_allocated":23248896,"data_compressed_original":371900416,"omap_allocated":0,"internal_metadata":43581440},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":22843392,"data_stored":365494272,"data_compressed":17355624,"data_compressed_allocated":22843392,"data_compressed_original":365494272,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27201536,"data_stored":435159064,"data_compressed":20663679,"data_compressed_allocated":27197440,"data_compressed_original":435159040,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18890752,"data_stored":302186520,"data_compressed":14349431,"data_compressed_allocated":18886656,"data_compressed_original":302186496,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":30543872,"data_stored":488636440,"data_compressed":23203071,"data_compressed_allocated":30539776,"data_compressed_original":488636416,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:34:18.741 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:34:18.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:18.879+0000 7f2445474640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:18.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:18.886+0000 7f2445474640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:21.119 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:34:21.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:21.245+0000 7f518847f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:21.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:21.253+0000 7f518847f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:23.268 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:34:23.268 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:34:23.268 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:34:23.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:23.418+0000 7f209a551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:23.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:23.432+0000 7f209a551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:23.589 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:34:23.694 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:34:23.695 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:34:23.718 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":559,"stamp":"2024-09-15T12:34:21.889231+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":530580043,"num_objects":8092,"num_object_clones":0,"num_object_copies":24276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":23113,"num_write_kb":996885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23087,"ondisk_log_size":23087,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":261304,"kb_used_data":102264,"kb_used_omap":0,"kb_used_meta":158976,"kb_avail":377226056,"statfs":{"total":386547056640,"available":386279481344,"internally_reserved":0,"allocated":104718336,"data_stored":1623496901,"data_compressed":77040517,"data_compressed_allocated":101404672,"data_compressed_original":1622228992,"omap_allocated":0,"internal_metadata":162791424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-356450304,"num_objects":-5439,"num_object_clones":0,"num_object_copies":-16317,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5439,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002387"},"pg_stats":[{"pgid":"7.f","version":"96'1442","reported_seq":1454,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:11.719593+0000","last_change":"2024-09-15T12:31:58.539371+0000","last_active":"2024-09-15T12:34:11.719593+0000","last_peered":"2024-09-15T12:34:11.719593+0000","last_clean":"2024-09-15T12:34:11.719593+0000","last_became_active":"2024-09-15T12:31:58.529616+0000","last_became_peered":"2024-09-15T12:31:58.529616+0000","last_unstale":"2024-09-15T12:34:11.719593+0000","last_undegraded":"2024-09-15T12:34:11.719593+0000","last_fullsized":"2024-09-15T12:34:11.719593+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1442,"log_dups_size":0,"ondisk_log_size":1442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32899072,"num_objects":502,"num_object_clones":0,"num_object_copies":1506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1442,"num_write_kb":62208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"96'1390","reported_seq":1402,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.584484+0000","last_change":"2024-09-15T12:31:58.494396+0000","last_active":"2024-09-15T12:34:10.584484+0000","last_peered":"2024-09-15T12:34:10.584484+0000","last_clean":"2024-09-15T12:34:10.584484+0000","last_became_active":"2024-09-15T12:31:58.482932+0000","last_became_peered":"2024-09-15T12:31:58.482932+0000","last_unstale":"2024-09-15T12:34:10.584484+0000","last_undegraded":"2024-09-15T12:34:10.584484+0000","last_fullsized":"2024-09-15T12:34:10.584484+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1390,"log_dups_size":0,"ondisk_log_size":1390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33947648,"num_objects":518,"num_object_clones":0,"num_object_copies":1554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1390,"num_write_kb":61056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"96'1408","reported_seq":1421,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.606835+0000","last_change":"2024-09-15T12:31:58.494069+0000","last_active":"2024-09-15T12:34:10.606835+0000","last_peered":"2024-09-15T12:34:10.606835+0000","last_clean":"2024-09-15T12:34:10.606835+0000","last_became_active":"2024-09-15T12:31:58.483561+0000","last_became_peered":"2024-09-15T12:31:58.483561+0000","last_unstale":"2024-09-15T12:34:10.606835+0000","last_undegraded":"2024-09-15T12:34:10.606835+0000","last_fullsized":"2024-09-15T12:34:10.606835+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1408,"log_dups_size":0,"ondisk_log_size":1408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34930712,"num_objects":534,"num_object_clones":0,"num_object_copies":1602,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1408,"num_write_kb":62081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"96'1343","reported_seq":1355,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.670987+0000","last_change":"2024-09-15T12:31:58.531562+0000","last_active":"2024-09-15T12:34:10.670987+0000","last_peered":"2024-09-15T12:34:10.670987+0000","last_clean":"2024-09-15T12:34:10.670987+0000","last_became_active":"2024-09-15T12:31:58.525598+0000","last_became_peered":"2024-09-15T12:31:58.525598+0000","last_unstale":"2024-09-15T12:34:10.670987+0000","last_undegraded":"2024-09-15T12:34:10.670987+0000","last_fullsized":"2024-09-15T12:34:10.670987+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32702464,"num_objects":499,"num_object_clones":0,"num_object_copies":1497,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1343,"num_write_kb":58944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"96'1403","reported_seq":1415,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:11.506750+0000","last_change":"2024-09-15T12:31:58.544695+0000","last_active":"2024-09-15T12:34:11.506750+0000","last_peered":"2024-09-15T12:34:11.506750+0000","last_clean":"2024-09-15T12:34:11.506750+0000","last_became_active":"2024-09-15T12:31:58.536224+0000","last_became_peered":"2024-09-15T12:31:58.536224+0000","last_unstale":"2024-09-15T12:34:11.506750+0000","last_undegraded":"2024-09-15T12:34:11.506750+0000","last_fullsized":"2024-09-15T12:34:11.506750+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1403,"log_dups_size":0,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32178176,"num_objects":491,"num_object_clones":0,"num_object_copies":1473,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1403,"num_write_kb":60608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"96'1486","reported_seq":1498,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:11.645005+0000","last_change":"2024-09-15T12:31:58.503374+0000","last_active":"2024-09-15T12:34:11.645005+0000","last_peered":"2024-09-15T12:34:11.645005+0000","last_clean":"2024-09-15T12:34:11.645005+0000","last_became_active":"2024-09-15T12:31:58.483732+0000","last_became_peered":"2024-09-15T12:31:58.483732+0000","last_unstale":"2024-09-15T12:34:11.645005+0000","last_undegraded":"2024-09-15T12:34:11.645005+0000","last_fullsized":"2024-09-15T12:34:11.645005+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1486,"log_dups_size":0,"ondisk_log_size":1486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1486,"num_write_kb":62336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"96'1522","reported_seq":1534,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.213754+0000","last_change":"2024-09-15T12:31:58.497018+0000","last_active":"2024-09-15T12:34:10.213754+0000","last_peered":"2024-09-15T12:34:10.213754+0000","last_clean":"2024-09-15T12:34:10.213754+0000","last_became_active":"2024-09-15T12:31:58.489173+0000","last_became_peered":"2024-09-15T12:31:58.489173+0000","last_unstale":"2024-09-15T12:34:10.213754+0000","last_undegraded":"2024-09-15T12:34:10.213754+0000","last_fullsized":"2024-09-15T12:34:10.213754+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1522,"log_dups_size":0,"ondisk_log_size":1522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35782656,"num_objects":546,"num_object_clones":0,"num_object_copies":1638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1522,"num_write_kb":66176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"96'1436","reported_seq":1448,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.417600+0000","last_change":"2024-09-15T12:31:58.524969+0000","last_active":"2024-09-15T12:34:10.417600+0000","last_peered":"2024-09-15T12:34:10.417600+0000","last_clean":"2024-09-15T12:34:10.417600+0000","last_became_active":"2024-09-15T12:31:58.516994+0000","last_became_peered":"2024-09-15T12:31:58.516994+0000","last_unstale":"2024-09-15T12:34:10.417600+0000","last_undegraded":"2024-09-15T12:34:10.417600+0000","last_fullsized":"2024-09-15T12:34:10.417600+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1436,"log_dups_size":0,"ondisk_log_size":1436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32243712,"num_objects":492,"num_object_clones":0,"num_object_copies":1476,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1436,"num_write_kb":61696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"96'1411","reported_seq":1423,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:11.796484+0000","last_change":"2024-09-15T12:31:58.495776+0000","last_active":"2024-09-15T12:34:11.796484+0000","last_peered":"2024-09-15T12:34:11.796484+0000","last_clean":"2024-09-15T12:34:11.796484+0000","last_became_active":"2024-09-15T12:31:58.474993+0000","last_became_peered":"2024-09-15T12:31:58.474993+0000","last_unstale":"2024-09-15T12:34:11.796484+0000","last_undegraded":"2024-09-15T12:34:11.796484+0000","last_fullsized":"2024-09-15T12:34:11.796484+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1411,"log_dups_size":0,"ondisk_log_size":1411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33882112,"num_objects":517,"num_object_clones":0,"num_object_copies":1551,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1411,"num_write_kb":61696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":331,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.358933+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:31:59.358933+0000","last_peered":"2024-09-15T12:31:59.358933+0000","last_clean":"2024-09-15T12:31:59.358933+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:31:59.358933+0000","last_undegraded":"2024-09-15T12:31:59.358933+0000","last_fullsized":"2024-09-15T12:31:59.358933+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":260,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.365124+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:31:59.365124+0000","last_peered":"2024-09-15T12:31:59.365124+0000","last_clean":"2024-09-15T12:31:59.365124+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:31:59.365124+0000","last_undegraded":"2024-09-15T12:31:59.365124+0000","last_fullsized":"2024-09-15T12:31:59.365124+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"96'1479","reported_seq":1491,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.667469+0000","last_change":"2024-09-15T12:31:58.498915+0000","last_active":"2024-09-15T12:34:10.667469+0000","last_peered":"2024-09-15T12:34:10.667469+0000","last_clean":"2024-09-15T12:34:10.667469+0000","last_became_active":"2024-09-15T12:31:58.487521+0000","last_became_peered":"2024-09-15T12:31:58.487521+0000","last_unstale":"2024-09-15T12:34:10.667469+0000","last_undegraded":"2024-09-15T12:34:10.667469+0000","last_fullsized":"2024-09-15T12:34:10.667469+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1479,"log_dups_size":0,"ondisk_log_size":1479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32440320,"num_objects":495,"num_object_clones":0,"num_object_copies":1485,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1479,"num_write_kb":63168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.364819+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:31:59.364819+0000","last_peered":"2024-09-15T12:31:59.364819+0000","last_clean":"2024-09-15T12:31:59.364819+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:31:59.364819+0000","last_undegraded":"2024-09-15T12:31:59.364819+0000","last_fullsized":"2024-09-15T12:31:59.364819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"96'1456","reported_seq":1468,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.571124+0000","last_change":"2024-09-15T12:31:58.468104+0000","last_active":"2024-09-15T12:34:10.571124+0000","last_peered":"2024-09-15T12:34:10.571124+0000","last_clean":"2024-09-15T12:34:10.571124+0000","last_became_active":"2024-09-15T12:31:58.462443+0000","last_became_peered":"2024-09-15T12:31:58.462443+0000","last_unstale":"2024-09-15T12:34:10.571124+0000","last_undegraded":"2024-09-15T12:34:10.571124+0000","last_fullsized":"2024-09-15T12:34:10.571124+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1456,"log_dups_size":0,"ondisk_log_size":1456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34078720,"num_objects":520,"num_object_clones":0,"num_object_copies":1560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1456,"num_write_kb":63232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.356572+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:31:59.356572+0000","last_peered":"2024-09-15T12:31:59.356572+0000","last_clean":"2024-09-15T12:31:59.356572+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:31:59.356572+0000","last_undegraded":"2024-09-15T12:31:59.356572+0000","last_fullsized":"2024-09-15T12:31:59.356572+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"96'1395","reported_seq":1407,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.668010+0000","last_change":"2024-09-15T12:31:58.480532+0000","last_active":"2024-09-15T12:34:10.668010+0000","last_peered":"2024-09-15T12:34:10.668010+0000","last_clean":"2024-09-15T12:34:10.668010+0000","last_became_active":"2024-09-15T12:31:58.468452+0000","last_became_peered":"2024-09-15T12:31:58.468452+0000","last_unstale":"2024-09-15T12:34:10.668010+0000","last_undegraded":"2024-09-15T12:34:10.668010+0000","last_fullsized":"2024-09-15T12:34:10.668010+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1395,"log_dups_size":0,"ondisk_log_size":1395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33226752,"num_objects":507,"num_object_clones":0,"num_object_copies":1521,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1395,"num_write_kb":60864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":261,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.358054+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:31:59.358054+0000","last_peered":"2024-09-15T12:31:59.358054+0000","last_clean":"2024-09-15T12:31:59.358054+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:31:59.358054+0000","last_undegraded":"2024-09-15T12:31:59.358054+0000","last_fullsized":"2024-09-15T12:31:59.358054+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"96'1488","reported_seq":1500,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.325093+0000","last_change":"2024-09-15T12:31:58.472814+0000","last_active":"2024-09-15T12:34:10.325093+0000","last_peered":"2024-09-15T12:34:10.325093+0000","last_clean":"2024-09-15T12:34:10.325093+0000","last_became_active":"2024-09-15T12:31:58.466600+0000","last_became_peered":"2024-09-15T12:31:58.466600+0000","last_unstale":"2024-09-15T12:34:10.325093+0000","last_undegraded":"2024-09-15T12:34:10.325093+0000","last_fullsized":"2024-09-15T12:34:10.325093+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1488,"log_dups_size":0,"ondisk_log_size":1488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33292288,"num_objects":508,"num_object_clones":0,"num_object_copies":1524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1488,"num_write_kb":63872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.362774+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:31:59.362774+0000","last_peered":"2024-09-15T12:31:59.362774+0000","last_clean":"2024-09-15T12:31:59.362774+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:31:59.362774+0000","last_undegraded":"2024-09-15T12:31:59.362774+0000","last_fullsized":"2024-09-15T12:31:59.362774+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"96'1486","reported_seq":1498,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.698415+0000","last_change":"2024-09-15T12:31:58.435605+0000","last_active":"2024-09-15T12:34:10.698415+0000","last_peered":"2024-09-15T12:34:10.698415+0000","last_clean":"2024-09-15T12:34:10.698415+0000","last_became_active":"2024-09-15T12:31:58.429332+0000","last_became_peered":"2024-09-15T12:31:58.429332+0000","last_unstale":"2024-09-15T12:34:10.698415+0000","last_undegraded":"2024-09-15T12:34:10.698415+0000","last_fullsized":"2024-09-15T12:34:10.698415+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1486,"log_dups_size":0,"ondisk_log_size":1486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33030144,"num_objects":504,"num_object_clones":0,"num_object_copies":1512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1486,"num_write_kb":63680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.360240+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:31:59.360240+0000","last_peered":"2024-09-15T12:31:59.360240+0000","last_clean":"2024-09-15T12:31:59.360240+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:31:59.360240+0000","last_undegraded":"2024-09-15T12:31:59.360240+0000","last_fullsized":"2024-09-15T12:31:59.360240+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"96'1444","reported_seq":1456,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:11.750559+0000","last_change":"2024-09-15T12:31:58.492392+0000","last_active":"2024-09-15T12:34:11.750559+0000","last_peered":"2024-09-15T12:34:11.750559+0000","last_clean":"2024-09-15T12:34:11.750559+0000","last_became_active":"2024-09-15T12:31:58.466633+0000","last_became_peered":"2024-09-15T12:31:58.466633+0000","last_unstale":"2024-09-15T12:34:11.750559+0000","last_undegraded":"2024-09-15T12:34:11.750559+0000","last_fullsized":"2024-09-15T12:34:11.750559+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1444,"log_dups_size":0,"ondisk_log_size":1444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33423360,"num_objects":510,"num_object_clones":0,"num_object_copies":1530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1444,"num_write_kb":62528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.360118+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:31:59.360118+0000","last_peered":"2024-09-15T12:31:59.360118+0000","last_clean":"2024-09-15T12:31:59.360118+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:31:59.360118+0000","last_undegraded":"2024-09-15T12:31:59.360118+0000","last_fullsized":"2024-09-15T12:31:59.360118+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"96'1443","reported_seq":1455,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:11.719608+0000","last_change":"2024-09-15T12:31:58.524245+0000","last_active":"2024-09-15T12:34:11.719608+0000","last_peered":"2024-09-15T12:34:11.719608+0000","last_clean":"2024-09-15T12:34:11.719608+0000","last_became_active":"2024-09-15T12:31:58.516700+0000","last_became_peered":"2024-09-15T12:31:58.516700+0000","last_unstale":"2024-09-15T12:34:11.719608+0000","last_undegraded":"2024-09-15T12:34:11.719608+0000","last_fullsized":"2024-09-15T12:34:11.719608+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1443,"log_dups_size":0,"ondisk_log_size":1443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31653888,"num_objects":483,"num_object_clones":0,"num_object_copies":1449,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1443,"num_write_kb":61632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.363584+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:31:59.363584+0000","last_peered":"2024-09-15T12:31:59.363584+0000","last_clean":"2024-09-15T12:31:59.363584+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:31:59.363584+0000","last_undegraded":"2024-09-15T12:31:59.363584+0000","last_fullsized":"2024-09-15T12:31:59.363584+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":529989656,"num_objects":8088,"num_object_clones":0,"num_object_copies":24264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":23032,"num_write_kb":995777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":99479552,"data_stored":1591476296,"data_compressed":75571805,"data_compressed_allocated":99467264,"data_compressed_original":1591476224,"omap_allocated":0,"internal_metadata":0},"log_size":23032,"ondisk_log_size":23032,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69776,"kb_used_data":31232,"kb_used_omap":0,"kb_used_meta":38528,"kb_avail":94302064,"statfs":{"total":96636764160,"available":96565313536,"internally_reserved":0,"allocated":31981568,"data_stored":498640561,"data_compressed":23665671,"data_compressed_allocated":31150080,"data_compressed_original":498319360,"omap_allocated":0,"internal_metadata":39452672},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706591,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50472,"kb_used_data":19672,"kb_used_omap":0,"kb_used_meta":30784,"kb_avail":94321368,"statfs":{"total":96636764160,"available":96585080832,"internally_reserved":0,"allocated":20144128,"data_stored":309176004,"data_compressed":14668879,"data_compressed_allocated":19308544,"data_compressed_original":308854784,"omap_allocated":0,"internal_metadata":31522816},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706591,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74964,"kb_used_data":27844,"kb_used_omap":0,"kb_used_meta":47104,"kb_avail":94296876,"statfs":{"total":96636764160,"available":96560001024,"internally_reserved":0,"allocated":28512256,"data_stored":443458724,"data_compressed":21043343,"data_compressed_allocated":27697152,"data_compressed_original":443154432,"omap_allocated":0,"internal_metadata":48234496},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706591,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66092,"kb_used_data":23516,"kb_used_omap":0,"kb_used_meta":42560,"kb_avail":94305748,"statfs":{"total":96636764160,"available":96569085952,"internally_reserved":0,"allocated":24080384,"data_stored":372221612,"data_compressed":17662624,"data_compressed_allocated":23248896,"data_compressed_original":371900416,"omap_allocated":0,"internal_metadata":43581440},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":22843392,"data_stored":365494272,"data_compressed":17355624,"data_compressed_allocated":22843392,"data_compressed_original":365494272,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27201536,"data_stored":435159064,"data_compressed":20663679,"data_compressed_allocated":27197440,"data_compressed_original":435159040,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18890752,"data_stored":302186520,"data_compressed":14349431,"data_compressed_allocated":18886656,"data_compressed_original":302186496,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":30543872,"data_stored":488636440,"data_compressed":23203071,"data_compressed_allocated":30539776,"data_compressed_original":488636416,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:34:23.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:23.741+0000 7fb9ff711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:23.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:23.751+0000 7fb9ff711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:26.066 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:34:26.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:26.202+0000 7ff9f0f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:26.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:26.214+0000 7ff9eb59e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:28.463 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:34:28.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:28.590+0000 7feb35a8e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:28.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:28.601+0000 7feb35a8e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:28.720 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:34:28.720 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-15T12:34:28.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:28.865+0000 7f8f5d674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:28.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:28.879+0000 7f8f5d674640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:29.351 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.0 to 1 (10000) 2024-09-15T12:34:29.375 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-15T12:34:29.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:29.509+0000 7f489e274640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:29.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:29.527+0000 7f489e274640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:30.358 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.1 to 1 (10000) 2024-09-15T12:34:30.376 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-15T12:34:30.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:30.536+0000 7f2823d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:30.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:30.555+0000 7f2823d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:30.818 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:34:30.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:30.953+0000 7f74bc791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:30.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:30.959+0000 7f74bc791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:31.358 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.2 to 1 (10000) 2024-09-15T12:34:31.383 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-15T12:34:31.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:31.515+0000 7f4988791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:31.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:31.527+0000 7f4988791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:32.367 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.3 to 1 (10000) 2024-09-15T12:34:32.386 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-15T12:34:32.386 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:34:32.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:32.519+0000 7faf4fcac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:32.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:32.532+0000 7faf4fcac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:32.810 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:34:32.811 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:34:32.830 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":568,"stamp":"2024-09-15T12:34:32.367175+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":530580043,"num_objects":8092,"num_object_clones":0,"num_object_copies":24276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":23113,"num_write_kb":996885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23087,"ondisk_log_size":23087,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":261304,"kb_used_data":102264,"kb_used_omap":0,"kb_used_meta":158976,"kb_avail":377226056,"statfs":{"total":386547056640,"available":386279481344,"internally_reserved":0,"allocated":104718336,"data_stored":1623496901,"data_compressed":77040517,"data_compressed_allocated":101404672,"data_compressed_original":1622228992,"omap_allocated":0,"internal_metadata":162791424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.476888"},"pg_stats":[{"pgid":"7.f","version":"96'1442","reported_seq":1454,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:11.719593+0000","last_change":"2024-09-15T12:31:58.539371+0000","last_active":"2024-09-15T12:34:11.719593+0000","last_peered":"2024-09-15T12:34:11.719593+0000","last_clean":"2024-09-15T12:34:11.719593+0000","last_became_active":"2024-09-15T12:31:58.529616+0000","last_became_peered":"2024-09-15T12:31:58.529616+0000","last_unstale":"2024-09-15T12:34:11.719593+0000","last_undegraded":"2024-09-15T12:34:11.719593+0000","last_fullsized":"2024-09-15T12:34:11.719593+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1442,"log_dups_size":0,"ondisk_log_size":1442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32899072,"num_objects":502,"num_object_clones":0,"num_object_copies":1506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1442,"num_write_kb":62208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"96'1390","reported_seq":1402,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.584484+0000","last_change":"2024-09-15T12:31:58.494396+0000","last_active":"2024-09-15T12:34:10.584484+0000","last_peered":"2024-09-15T12:34:10.584484+0000","last_clean":"2024-09-15T12:34:10.584484+0000","last_became_active":"2024-09-15T12:31:58.482932+0000","last_became_peered":"2024-09-15T12:31:58.482932+0000","last_unstale":"2024-09-15T12:34:10.584484+0000","last_undegraded":"2024-09-15T12:34:10.584484+0000","last_fullsized":"2024-09-15T12:34:10.584484+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1390,"log_dups_size":0,"ondisk_log_size":1390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33947648,"num_objects":518,"num_object_clones":0,"num_object_copies":1554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1390,"num_write_kb":61056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"96'1408","reported_seq":1421,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.606835+0000","last_change":"2024-09-15T12:31:58.494069+0000","last_active":"2024-09-15T12:34:10.606835+0000","last_peered":"2024-09-15T12:34:10.606835+0000","last_clean":"2024-09-15T12:34:10.606835+0000","last_became_active":"2024-09-15T12:31:58.483561+0000","last_became_peered":"2024-09-15T12:31:58.483561+0000","last_unstale":"2024-09-15T12:34:10.606835+0000","last_undegraded":"2024-09-15T12:34:10.606835+0000","last_fullsized":"2024-09-15T12:34:10.606835+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1408,"log_dups_size":0,"ondisk_log_size":1408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34930712,"num_objects":534,"num_object_clones":0,"num_object_copies":1602,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1408,"num_write_kb":62081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"96'1343","reported_seq":1355,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.670987+0000","last_change":"2024-09-15T12:31:58.531562+0000","last_active":"2024-09-15T12:34:10.670987+0000","last_peered":"2024-09-15T12:34:10.670987+0000","last_clean":"2024-09-15T12:34:10.670987+0000","last_became_active":"2024-09-15T12:31:58.525598+0000","last_became_peered":"2024-09-15T12:31:58.525598+0000","last_unstale":"2024-09-15T12:34:10.670987+0000","last_undegraded":"2024-09-15T12:34:10.670987+0000","last_fullsized":"2024-09-15T12:34:10.670987+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32702464,"num_objects":499,"num_object_clones":0,"num_object_copies":1497,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1343,"num_write_kb":58944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"96'1403","reported_seq":1415,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:11.506750+0000","last_change":"2024-09-15T12:31:58.544695+0000","last_active":"2024-09-15T12:34:11.506750+0000","last_peered":"2024-09-15T12:34:11.506750+0000","last_clean":"2024-09-15T12:34:11.506750+0000","last_became_active":"2024-09-15T12:31:58.536224+0000","last_became_peered":"2024-09-15T12:31:58.536224+0000","last_unstale":"2024-09-15T12:34:11.506750+0000","last_undegraded":"2024-09-15T12:34:11.506750+0000","last_fullsized":"2024-09-15T12:34:11.506750+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1403,"log_dups_size":0,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32178176,"num_objects":491,"num_object_clones":0,"num_object_copies":1473,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1403,"num_write_kb":60608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"96'1486","reported_seq":1498,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:11.645005+0000","last_change":"2024-09-15T12:31:58.503374+0000","last_active":"2024-09-15T12:34:11.645005+0000","last_peered":"2024-09-15T12:34:11.645005+0000","last_clean":"2024-09-15T12:34:11.645005+0000","last_became_active":"2024-09-15T12:31:58.483732+0000","last_became_peered":"2024-09-15T12:31:58.483732+0000","last_unstale":"2024-09-15T12:34:11.645005+0000","last_undegraded":"2024-09-15T12:34:11.645005+0000","last_fullsized":"2024-09-15T12:34:11.645005+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1486,"log_dups_size":0,"ondisk_log_size":1486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1486,"num_write_kb":62336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"96'1522","reported_seq":1534,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.213754+0000","last_change":"2024-09-15T12:31:58.497018+0000","last_active":"2024-09-15T12:34:10.213754+0000","last_peered":"2024-09-15T12:34:10.213754+0000","last_clean":"2024-09-15T12:34:10.213754+0000","last_became_active":"2024-09-15T12:31:58.489173+0000","last_became_peered":"2024-09-15T12:31:58.489173+0000","last_unstale":"2024-09-15T12:34:10.213754+0000","last_undegraded":"2024-09-15T12:34:10.213754+0000","last_fullsized":"2024-09-15T12:34:10.213754+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1522,"log_dups_size":0,"ondisk_log_size":1522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35782656,"num_objects":546,"num_object_clones":0,"num_object_copies":1638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1522,"num_write_kb":66176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"96'1436","reported_seq":1448,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.417600+0000","last_change":"2024-09-15T12:31:58.524969+0000","last_active":"2024-09-15T12:34:10.417600+0000","last_peered":"2024-09-15T12:34:10.417600+0000","last_clean":"2024-09-15T12:34:10.417600+0000","last_became_active":"2024-09-15T12:31:58.516994+0000","last_became_peered":"2024-09-15T12:31:58.516994+0000","last_unstale":"2024-09-15T12:34:10.417600+0000","last_undegraded":"2024-09-15T12:34:10.417600+0000","last_fullsized":"2024-09-15T12:34:10.417600+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1436,"log_dups_size":0,"ondisk_log_size":1436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32243712,"num_objects":492,"num_object_clones":0,"num_object_copies":1476,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1436,"num_write_kb":61696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"96'1411","reported_seq":1423,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:11.796484+0000","last_change":"2024-09-15T12:31:58.495776+0000","last_active":"2024-09-15T12:34:11.796484+0000","last_peered":"2024-09-15T12:34:11.796484+0000","last_clean":"2024-09-15T12:34:11.796484+0000","last_became_active":"2024-09-15T12:31:58.474993+0000","last_became_peered":"2024-09-15T12:31:58.474993+0000","last_unstale":"2024-09-15T12:34:11.796484+0000","last_undegraded":"2024-09-15T12:34:11.796484+0000","last_fullsized":"2024-09-15T12:34:11.796484+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1411,"log_dups_size":0,"ondisk_log_size":1411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33882112,"num_objects":517,"num_object_clones":0,"num_object_copies":1551,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1411,"num_write_kb":61696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":331,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.358933+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:31:59.358933+0000","last_peered":"2024-09-15T12:31:59.358933+0000","last_clean":"2024-09-15T12:31:59.358933+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:31:59.358933+0000","last_undegraded":"2024-09-15T12:31:59.358933+0000","last_fullsized":"2024-09-15T12:31:59.358933+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":260,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.365124+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:31:59.365124+0000","last_peered":"2024-09-15T12:31:59.365124+0000","last_clean":"2024-09-15T12:31:59.365124+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:31:59.365124+0000","last_undegraded":"2024-09-15T12:31:59.365124+0000","last_fullsized":"2024-09-15T12:31:59.365124+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"96'1479","reported_seq":1491,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.667469+0000","last_change":"2024-09-15T12:31:58.498915+0000","last_active":"2024-09-15T12:34:10.667469+0000","last_peered":"2024-09-15T12:34:10.667469+0000","last_clean":"2024-09-15T12:34:10.667469+0000","last_became_active":"2024-09-15T12:31:58.487521+0000","last_became_peered":"2024-09-15T12:31:58.487521+0000","last_unstale":"2024-09-15T12:34:10.667469+0000","last_undegraded":"2024-09-15T12:34:10.667469+0000","last_fullsized":"2024-09-15T12:34:10.667469+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1479,"log_dups_size":0,"ondisk_log_size":1479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32440320,"num_objects":495,"num_object_clones":0,"num_object_copies":1485,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1479,"num_write_kb":63168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.364819+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:31:59.364819+0000","last_peered":"2024-09-15T12:31:59.364819+0000","last_clean":"2024-09-15T12:31:59.364819+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:31:59.364819+0000","last_undegraded":"2024-09-15T12:31:59.364819+0000","last_fullsized":"2024-09-15T12:31:59.364819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"96'1456","reported_seq":1468,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.571124+0000","last_change":"2024-09-15T12:31:58.468104+0000","last_active":"2024-09-15T12:34:10.571124+0000","last_peered":"2024-09-15T12:34:10.571124+0000","last_clean":"2024-09-15T12:34:10.571124+0000","last_became_active":"2024-09-15T12:31:58.462443+0000","last_became_peered":"2024-09-15T12:31:58.462443+0000","last_unstale":"2024-09-15T12:34:10.571124+0000","last_undegraded":"2024-09-15T12:34:10.571124+0000","last_fullsized":"2024-09-15T12:34:10.571124+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1456,"log_dups_size":0,"ondisk_log_size":1456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34078720,"num_objects":520,"num_object_clones":0,"num_object_copies":1560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1456,"num_write_kb":63232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.356572+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:31:59.356572+0000","last_peered":"2024-09-15T12:31:59.356572+0000","last_clean":"2024-09-15T12:31:59.356572+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:31:59.356572+0000","last_undegraded":"2024-09-15T12:31:59.356572+0000","last_fullsized":"2024-09-15T12:31:59.356572+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"96'1395","reported_seq":1407,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.668010+0000","last_change":"2024-09-15T12:31:58.480532+0000","last_active":"2024-09-15T12:34:10.668010+0000","last_peered":"2024-09-15T12:34:10.668010+0000","last_clean":"2024-09-15T12:34:10.668010+0000","last_became_active":"2024-09-15T12:31:58.468452+0000","last_became_peered":"2024-09-15T12:31:58.468452+0000","last_unstale":"2024-09-15T12:34:10.668010+0000","last_undegraded":"2024-09-15T12:34:10.668010+0000","last_fullsized":"2024-09-15T12:34:10.668010+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1395,"log_dups_size":0,"ondisk_log_size":1395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33226752,"num_objects":507,"num_object_clones":0,"num_object_copies":1521,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1395,"num_write_kb":60864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":261,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.358054+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:31:59.358054+0000","last_peered":"2024-09-15T12:31:59.358054+0000","last_clean":"2024-09-15T12:31:59.358054+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:31:59.358054+0000","last_undegraded":"2024-09-15T12:31:59.358054+0000","last_fullsized":"2024-09-15T12:31:59.358054+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"96'1488","reported_seq":1500,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.325093+0000","last_change":"2024-09-15T12:31:58.472814+0000","last_active":"2024-09-15T12:34:10.325093+0000","last_peered":"2024-09-15T12:34:10.325093+0000","last_clean":"2024-09-15T12:34:10.325093+0000","last_became_active":"2024-09-15T12:31:58.466600+0000","last_became_peered":"2024-09-15T12:31:58.466600+0000","last_unstale":"2024-09-15T12:34:10.325093+0000","last_undegraded":"2024-09-15T12:34:10.325093+0000","last_fullsized":"2024-09-15T12:34:10.325093+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1488,"log_dups_size":0,"ondisk_log_size":1488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33292288,"num_objects":508,"num_object_clones":0,"num_object_copies":1524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1488,"num_write_kb":63872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.362774+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:31:59.362774+0000","last_peered":"2024-09-15T12:31:59.362774+0000","last_clean":"2024-09-15T12:31:59.362774+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:31:59.362774+0000","last_undegraded":"2024-09-15T12:31:59.362774+0000","last_fullsized":"2024-09-15T12:31:59.362774+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"96'1486","reported_seq":1498,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.698415+0000","last_change":"2024-09-15T12:31:58.435605+0000","last_active":"2024-09-15T12:34:10.698415+0000","last_peered":"2024-09-15T12:34:10.698415+0000","last_clean":"2024-09-15T12:34:10.698415+0000","last_became_active":"2024-09-15T12:31:58.429332+0000","last_became_peered":"2024-09-15T12:31:58.429332+0000","last_unstale":"2024-09-15T12:34:10.698415+0000","last_undegraded":"2024-09-15T12:34:10.698415+0000","last_fullsized":"2024-09-15T12:34:10.698415+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1486,"log_dups_size":0,"ondisk_log_size":1486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33030144,"num_objects":504,"num_object_clones":0,"num_object_copies":1512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1486,"num_write_kb":63680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.360240+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:31:59.360240+0000","last_peered":"2024-09-15T12:31:59.360240+0000","last_clean":"2024-09-15T12:31:59.360240+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:31:59.360240+0000","last_undegraded":"2024-09-15T12:31:59.360240+0000","last_fullsized":"2024-09-15T12:31:59.360240+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"96'1444","reported_seq":1456,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:11.750559+0000","last_change":"2024-09-15T12:31:58.492392+0000","last_active":"2024-09-15T12:34:11.750559+0000","last_peered":"2024-09-15T12:34:11.750559+0000","last_clean":"2024-09-15T12:34:11.750559+0000","last_became_active":"2024-09-15T12:31:58.466633+0000","last_became_peered":"2024-09-15T12:31:58.466633+0000","last_unstale":"2024-09-15T12:34:11.750559+0000","last_undegraded":"2024-09-15T12:34:11.750559+0000","last_fullsized":"2024-09-15T12:34:11.750559+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1444,"log_dups_size":0,"ondisk_log_size":1444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33423360,"num_objects":510,"num_object_clones":0,"num_object_copies":1530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1444,"num_write_kb":62528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.360118+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:31:59.360118+0000","last_peered":"2024-09-15T12:31:59.360118+0000","last_clean":"2024-09-15T12:31:59.360118+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:31:59.360118+0000","last_undegraded":"2024-09-15T12:31:59.360118+0000","last_fullsized":"2024-09-15T12:31:59.360118+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"96'1443","reported_seq":1455,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:11.719608+0000","last_change":"2024-09-15T12:31:58.524245+0000","last_active":"2024-09-15T12:34:11.719608+0000","last_peered":"2024-09-15T12:34:11.719608+0000","last_clean":"2024-09-15T12:34:11.719608+0000","last_became_active":"2024-09-15T12:31:58.516700+0000","last_became_peered":"2024-09-15T12:31:58.516700+0000","last_unstale":"2024-09-15T12:34:11.719608+0000","last_undegraded":"2024-09-15T12:34:11.719608+0000","last_fullsized":"2024-09-15T12:34:11.719608+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1443,"log_dups_size":0,"ondisk_log_size":1443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31653888,"num_objects":483,"num_object_clones":0,"num_object_copies":1449,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1443,"num_write_kb":61632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.363584+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:31:59.363584+0000","last_peered":"2024-09-15T12:31:59.363584+0000","last_clean":"2024-09-15T12:31:59.363584+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:31:59.363584+0000","last_undegraded":"2024-09-15T12:31:59.363584+0000","last_fullsized":"2024-09-15T12:31:59.363584+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":529989656,"num_objects":8088,"num_object_clones":0,"num_object_copies":24264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":23032,"num_write_kb":995777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":99479552,"data_stored":1591476296,"data_compressed":75571805,"data_compressed_allocated":99467264,"data_compressed_original":1591476224,"omap_allocated":0,"internal_metadata":0},"log_size":23032,"ondisk_log_size":23032,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69776,"kb_used_data":31232,"kb_used_omap":0,"kb_used_meta":38528,"kb_avail":94302064,"statfs":{"total":96636764160,"available":96565313536,"internally_reserved":0,"allocated":31981568,"data_stored":498640561,"data_compressed":23665671,"data_compressed_allocated":31150080,"data_compressed_original":498319360,"omap_allocated":0,"internal_metadata":39452672},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706591,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50472,"kb_used_data":19672,"kb_used_omap":0,"kb_used_meta":30784,"kb_avail":94321368,"statfs":{"total":96636764160,"available":96585080832,"internally_reserved":0,"allocated":20144128,"data_stored":309176004,"data_compressed":14668879,"data_compressed_allocated":19308544,"data_compressed_original":308854784,"omap_allocated":0,"internal_metadata":31522816},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706591,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74964,"kb_used_data":27844,"kb_used_omap":0,"kb_used_meta":47104,"kb_avail":94296876,"statfs":{"total":96636764160,"available":96560001024,"internally_reserved":0,"allocated":28512256,"data_stored":443458724,"data_compressed":21043343,"data_compressed_allocated":27697152,"data_compressed_original":443154432,"omap_allocated":0,"internal_metadata":48234496},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706591,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66092,"kb_used_data":23516,"kb_used_omap":0,"kb_used_meta":42560,"kb_avail":94305748,"statfs":{"total":96636764160,"available":96569085952,"internally_reserved":0,"allocated":24080384,"data_stored":372221612,"data_compressed":17662624,"data_compressed_allocated":23248896,"data_compressed_original":371900416,"omap_allocated":0,"internal_metadata":43581440},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":22843392,"data_stored":365494272,"data_compressed":17355624,"data_compressed_allocated":22843392,"data_compressed_original":365494272,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27201536,"data_stored":435159064,"data_compressed":20663679,"data_compressed_allocated":27197440,"data_compressed_original":435159040,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18890752,"data_stored":302186520,"data_compressed":14349431,"data_compressed_allocated":18886656,"data_compressed_original":302186496,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":30543872,"data_stored":488636440,"data_compressed":23203071,"data_compressed_allocated":30539776,"data_compressed_original":488636416,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:34:32.831 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:34:32.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:32.982+0000 7fb42f8a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:32.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:32.995+0000 7fb42f8a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:33.280 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:34:33.280 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:34:33.303 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":568,"stamp":"2024-09-15T12:34:32.367175+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":530580043,"num_objects":8092,"num_object_clones":0,"num_object_copies":24276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":23113,"num_write_kb":996885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23087,"ondisk_log_size":23087,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":261304,"kb_used_data":102264,"kb_used_omap":0,"kb_used_meta":158976,"kb_avail":377226056,"statfs":{"total":386547056640,"available":386279481344,"internally_reserved":0,"allocated":104718336,"data_stored":1623496901,"data_compressed":77040517,"data_compressed_allocated":101404672,"data_compressed_original":1622228992,"omap_allocated":0,"internal_metadata":162791424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.476888"},"pg_stats":[{"pgid":"7.f","version":"96'1442","reported_seq":1454,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:11.719593+0000","last_change":"2024-09-15T12:31:58.539371+0000","last_active":"2024-09-15T12:34:11.719593+0000","last_peered":"2024-09-15T12:34:11.719593+0000","last_clean":"2024-09-15T12:34:11.719593+0000","last_became_active":"2024-09-15T12:31:58.529616+0000","last_became_peered":"2024-09-15T12:31:58.529616+0000","last_unstale":"2024-09-15T12:34:11.719593+0000","last_undegraded":"2024-09-15T12:34:11.719593+0000","last_fullsized":"2024-09-15T12:34:11.719593+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1442,"log_dups_size":0,"ondisk_log_size":1442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32899072,"num_objects":502,"num_object_clones":0,"num_object_copies":1506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1442,"num_write_kb":62208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"96'1390","reported_seq":1402,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.584484+0000","last_change":"2024-09-15T12:31:58.494396+0000","last_active":"2024-09-15T12:34:10.584484+0000","last_peered":"2024-09-15T12:34:10.584484+0000","last_clean":"2024-09-15T12:34:10.584484+0000","last_became_active":"2024-09-15T12:31:58.482932+0000","last_became_peered":"2024-09-15T12:31:58.482932+0000","last_unstale":"2024-09-15T12:34:10.584484+0000","last_undegraded":"2024-09-15T12:34:10.584484+0000","last_fullsized":"2024-09-15T12:34:10.584484+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1390,"log_dups_size":0,"ondisk_log_size":1390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33947648,"num_objects":518,"num_object_clones":0,"num_object_copies":1554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1390,"num_write_kb":61056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"96'1408","reported_seq":1421,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.606835+0000","last_change":"2024-09-15T12:31:58.494069+0000","last_active":"2024-09-15T12:34:10.606835+0000","last_peered":"2024-09-15T12:34:10.606835+0000","last_clean":"2024-09-15T12:34:10.606835+0000","last_became_active":"2024-09-15T12:31:58.483561+0000","last_became_peered":"2024-09-15T12:31:58.483561+0000","last_unstale":"2024-09-15T12:34:10.606835+0000","last_undegraded":"2024-09-15T12:34:10.606835+0000","last_fullsized":"2024-09-15T12:34:10.606835+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1408,"log_dups_size":0,"ondisk_log_size":1408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34930712,"num_objects":534,"num_object_clones":0,"num_object_copies":1602,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1408,"num_write_kb":62081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"96'1343","reported_seq":1355,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.670987+0000","last_change":"2024-09-15T12:31:58.531562+0000","last_active":"2024-09-15T12:34:10.670987+0000","last_peered":"2024-09-15T12:34:10.670987+0000","last_clean":"2024-09-15T12:34:10.670987+0000","last_became_active":"2024-09-15T12:31:58.525598+0000","last_became_peered":"2024-09-15T12:31:58.525598+0000","last_unstale":"2024-09-15T12:34:10.670987+0000","last_undegraded":"2024-09-15T12:34:10.670987+0000","last_fullsized":"2024-09-15T12:34:10.670987+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32702464,"num_objects":499,"num_object_clones":0,"num_object_copies":1497,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1343,"num_write_kb":58944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"96'1403","reported_seq":1415,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:11.506750+0000","last_change":"2024-09-15T12:31:58.544695+0000","last_active":"2024-09-15T12:34:11.506750+0000","last_peered":"2024-09-15T12:34:11.506750+0000","last_clean":"2024-09-15T12:34:11.506750+0000","last_became_active":"2024-09-15T12:31:58.536224+0000","last_became_peered":"2024-09-15T12:31:58.536224+0000","last_unstale":"2024-09-15T12:34:11.506750+0000","last_undegraded":"2024-09-15T12:34:11.506750+0000","last_fullsized":"2024-09-15T12:34:11.506750+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1403,"log_dups_size":0,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32178176,"num_objects":491,"num_object_clones":0,"num_object_copies":1473,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1403,"num_write_kb":60608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"96'1486","reported_seq":1498,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:11.645005+0000","last_change":"2024-09-15T12:31:58.503374+0000","last_active":"2024-09-15T12:34:11.645005+0000","last_peered":"2024-09-15T12:34:11.645005+0000","last_clean":"2024-09-15T12:34:11.645005+0000","last_became_active":"2024-09-15T12:31:58.483732+0000","last_became_peered":"2024-09-15T12:31:58.483732+0000","last_unstale":"2024-09-15T12:34:11.645005+0000","last_undegraded":"2024-09-15T12:34:11.645005+0000","last_fullsized":"2024-09-15T12:34:11.645005+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1486,"log_dups_size":0,"ondisk_log_size":1486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1486,"num_write_kb":62336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"96'1522","reported_seq":1534,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.213754+0000","last_change":"2024-09-15T12:31:58.497018+0000","last_active":"2024-09-15T12:34:10.213754+0000","last_peered":"2024-09-15T12:34:10.213754+0000","last_clean":"2024-09-15T12:34:10.213754+0000","last_became_active":"2024-09-15T12:31:58.489173+0000","last_became_peered":"2024-09-15T12:31:58.489173+0000","last_unstale":"2024-09-15T12:34:10.213754+0000","last_undegraded":"2024-09-15T12:34:10.213754+0000","last_fullsized":"2024-09-15T12:34:10.213754+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1522,"log_dups_size":0,"ondisk_log_size":1522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35782656,"num_objects":546,"num_object_clones":0,"num_object_copies":1638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1522,"num_write_kb":66176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"96'1436","reported_seq":1448,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.417600+0000","last_change":"2024-09-15T12:31:58.524969+0000","last_active":"2024-09-15T12:34:10.417600+0000","last_peered":"2024-09-15T12:34:10.417600+0000","last_clean":"2024-09-15T12:34:10.417600+0000","last_became_active":"2024-09-15T12:31:58.516994+0000","last_became_peered":"2024-09-15T12:31:58.516994+0000","last_unstale":"2024-09-15T12:34:10.417600+0000","last_undegraded":"2024-09-15T12:34:10.417600+0000","last_fullsized":"2024-09-15T12:34:10.417600+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1436,"log_dups_size":0,"ondisk_log_size":1436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32243712,"num_objects":492,"num_object_clones":0,"num_object_copies":1476,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1436,"num_write_kb":61696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"96'1411","reported_seq":1423,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:11.796484+0000","last_change":"2024-09-15T12:31:58.495776+0000","last_active":"2024-09-15T12:34:11.796484+0000","last_peered":"2024-09-15T12:34:11.796484+0000","last_clean":"2024-09-15T12:34:11.796484+0000","last_became_active":"2024-09-15T12:31:58.474993+0000","last_became_peered":"2024-09-15T12:31:58.474993+0000","last_unstale":"2024-09-15T12:34:11.796484+0000","last_undegraded":"2024-09-15T12:34:11.796484+0000","last_fullsized":"2024-09-15T12:34:11.796484+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1411,"log_dups_size":0,"ondisk_log_size":1411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33882112,"num_objects":517,"num_object_clones":0,"num_object_copies":1551,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1411,"num_write_kb":61696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":331,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.358933+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:31:59.358933+0000","last_peered":"2024-09-15T12:31:59.358933+0000","last_clean":"2024-09-15T12:31:59.358933+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:31:59.358933+0000","last_undegraded":"2024-09-15T12:31:59.358933+0000","last_fullsized":"2024-09-15T12:31:59.358933+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":260,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.365124+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:31:59.365124+0000","last_peered":"2024-09-15T12:31:59.365124+0000","last_clean":"2024-09-15T12:31:59.365124+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:31:59.365124+0000","last_undegraded":"2024-09-15T12:31:59.365124+0000","last_fullsized":"2024-09-15T12:31:59.365124+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"96'1479","reported_seq":1491,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.667469+0000","last_change":"2024-09-15T12:31:58.498915+0000","last_active":"2024-09-15T12:34:10.667469+0000","last_peered":"2024-09-15T12:34:10.667469+0000","last_clean":"2024-09-15T12:34:10.667469+0000","last_became_active":"2024-09-15T12:31:58.487521+0000","last_became_peered":"2024-09-15T12:31:58.487521+0000","last_unstale":"2024-09-15T12:34:10.667469+0000","last_undegraded":"2024-09-15T12:34:10.667469+0000","last_fullsized":"2024-09-15T12:34:10.667469+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1479,"log_dups_size":0,"ondisk_log_size":1479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32440320,"num_objects":495,"num_object_clones":0,"num_object_copies":1485,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1479,"num_write_kb":63168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.364819+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:31:59.364819+0000","last_peered":"2024-09-15T12:31:59.364819+0000","last_clean":"2024-09-15T12:31:59.364819+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:31:59.364819+0000","last_undegraded":"2024-09-15T12:31:59.364819+0000","last_fullsized":"2024-09-15T12:31:59.364819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"96'1456","reported_seq":1468,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.571124+0000","last_change":"2024-09-15T12:31:58.468104+0000","last_active":"2024-09-15T12:34:10.571124+0000","last_peered":"2024-09-15T12:34:10.571124+0000","last_clean":"2024-09-15T12:34:10.571124+0000","last_became_active":"2024-09-15T12:31:58.462443+0000","last_became_peered":"2024-09-15T12:31:58.462443+0000","last_unstale":"2024-09-15T12:34:10.571124+0000","last_undegraded":"2024-09-15T12:34:10.571124+0000","last_fullsized":"2024-09-15T12:34:10.571124+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1456,"log_dups_size":0,"ondisk_log_size":1456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34078720,"num_objects":520,"num_object_clones":0,"num_object_copies":1560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1456,"num_write_kb":63232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.356572+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:31:59.356572+0000","last_peered":"2024-09-15T12:31:59.356572+0000","last_clean":"2024-09-15T12:31:59.356572+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:31:59.356572+0000","last_undegraded":"2024-09-15T12:31:59.356572+0000","last_fullsized":"2024-09-15T12:31:59.356572+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"96'1395","reported_seq":1407,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.668010+0000","last_change":"2024-09-15T12:31:58.480532+0000","last_active":"2024-09-15T12:34:10.668010+0000","last_peered":"2024-09-15T12:34:10.668010+0000","last_clean":"2024-09-15T12:34:10.668010+0000","last_became_active":"2024-09-15T12:31:58.468452+0000","last_became_peered":"2024-09-15T12:31:58.468452+0000","last_unstale":"2024-09-15T12:34:10.668010+0000","last_undegraded":"2024-09-15T12:34:10.668010+0000","last_fullsized":"2024-09-15T12:34:10.668010+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1395,"log_dups_size":0,"ondisk_log_size":1395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33226752,"num_objects":507,"num_object_clones":0,"num_object_copies":1521,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1395,"num_write_kb":60864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":261,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.358054+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:31:59.358054+0000","last_peered":"2024-09-15T12:31:59.358054+0000","last_clean":"2024-09-15T12:31:59.358054+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:31:59.358054+0000","last_undegraded":"2024-09-15T12:31:59.358054+0000","last_fullsized":"2024-09-15T12:31:59.358054+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"96'1488","reported_seq":1500,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.325093+0000","last_change":"2024-09-15T12:31:58.472814+0000","last_active":"2024-09-15T12:34:10.325093+0000","last_peered":"2024-09-15T12:34:10.325093+0000","last_clean":"2024-09-15T12:34:10.325093+0000","last_became_active":"2024-09-15T12:31:58.466600+0000","last_became_peered":"2024-09-15T12:31:58.466600+0000","last_unstale":"2024-09-15T12:34:10.325093+0000","last_undegraded":"2024-09-15T12:34:10.325093+0000","last_fullsized":"2024-09-15T12:34:10.325093+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1488,"log_dups_size":0,"ondisk_log_size":1488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33292288,"num_objects":508,"num_object_clones":0,"num_object_copies":1524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1488,"num_write_kb":63872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.362774+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:31:59.362774+0000","last_peered":"2024-09-15T12:31:59.362774+0000","last_clean":"2024-09-15T12:31:59.362774+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:31:59.362774+0000","last_undegraded":"2024-09-15T12:31:59.362774+0000","last_fullsized":"2024-09-15T12:31:59.362774+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"96'1486","reported_seq":1498,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.698415+0000","last_change":"2024-09-15T12:31:58.435605+0000","last_active":"2024-09-15T12:34:10.698415+0000","last_peered":"2024-09-15T12:34:10.698415+0000","last_clean":"2024-09-15T12:34:10.698415+0000","last_became_active":"2024-09-15T12:31:58.429332+0000","last_became_peered":"2024-09-15T12:31:58.429332+0000","last_unstale":"2024-09-15T12:34:10.698415+0000","last_undegraded":"2024-09-15T12:34:10.698415+0000","last_fullsized":"2024-09-15T12:34:10.698415+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1486,"log_dups_size":0,"ondisk_log_size":1486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33030144,"num_objects":504,"num_object_clones":0,"num_object_copies":1512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1486,"num_write_kb":63680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.360240+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:31:59.360240+0000","last_peered":"2024-09-15T12:31:59.360240+0000","last_clean":"2024-09-15T12:31:59.360240+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:31:59.360240+0000","last_undegraded":"2024-09-15T12:31:59.360240+0000","last_fullsized":"2024-09-15T12:31:59.360240+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"96'1444","reported_seq":1456,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:11.750559+0000","last_change":"2024-09-15T12:31:58.492392+0000","last_active":"2024-09-15T12:34:11.750559+0000","last_peered":"2024-09-15T12:34:11.750559+0000","last_clean":"2024-09-15T12:34:11.750559+0000","last_became_active":"2024-09-15T12:31:58.466633+0000","last_became_peered":"2024-09-15T12:31:58.466633+0000","last_unstale":"2024-09-15T12:34:11.750559+0000","last_undegraded":"2024-09-15T12:34:11.750559+0000","last_fullsized":"2024-09-15T12:34:11.750559+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1444,"log_dups_size":0,"ondisk_log_size":1444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33423360,"num_objects":510,"num_object_clones":0,"num_object_copies":1530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1444,"num_write_kb":62528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.360118+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:31:59.360118+0000","last_peered":"2024-09-15T12:31:59.360118+0000","last_clean":"2024-09-15T12:31:59.360118+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:31:59.360118+0000","last_undegraded":"2024-09-15T12:31:59.360118+0000","last_fullsized":"2024-09-15T12:31:59.360118+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"96'1443","reported_seq":1455,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:11.719608+0000","last_change":"2024-09-15T12:31:58.524245+0000","last_active":"2024-09-15T12:34:11.719608+0000","last_peered":"2024-09-15T12:34:11.719608+0000","last_clean":"2024-09-15T12:34:11.719608+0000","last_became_active":"2024-09-15T12:31:58.516700+0000","last_became_peered":"2024-09-15T12:31:58.516700+0000","last_unstale":"2024-09-15T12:34:11.719608+0000","last_undegraded":"2024-09-15T12:34:11.719608+0000","last_fullsized":"2024-09-15T12:34:11.719608+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1443,"log_dups_size":0,"ondisk_log_size":1443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31653888,"num_objects":483,"num_object_clones":0,"num_object_copies":1449,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1443,"num_write_kb":61632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.363584+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:31:59.363584+0000","last_peered":"2024-09-15T12:31:59.363584+0000","last_clean":"2024-09-15T12:31:59.363584+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:31:59.363584+0000","last_undegraded":"2024-09-15T12:31:59.363584+0000","last_fullsized":"2024-09-15T12:31:59.363584+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":529989656,"num_objects":8088,"num_object_clones":0,"num_object_copies":24264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":23032,"num_write_kb":995777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":99479552,"data_stored":1591476296,"data_compressed":75571805,"data_compressed_allocated":99467264,"data_compressed_original":1591476224,"omap_allocated":0,"internal_metadata":0},"log_size":23032,"ondisk_log_size":23032,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69776,"kb_used_data":31232,"kb_used_omap":0,"kb_used_meta":38528,"kb_avail":94302064,"statfs":{"total":96636764160,"available":96565313536,"internally_reserved":0,"allocated":31981568,"data_stored":498640561,"data_compressed":23665671,"data_compressed_allocated":31150080,"data_compressed_original":498319360,"omap_allocated":0,"internal_metadata":39452672},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706591,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50472,"kb_used_data":19672,"kb_used_omap":0,"kb_used_meta":30784,"kb_avail":94321368,"statfs":{"total":96636764160,"available":96585080832,"internally_reserved":0,"allocated":20144128,"data_stored":309176004,"data_compressed":14668879,"data_compressed_allocated":19308544,"data_compressed_original":308854784,"omap_allocated":0,"internal_metadata":31522816},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706591,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74964,"kb_used_data":27844,"kb_used_omap":0,"kb_used_meta":47104,"kb_avail":94296876,"statfs":{"total":96636764160,"available":96560001024,"internally_reserved":0,"allocated":28512256,"data_stored":443458724,"data_compressed":21043343,"data_compressed_allocated":27697152,"data_compressed_original":443154432,"omap_allocated":0,"internal_metadata":48234496},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706591,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66092,"kb_used_data":23516,"kb_used_omap":0,"kb_used_meta":42560,"kb_avail":94305748,"statfs":{"total":96636764160,"available":96569085952,"internally_reserved":0,"allocated":24080384,"data_stored":372221612,"data_compressed":17662624,"data_compressed_allocated":23248896,"data_compressed_original":371900416,"omap_allocated":0,"internal_metadata":43581440},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":22843392,"data_stored":365494272,"data_compressed":17355624,"data_compressed_allocated":22843392,"data_compressed_original":365494272,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27201536,"data_stored":435159064,"data_compressed":20663679,"data_compressed_allocated":27197440,"data_compressed_original":435159040,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18890752,"data_stored":302186520,"data_compressed":14349431,"data_compressed_allocated":18886656,"data_compressed_original":302186496,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":30543872,"data_stored":488636440,"data_compressed":23203071,"data_compressed_allocated":30539776,"data_compressed_original":488636416,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:34:33.304 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-15T12:34:33.304 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:34:33.305 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:34:33.305 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:34:33.389 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:34:33.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:33.462+0000 7f0543c7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:33.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:33.479+0000 7f0543c7f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:33.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:33.548+0000 7f0b48791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:33.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:33.556+0000 7f0b48791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:33.763 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:34:33.763 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:34:33.763 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:34:33.763 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:34:33.764 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:34:33.764 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:34:33.764 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:34:33.764 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:34:33.764 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:34:33.764 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:34:33.764 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:34:33.764 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:34:33.767 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:34:33.768 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:34:33.768 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:34:33.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:33.892+0000 7f6952f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:33.910 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:33.907+0000 7f6952f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:33.954 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:34:33.954 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:34:33.954 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:34:33.954 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:34:33.954 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:34:33.954 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:34:33.954 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:34:33.954 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:34:33.954 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:34:33.954 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:34:33.954 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:34:33.954 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:34:33.958 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:34:33.958 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:34:33.959 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:34:34.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:34.153+0000 7f5062351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:34.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:34.165+0000 7f5062351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:34.324 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:34:34.324 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:34:34.324 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:34:34.324 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:34:34.324 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:34:34.324 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:34:34.324 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:34:34.324 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:34:34.324 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:34:34.324 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:34:34.325 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:34:34.325 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:34:34.328 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:34:34.328 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:34:34.329 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:34:34.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:34.461+0000 7f63fd6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:34.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:34.475+0000 7f63fd6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:34.523 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:34:34.523 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:34:34.524 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:34:34.524 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:34:34.524 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:34:34.524 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:34:34.524 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:34:34.524 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:34:34.524 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:34:34.524 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:34:34.524 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:34:34.524 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:34:34.528 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:34:34.528 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:34:35.903 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:34:36.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:36.047+0000 7f3a7d063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:36.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:36.054+0000 7f3a7d063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:38.539 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:34:38.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:38.678+0000 7fb6f2791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:38.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:38.685+0000 7fb6f2791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:39.529 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:34:39.529 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:34:39.530 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:34:39.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:39.694+0000 7f924ef11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:39.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:39.705+0000 7f924ef11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:39.967 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:34:39.968 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:34:39.987 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":572,"stamp":"2024-09-15T12:34:39.892339+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":530580043,"num_objects":8092,"num_object_clones":0,"num_object_copies":24276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":23113,"num_write_kb":996885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23087,"ondisk_log_size":23087,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":261304,"kb_used_data":102264,"kb_used_omap":0,"kb_used_meta":158976,"kb_avail":377226056,"statfs":{"total":386547056640,"available":386279481344,"internally_reserved":0,"allocated":104718336,"data_stored":1623496901,"data_compressed":77040517,"data_compressed_allocated":101404672,"data_compressed_original":1622228992,"omap_allocated":0,"internal_metadata":162791424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.534069"},"pg_stats":[{"pgid":"7.f","version":"96'1442","reported_seq":1454,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:11.719593+0000","last_change":"2024-09-15T12:31:58.539371+0000","last_active":"2024-09-15T12:34:11.719593+0000","last_peered":"2024-09-15T12:34:11.719593+0000","last_clean":"2024-09-15T12:34:11.719593+0000","last_became_active":"2024-09-15T12:31:58.529616+0000","last_became_peered":"2024-09-15T12:31:58.529616+0000","last_unstale":"2024-09-15T12:34:11.719593+0000","last_undegraded":"2024-09-15T12:34:11.719593+0000","last_fullsized":"2024-09-15T12:34:11.719593+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1442,"log_dups_size":0,"ondisk_log_size":1442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32899072,"num_objects":502,"num_object_clones":0,"num_object_copies":1506,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1442,"num_write_kb":62208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"96'1390","reported_seq":1402,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.584484+0000","last_change":"2024-09-15T12:31:58.494396+0000","last_active":"2024-09-15T12:34:10.584484+0000","last_peered":"2024-09-15T12:34:10.584484+0000","last_clean":"2024-09-15T12:34:10.584484+0000","last_became_active":"2024-09-15T12:31:58.482932+0000","last_became_peered":"2024-09-15T12:31:58.482932+0000","last_unstale":"2024-09-15T12:34:10.584484+0000","last_undegraded":"2024-09-15T12:34:10.584484+0000","last_fullsized":"2024-09-15T12:34:10.584484+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1390,"log_dups_size":0,"ondisk_log_size":1390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33947648,"num_objects":518,"num_object_clones":0,"num_object_copies":1554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1390,"num_write_kb":61056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"96'1408","reported_seq":1421,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.606835+0000","last_change":"2024-09-15T12:31:58.494069+0000","last_active":"2024-09-15T12:34:10.606835+0000","last_peered":"2024-09-15T12:34:10.606835+0000","last_clean":"2024-09-15T12:34:10.606835+0000","last_became_active":"2024-09-15T12:31:58.483561+0000","last_became_peered":"2024-09-15T12:31:58.483561+0000","last_unstale":"2024-09-15T12:34:10.606835+0000","last_undegraded":"2024-09-15T12:34:10.606835+0000","last_fullsized":"2024-09-15T12:34:10.606835+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1408,"log_dups_size":0,"ondisk_log_size":1408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34930712,"num_objects":534,"num_object_clones":0,"num_object_copies":1602,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1408,"num_write_kb":62081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"96'1343","reported_seq":1355,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.670987+0000","last_change":"2024-09-15T12:31:58.531562+0000","last_active":"2024-09-15T12:34:10.670987+0000","last_peered":"2024-09-15T12:34:10.670987+0000","last_clean":"2024-09-15T12:34:10.670987+0000","last_became_active":"2024-09-15T12:31:58.525598+0000","last_became_peered":"2024-09-15T12:31:58.525598+0000","last_unstale":"2024-09-15T12:34:10.670987+0000","last_undegraded":"2024-09-15T12:34:10.670987+0000","last_fullsized":"2024-09-15T12:34:10.670987+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32702464,"num_objects":499,"num_object_clones":0,"num_object_copies":1497,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1343,"num_write_kb":58944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"96'1403","reported_seq":1415,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:11.506750+0000","last_change":"2024-09-15T12:31:58.544695+0000","last_active":"2024-09-15T12:34:11.506750+0000","last_peered":"2024-09-15T12:34:11.506750+0000","last_clean":"2024-09-15T12:34:11.506750+0000","last_became_active":"2024-09-15T12:31:58.536224+0000","last_became_peered":"2024-09-15T12:31:58.536224+0000","last_unstale":"2024-09-15T12:34:11.506750+0000","last_undegraded":"2024-09-15T12:34:11.506750+0000","last_fullsized":"2024-09-15T12:34:11.506750+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1403,"log_dups_size":0,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32178176,"num_objects":491,"num_object_clones":0,"num_object_copies":1473,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1403,"num_write_kb":60608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"96'1486","reported_seq":1498,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:11.645005+0000","last_change":"2024-09-15T12:31:58.503374+0000","last_active":"2024-09-15T12:34:11.645005+0000","last_peered":"2024-09-15T12:34:11.645005+0000","last_clean":"2024-09-15T12:34:11.645005+0000","last_became_active":"2024-09-15T12:31:58.483732+0000","last_became_peered":"2024-09-15T12:31:58.483732+0000","last_unstale":"2024-09-15T12:34:11.645005+0000","last_undegraded":"2024-09-15T12:34:11.645005+0000","last_fullsized":"2024-09-15T12:34:11.645005+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1486,"log_dups_size":0,"ondisk_log_size":1486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1486,"num_write_kb":62336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"96'1522","reported_seq":1534,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.213754+0000","last_change":"2024-09-15T12:31:58.497018+0000","last_active":"2024-09-15T12:34:10.213754+0000","last_peered":"2024-09-15T12:34:10.213754+0000","last_clean":"2024-09-15T12:34:10.213754+0000","last_became_active":"2024-09-15T12:31:58.489173+0000","last_became_peered":"2024-09-15T12:31:58.489173+0000","last_unstale":"2024-09-15T12:34:10.213754+0000","last_undegraded":"2024-09-15T12:34:10.213754+0000","last_fullsized":"2024-09-15T12:34:10.213754+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1522,"log_dups_size":0,"ondisk_log_size":1522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35782656,"num_objects":546,"num_object_clones":0,"num_object_copies":1638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1522,"num_write_kb":66176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"96'1436","reported_seq":1448,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.417600+0000","last_change":"2024-09-15T12:31:58.524969+0000","last_active":"2024-09-15T12:34:10.417600+0000","last_peered":"2024-09-15T12:34:10.417600+0000","last_clean":"2024-09-15T12:34:10.417600+0000","last_became_active":"2024-09-15T12:31:58.516994+0000","last_became_peered":"2024-09-15T12:31:58.516994+0000","last_unstale":"2024-09-15T12:34:10.417600+0000","last_undegraded":"2024-09-15T12:34:10.417600+0000","last_fullsized":"2024-09-15T12:34:10.417600+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1436,"log_dups_size":0,"ondisk_log_size":1436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32243712,"num_objects":492,"num_object_clones":0,"num_object_copies":1476,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1436,"num_write_kb":61696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"96'1411","reported_seq":1423,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:11.796484+0000","last_change":"2024-09-15T12:31:58.495776+0000","last_active":"2024-09-15T12:34:11.796484+0000","last_peered":"2024-09-15T12:34:11.796484+0000","last_clean":"2024-09-15T12:34:11.796484+0000","last_became_active":"2024-09-15T12:31:58.474993+0000","last_became_peered":"2024-09-15T12:31:58.474993+0000","last_unstale":"2024-09-15T12:34:11.796484+0000","last_undegraded":"2024-09-15T12:34:11.796484+0000","last_fullsized":"2024-09-15T12:34:11.796484+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1411,"log_dups_size":0,"ondisk_log_size":1411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33882112,"num_objects":517,"num_object_clones":0,"num_object_copies":1551,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1411,"num_write_kb":61696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":331,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.358933+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:31:59.358933+0000","last_peered":"2024-09-15T12:31:59.358933+0000","last_clean":"2024-09-15T12:31:59.358933+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:31:59.358933+0000","last_undegraded":"2024-09-15T12:31:59.358933+0000","last_fullsized":"2024-09-15T12:31:59.358933+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":260,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.365124+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:31:59.365124+0000","last_peered":"2024-09-15T12:31:59.365124+0000","last_clean":"2024-09-15T12:31:59.365124+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:31:59.365124+0000","last_undegraded":"2024-09-15T12:31:59.365124+0000","last_fullsized":"2024-09-15T12:31:59.365124+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"96'1479","reported_seq":1491,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.667469+0000","last_change":"2024-09-15T12:31:58.498915+0000","last_active":"2024-09-15T12:34:10.667469+0000","last_peered":"2024-09-15T12:34:10.667469+0000","last_clean":"2024-09-15T12:34:10.667469+0000","last_became_active":"2024-09-15T12:31:58.487521+0000","last_became_peered":"2024-09-15T12:31:58.487521+0000","last_unstale":"2024-09-15T12:34:10.667469+0000","last_undegraded":"2024-09-15T12:34:10.667469+0000","last_fullsized":"2024-09-15T12:34:10.667469+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1479,"log_dups_size":0,"ondisk_log_size":1479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32440320,"num_objects":495,"num_object_clones":0,"num_object_copies":1485,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1479,"num_write_kb":63168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.364819+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:31:59.364819+0000","last_peered":"2024-09-15T12:31:59.364819+0000","last_clean":"2024-09-15T12:31:59.364819+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:31:59.364819+0000","last_undegraded":"2024-09-15T12:31:59.364819+0000","last_fullsized":"2024-09-15T12:31:59.364819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"96'1456","reported_seq":1468,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.571124+0000","last_change":"2024-09-15T12:31:58.468104+0000","last_active":"2024-09-15T12:34:10.571124+0000","last_peered":"2024-09-15T12:34:10.571124+0000","last_clean":"2024-09-15T12:34:10.571124+0000","last_became_active":"2024-09-15T12:31:58.462443+0000","last_became_peered":"2024-09-15T12:31:58.462443+0000","last_unstale":"2024-09-15T12:34:10.571124+0000","last_undegraded":"2024-09-15T12:34:10.571124+0000","last_fullsized":"2024-09-15T12:34:10.571124+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1456,"log_dups_size":0,"ondisk_log_size":1456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34078720,"num_objects":520,"num_object_clones":0,"num_object_copies":1560,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1456,"num_write_kb":63232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.356572+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:31:59.356572+0000","last_peered":"2024-09-15T12:31:59.356572+0000","last_clean":"2024-09-15T12:31:59.356572+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:31:59.356572+0000","last_undegraded":"2024-09-15T12:31:59.356572+0000","last_fullsized":"2024-09-15T12:31:59.356572+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"96'1395","reported_seq":1407,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.668010+0000","last_change":"2024-09-15T12:31:58.480532+0000","last_active":"2024-09-15T12:34:10.668010+0000","last_peered":"2024-09-15T12:34:10.668010+0000","last_clean":"2024-09-15T12:34:10.668010+0000","last_became_active":"2024-09-15T12:31:58.468452+0000","last_became_peered":"2024-09-15T12:31:58.468452+0000","last_unstale":"2024-09-15T12:34:10.668010+0000","last_undegraded":"2024-09-15T12:34:10.668010+0000","last_fullsized":"2024-09-15T12:34:10.668010+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1395,"log_dups_size":0,"ondisk_log_size":1395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33226752,"num_objects":507,"num_object_clones":0,"num_object_copies":1521,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1395,"num_write_kb":60864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":261,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.358054+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:31:59.358054+0000","last_peered":"2024-09-15T12:31:59.358054+0000","last_clean":"2024-09-15T12:31:59.358054+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:31:59.358054+0000","last_undegraded":"2024-09-15T12:31:59.358054+0000","last_fullsized":"2024-09-15T12:31:59.358054+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"96'1488","reported_seq":1500,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.325093+0000","last_change":"2024-09-15T12:31:58.472814+0000","last_active":"2024-09-15T12:34:10.325093+0000","last_peered":"2024-09-15T12:34:10.325093+0000","last_clean":"2024-09-15T12:34:10.325093+0000","last_became_active":"2024-09-15T12:31:58.466600+0000","last_became_peered":"2024-09-15T12:31:58.466600+0000","last_unstale":"2024-09-15T12:34:10.325093+0000","last_undegraded":"2024-09-15T12:34:10.325093+0000","last_fullsized":"2024-09-15T12:34:10.325093+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1488,"log_dups_size":0,"ondisk_log_size":1488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33292288,"num_objects":508,"num_object_clones":0,"num_object_copies":1524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1488,"num_write_kb":63872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.362774+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:31:59.362774+0000","last_peered":"2024-09-15T12:31:59.362774+0000","last_clean":"2024-09-15T12:31:59.362774+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:31:59.362774+0000","last_undegraded":"2024-09-15T12:31:59.362774+0000","last_fullsized":"2024-09-15T12:31:59.362774+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"96'1486","reported_seq":1498,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:10.698415+0000","last_change":"2024-09-15T12:31:58.435605+0000","last_active":"2024-09-15T12:34:10.698415+0000","last_peered":"2024-09-15T12:34:10.698415+0000","last_clean":"2024-09-15T12:34:10.698415+0000","last_became_active":"2024-09-15T12:31:58.429332+0000","last_became_peered":"2024-09-15T12:31:58.429332+0000","last_unstale":"2024-09-15T12:34:10.698415+0000","last_undegraded":"2024-09-15T12:34:10.698415+0000","last_fullsized":"2024-09-15T12:34:10.698415+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1486,"log_dups_size":0,"ondisk_log_size":1486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33030144,"num_objects":504,"num_object_clones":0,"num_object_copies":1512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1486,"num_write_kb":63680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.360240+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:31:59.360240+0000","last_peered":"2024-09-15T12:31:59.360240+0000","last_clean":"2024-09-15T12:31:59.360240+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:31:59.360240+0000","last_undegraded":"2024-09-15T12:31:59.360240+0000","last_fullsized":"2024-09-15T12:31:59.360240+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"96'1444","reported_seq":1456,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:11.750559+0000","last_change":"2024-09-15T12:31:58.492392+0000","last_active":"2024-09-15T12:34:11.750559+0000","last_peered":"2024-09-15T12:34:11.750559+0000","last_clean":"2024-09-15T12:34:11.750559+0000","last_became_active":"2024-09-15T12:31:58.466633+0000","last_became_peered":"2024-09-15T12:31:58.466633+0000","last_unstale":"2024-09-15T12:34:11.750559+0000","last_undegraded":"2024-09-15T12:34:11.750559+0000","last_fullsized":"2024-09-15T12:34:11.750559+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1444,"log_dups_size":0,"ondisk_log_size":1444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33423360,"num_objects":510,"num_object_clones":0,"num_object_copies":1530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1444,"num_write_kb":62528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.360118+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:31:59.360118+0000","last_peered":"2024-09-15T12:31:59.360118+0000","last_clean":"2024-09-15T12:31:59.360118+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:31:59.360118+0000","last_undegraded":"2024-09-15T12:31:59.360118+0000","last_fullsized":"2024-09-15T12:31:59.360118+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"96'1443","reported_seq":1455,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:34:11.719608+0000","last_change":"2024-09-15T12:31:58.524245+0000","last_active":"2024-09-15T12:34:11.719608+0000","last_peered":"2024-09-15T12:34:11.719608+0000","last_clean":"2024-09-15T12:34:11.719608+0000","last_became_active":"2024-09-15T12:31:58.516700+0000","last_became_peered":"2024-09-15T12:31:58.516700+0000","last_unstale":"2024-09-15T12:34:11.719608+0000","last_undegraded":"2024-09-15T12:34:11.719608+0000","last_fullsized":"2024-09-15T12:34:11.719608+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1443,"log_dups_size":0,"ondisk_log_size":1443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31653888,"num_objects":483,"num_object_clones":0,"num_object_copies":1449,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1443,"num_write_kb":61632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":259,"reported_epoch":96,"state":"active+clean","last_fresh":"2024-09-15T12:31:59.363584+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:31:59.363584+0000","last_peered":"2024-09-15T12:31:59.363584+0000","last_clean":"2024-09-15T12:31:59.363584+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:31:59.363584+0000","last_undegraded":"2024-09-15T12:31:59.363584+0000","last_fullsized":"2024-09-15T12:31:59.363584+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":529989656,"num_objects":8088,"num_object_clones":0,"num_object_copies":24264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":23032,"num_write_kb":995777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":99479552,"data_stored":1591476296,"data_compressed":75571805,"data_compressed_allocated":99467264,"data_compressed_original":1591476224,"omap_allocated":0,"internal_metadata":0},"log_size":23032,"ondisk_log_size":23032,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69776,"kb_used_data":31232,"kb_used_omap":0,"kb_used_meta":38528,"kb_avail":94302064,"statfs":{"total":96636764160,"available":96565313536,"internally_reserved":0,"allocated":31981568,"data_stored":498640561,"data_compressed":23665671,"data_compressed_allocated":31150080,"data_compressed_original":498319360,"omap_allocated":0,"internal_metadata":39452672},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706591,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":50472,"kb_used_data":19672,"kb_used_omap":0,"kb_used_meta":30784,"kb_avail":94321368,"statfs":{"total":96636764160,"available":96585080832,"internally_reserved":0,"allocated":20144128,"data_stored":309176004,"data_compressed":14668879,"data_compressed_allocated":19308544,"data_compressed_original":308854784,"omap_allocated":0,"internal_metadata":31522816},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706591,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":74964,"kb_used_data":27844,"kb_used_omap":0,"kb_used_meta":47104,"kb_avail":94296876,"statfs":{"total":96636764160,"available":96560001024,"internally_reserved":0,"allocated":28512256,"data_stored":443458724,"data_compressed":21043343,"data_compressed_allocated":27697152,"data_compressed_original":443154432,"omap_allocated":0,"internal_metadata":48234496},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706591,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66092,"kb_used_data":23516,"kb_used_omap":0,"kb_used_meta":42560,"kb_avail":94305748,"statfs":{"total":96636764160,"available":96569085952,"internally_reserved":0,"allocated":24080384,"data_stored":372221612,"data_compressed":17662624,"data_compressed_allocated":23248896,"data_compressed_original":371900416,"omap_allocated":0,"internal_metadata":43581440},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":22843392,"data_stored":365494272,"data_compressed":17355624,"data_compressed_allocated":22843392,"data_compressed_original":365494272,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27201536,"data_stored":435159064,"data_compressed":20663679,"data_compressed_allocated":27197440,"data_compressed_original":435159040,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18890752,"data_stored":302186520,"data_compressed":14349431,"data_compressed_allocated":18886656,"data_compressed_original":302186496,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":30543872,"data_stored":488636440,"data_compressed":23203071,"data_compressed_allocated":30539776,"data_compressed_original":488636416,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:34:41.091 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:34:41.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:41.220+0000 7f812e111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:41.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:41.226+0000 7f812e111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:43.655 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:34:43.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:43.794+0000 7f6f5bd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:43.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:43.800+0000 7f6f5bd51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:44.990 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:34:44.990 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-15T12:34:45.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:45.137+0000 7fec2f351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:45.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:45.152+0000 7fec2f351640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:46.067 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:34:46.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:46.202+0000 7f8e61311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:46.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:46.209+0000 7f8e61311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:46.353 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.0 to 1 (10000) 2024-09-15T12:34:46.370 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-15T12:34:46.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:46.500+0000 7f0e6bed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:46.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:46.514+0000 7f0e6bed1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:47.358 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.1 to 1 (10000) 2024-09-15T12:34:47.385 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-15T12:34:47.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:47.542+0000 7f6684b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:47.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:47.557+0000 7f6684b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:48.361 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.2 to 1 (10000) 2024-09-15T12:34:48.383 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-15T12:34:48.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:48.526+0000 7f18f6591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:48.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:48.540+0000 7f18f6591640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:48.664 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:34:48.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:48.813+0000 7f943cf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:48.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:48.820+0000 7f943cf91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:49.368 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.3 to 1 (10000) 2024-09-15T12:34:49.391 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-15T12:34:49.391 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:34:49.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:49.551+0000 7f0c6a311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:49.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:49.565+0000 7f0c6a311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:49.840 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:34:49.841 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:34:49.860 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":580,"stamp":"2024-09-15T12:34:49.370699+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":199033419,"num_objects":3033,"num_object_clones":0,"num_object_copies":9099,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":28172,"num_write_kb":996885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28146,"ondisk_log_size":28146,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":221488,"kb_used_data":40240,"kb_used_omap":0,"kb_used_meta":181184,"kb_avail":377265872,"statfs":{"total":386547056640,"available":386320252928,"internally_reserved":0,"allocated":41205760,"data_stored":628310113,"data_compressed":29806584,"data_compressed_allocated":39235584,"data_compressed_original":627523584,"omap_allocated":0,"internal_metadata":185532416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.477465"},"pg_stats":[{"pgid":"7.f","version":"100'1768","reported_seq":1792,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:41.786909+0000","last_change":"2024-09-15T12:31:58.539371+0000","last_active":"2024-09-15T12:34:41.786909+0000","last_peered":"2024-09-15T12:34:41.786909+0000","last_clean":"2024-09-15T12:34:41.786909+0000","last_became_active":"2024-09-15T12:31:58.529616+0000","last_became_peered":"2024-09-15T12:31:58.529616+0000","last_unstale":"2024-09-15T12:34:41.786909+0000","last_undegraded":"2024-09-15T12:34:41.786909+0000","last_fullsized":"2024-09-15T12:34:41.786909+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1768,"log_dups_size":0,"ondisk_log_size":1768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":176,"num_object_clones":0,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1768,"num_write_kb":62208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"100'1708","reported_seq":1732,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:40.715226+0000","last_change":"2024-09-15T12:31:58.494396+0000","last_active":"2024-09-15T12:34:40.715226+0000","last_peered":"2024-09-15T12:34:40.715226+0000","last_clean":"2024-09-15T12:34:40.715226+0000","last_became_active":"2024-09-15T12:31:58.482932+0000","last_became_peered":"2024-09-15T12:31:58.482932+0000","last_unstale":"2024-09-15T12:34:40.715226+0000","last_undegraded":"2024-09-15T12:34:40.715226+0000","last_fullsized":"2024-09-15T12:34:40.715226+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1708,"log_dups_size":0,"ondisk_log_size":1708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13107200,"num_objects":200,"num_object_clones":0,"num_object_copies":600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1708,"num_write_kb":61056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"100'1716","reported_seq":1741,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:40.704011+0000","last_change":"2024-09-15T12:31:58.494069+0000","last_active":"2024-09-15T12:34:40.704011+0000","last_peered":"2024-09-15T12:34:40.704011+0000","last_clean":"2024-09-15T12:34:40.704011+0000","last_became_active":"2024-09-15T12:31:58.483561+0000","last_became_peered":"2024-09-15T12:31:58.483561+0000","last_unstale":"2024-09-15T12:34:40.704011+0000","last_undegraded":"2024-09-15T12:34:40.704011+0000","last_fullsized":"2024-09-15T12:34:40.704011+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1716,"log_dups_size":0,"ondisk_log_size":1716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14745624,"num_objects":226,"num_object_clones":0,"num_object_copies":678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1716,"num_write_kb":62081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"100'1650","reported_seq":1674,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:40.745291+0000","last_change":"2024-09-15T12:31:58.531562+0000","last_active":"2024-09-15T12:34:40.745291+0000","last_peered":"2024-09-15T12:34:40.745291+0000","last_clean":"2024-09-15T12:34:40.745291+0000","last_became_active":"2024-09-15T12:31:58.525598+0000","last_became_peered":"2024-09-15T12:31:58.525598+0000","last_unstale":"2024-09-15T12:34:40.745291+0000","last_undegraded":"2024-09-15T12:34:40.745291+0000","last_fullsized":"2024-09-15T12:34:40.745291+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1650,"log_dups_size":0,"ondisk_log_size":1650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1650,"num_write_kb":58944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"100'1711","reported_seq":1735,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:41.529659+0000","last_change":"2024-09-15T12:31:58.544695+0000","last_active":"2024-09-15T12:34:41.529659+0000","last_peered":"2024-09-15T12:34:41.529659+0000","last_clean":"2024-09-15T12:34:41.529659+0000","last_became_active":"2024-09-15T12:31:58.536224+0000","last_became_peered":"2024-09-15T12:31:58.536224+0000","last_unstale":"2024-09-15T12:34:41.529659+0000","last_undegraded":"2024-09-15T12:34:41.529659+0000","last_fullsized":"2024-09-15T12:34:41.529659+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1711,"log_dups_size":0,"ondisk_log_size":1711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11993088,"num_objects":183,"num_object_clones":0,"num_object_copies":549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1711,"num_write_kb":60608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"100'1778","reported_seq":1802,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:41.474285+0000","last_change":"2024-09-15T12:31:58.503374+0000","last_active":"2024-09-15T12:34:41.474285+0000","last_peered":"2024-09-15T12:34:41.474285+0000","last_clean":"2024-09-15T12:34:41.474285+0000","last_became_active":"2024-09-15T12:31:58.483732+0000","last_became_peered":"2024-09-15T12:31:58.483732+0000","last_unstale":"2024-09-15T12:34:41.474285+0000","last_undegraded":"2024-09-15T12:34:41.474285+0000","last_fullsized":"2024-09-15T12:34:41.474285+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1778,"log_dups_size":0,"ondisk_log_size":1778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11141120,"num_objects":170,"num_object_clones":0,"num_object_copies":510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1778,"num_write_kb":62336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"100'1843","reported_seq":1867,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:40.579507+0000","last_change":"2024-09-15T12:31:58.497018+0000","last_active":"2024-09-15T12:34:40.579507+0000","last_peered":"2024-09-15T12:34:40.579507+0000","last_clean":"2024-09-15T12:34:40.579507+0000","last_became_active":"2024-09-15T12:31:58.489173+0000","last_became_peered":"2024-09-15T12:31:58.489173+0000","last_unstale":"2024-09-15T12:34:40.579507+0000","last_undegraded":"2024-09-15T12:34:40.579507+0000","last_fullsized":"2024-09-15T12:34:40.579507+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1843,"log_dups_size":0,"ondisk_log_size":1843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14745600,"num_objects":225,"num_object_clones":0,"num_object_copies":675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1843,"num_write_kb":66176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"100'1744","reported_seq":1768,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:40.700385+0000","last_change":"2024-09-15T12:31:58.524969+0000","last_active":"2024-09-15T12:34:40.700385+0000","last_peered":"2024-09-15T12:34:40.700385+0000","last_clean":"2024-09-15T12:34:40.700385+0000","last_became_active":"2024-09-15T12:31:58.516994+0000","last_became_peered":"2024-09-15T12:31:58.516994+0000","last_unstale":"2024-09-15T12:34:40.700385+0000","last_undegraded":"2024-09-15T12:34:40.700385+0000","last_fullsized":"2024-09-15T12:34:40.700385+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1744,"log_dups_size":0,"ondisk_log_size":1744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12058624,"num_objects":184,"num_object_clones":0,"num_object_copies":552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1744,"num_write_kb":61696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"100'1751","reported_seq":1775,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:41.645120+0000","last_change":"2024-09-15T12:31:58.495776+0000","last_active":"2024-09-15T12:34:41.645120+0000","last_peered":"2024-09-15T12:34:41.645120+0000","last_clean":"2024-09-15T12:34:41.645120+0000","last_became_active":"2024-09-15T12:31:58.474993+0000","last_became_peered":"2024-09-15T12:31:58.474993+0000","last_unstale":"2024-09-15T12:34:41.645120+0000","last_undegraded":"2024-09-15T12:34:41.645120+0000","last_fullsized":"2024-09-15T12:34:41.645120+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1751,"log_dups_size":0,"ondisk_log_size":1751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11599872,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1751,"num_write_kb":61696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":343,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.424663+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:34:32.424663+0000","last_peered":"2024-09-15T12:34:32.424663+0000","last_clean":"2024-09-15T12:34:32.424663+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:34:32.424663+0000","last_undegraded":"2024-09-15T12:34:32.424663+0000","last_fullsized":"2024-09-15T12:34:32.424663+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":272,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.424426+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:34:32.424426+0000","last_peered":"2024-09-15T12:34:32.424426+0000","last_clean":"2024-09-15T12:34:32.424426+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:34:32.424426+0000","last_undegraded":"2024-09-15T12:34:32.424426+0000","last_fullsized":"2024-09-15T12:34:32.424426+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"100'1777","reported_seq":1801,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:40.499196+0000","last_change":"2024-09-15T12:31:58.498915+0000","last_active":"2024-09-15T12:34:40.499196+0000","last_peered":"2024-09-15T12:34:40.499196+0000","last_clean":"2024-09-15T12:34:40.499196+0000","last_became_active":"2024-09-15T12:31:58.487521+0000","last_became_peered":"2024-09-15T12:31:58.487521+0000","last_unstale":"2024-09-15T12:34:40.499196+0000","last_undegraded":"2024-09-15T12:34:40.499196+0000","last_fullsized":"2024-09-15T12:34:40.499196+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1777,"log_dups_size":0,"ondisk_log_size":1777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12910592,"num_objects":197,"num_object_clones":0,"num_object_copies":591,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1777,"num_write_kb":63168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.430074+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:34:32.430074+0000","last_peered":"2024-09-15T12:34:32.430074+0000","last_clean":"2024-09-15T12:34:32.430074+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:34:32.430074+0000","last_undegraded":"2024-09-15T12:34:32.430074+0000","last_fullsized":"2024-09-15T12:34:32.430074+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"100'1791","reported_seq":1815,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:40.694449+0000","last_change":"2024-09-15T12:31:58.468104+0000","last_active":"2024-09-15T12:34:40.694449+0000","last_peered":"2024-09-15T12:34:40.694449+0000","last_clean":"2024-09-15T12:34:40.694449+0000","last_became_active":"2024-09-15T12:31:58.462443+0000","last_became_peered":"2024-09-15T12:31:58.462443+0000","last_unstale":"2024-09-15T12:34:40.694449+0000","last_undegraded":"2024-09-15T12:34:40.694449+0000","last_fullsized":"2024-09-15T12:34:40.694449+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1791,"log_dups_size":0,"ondisk_log_size":1791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12124160,"num_objects":185,"num_object_clones":0,"num_object_copies":555,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1791,"num_write_kb":63232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.408569+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:34:32.408569+0000","last_peered":"2024-09-15T12:34:32.408569+0000","last_clean":"2024-09-15T12:34:32.408569+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:34:32.408569+0000","last_undegraded":"2024-09-15T12:34:32.408569+0000","last_fullsized":"2024-09-15T12:34:32.408569+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"100'1722","reported_seq":1746,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:40.670092+0000","last_change":"2024-09-15T12:31:58.480532+0000","last_active":"2024-09-15T12:34:40.670092+0000","last_peered":"2024-09-15T12:34:40.670092+0000","last_clean":"2024-09-15T12:34:40.670092+0000","last_became_active":"2024-09-15T12:31:58.468452+0000","last_became_peered":"2024-09-15T12:31:58.468452+0000","last_unstale":"2024-09-15T12:34:40.670092+0000","last_undegraded":"2024-09-15T12:34:40.670092+0000","last_fullsized":"2024-09-15T12:34:40.670092+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1722,"log_dups_size":0,"ondisk_log_size":1722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11796480,"num_objects":180,"num_object_clones":0,"num_object_copies":540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1722,"num_write_kb":60864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":273,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.417298+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:34:32.417298+0000","last_peered":"2024-09-15T12:34:32.417298+0000","last_clean":"2024-09-15T12:34:32.417298+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:34:32.417298+0000","last_undegraded":"2024-09-15T12:34:32.417298+0000","last_fullsized":"2024-09-15T12:34:32.417298+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"100'1804","reported_seq":1828,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:40.477620+0000","last_change":"2024-09-15T12:31:58.472814+0000","last_active":"2024-09-15T12:34:40.477620+0000","last_peered":"2024-09-15T12:34:40.477620+0000","last_clean":"2024-09-15T12:34:40.477620+0000","last_became_active":"2024-09-15T12:31:58.466600+0000","last_became_peered":"2024-09-15T12:31:58.466600+0000","last_unstale":"2024-09-15T12:34:40.477620+0000","last_undegraded":"2024-09-15T12:34:40.477620+0000","last_fullsized":"2024-09-15T12:34:40.477620+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1804,"log_dups_size":0,"ondisk_log_size":1804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1804,"num_write_kb":63872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.393227+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:34:32.393227+0000","last_peered":"2024-09-15T12:34:32.393227+0000","last_clean":"2024-09-15T12:34:32.393227+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:34:32.393227+0000","last_undegraded":"2024-09-15T12:34:32.393227+0000","last_fullsized":"2024-09-15T12:34:32.393227+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"100'1810","reported_seq":1834,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:40.564346+0000","last_change":"2024-09-15T12:31:58.435605+0000","last_active":"2024-09-15T12:34:40.564346+0000","last_peered":"2024-09-15T12:34:40.564346+0000","last_clean":"2024-09-15T12:34:40.564346+0000","last_became_active":"2024-09-15T12:31:58.429332+0000","last_became_peered":"2024-09-15T12:31:58.429332+0000","last_unstale":"2024-09-15T12:34:40.564346+0000","last_undegraded":"2024-09-15T12:34:40.564346+0000","last_fullsized":"2024-09-15T12:34:40.564346+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1810,"log_dups_size":0,"ondisk_log_size":1810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11796480,"num_objects":180,"num_object_clones":0,"num_object_copies":540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1810,"num_write_kb":63680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.443677+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:34:32.443677+0000","last_peered":"2024-09-15T12:34:32.443677+0000","last_clean":"2024-09-15T12:34:32.443677+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:34:32.443677+0000","last_undegraded":"2024-09-15T12:34:32.443677+0000","last_fullsized":"2024-09-15T12:34:32.443677+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"100'1767","reported_seq":1791,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:41.798766+0000","last_change":"2024-09-15T12:31:58.492392+0000","last_active":"2024-09-15T12:34:41.798766+0000","last_peered":"2024-09-15T12:34:41.798766+0000","last_clean":"2024-09-15T12:34:41.798766+0000","last_became_active":"2024-09-15T12:31:58.466633+0000","last_became_peered":"2024-09-15T12:31:58.466633+0000","last_unstale":"2024-09-15T12:34:41.798766+0000","last_undegraded":"2024-09-15T12:34:41.798766+0000","last_fullsized":"2024-09-15T12:34:41.798766+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1767,"log_dups_size":0,"ondisk_log_size":1767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12255232,"num_objects":187,"num_object_clones":0,"num_object_copies":561,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1767,"num_write_kb":62528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.388876+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:34:32.388876+0000","last_peered":"2024-09-15T12:34:32.388876+0000","last_clean":"2024-09-15T12:34:32.388876+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:34:32.388876+0000","last_undegraded":"2024-09-15T12:34:32.388876+0000","last_fullsized":"2024-09-15T12:34:32.388876+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"100'1751","reported_seq":1775,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:41.801941+0000","last_change":"2024-09-15T12:31:58.524245+0000","last_active":"2024-09-15T12:34:41.801941+0000","last_peered":"2024-09-15T12:34:41.801941+0000","last_clean":"2024-09-15T12:34:41.801941+0000","last_became_active":"2024-09-15T12:31:58.516700+0000","last_became_peered":"2024-09-15T12:31:58.516700+0000","last_unstale":"2024-09-15T12:34:41.801941+0000","last_undegraded":"2024-09-15T12:34:41.801941+0000","last_fullsized":"2024-09-15T12:34:41.801941+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1751,"log_dups_size":0,"ondisk_log_size":1751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11468800,"num_objects":175,"num_object_clones":0,"num_object_copies":525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1751,"num_write_kb":61632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.415946+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:34:32.415946+0000","last_peered":"2024-09-15T12:34:32.415946+0000","last_clean":"2024-09-15T12:34:32.415946+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:34:32.415946+0000","last_undegraded":"2024-09-15T12:34:32.415946+0000","last_fullsized":"2024-09-15T12:34:32.415946+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":198443032,"num_objects":3029,"num_object_clones":0,"num_object_copies":9087,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":28091,"num_write_kb":995777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":37425152,"data_stored":598605896,"data_compressed":28425008,"data_compressed_allocated":37412864,"data_compressed_original":598605824,"omap_allocated":0,"internal_metadata":0},"log_size":28091,"ondisk_log_size":28091,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68532,"kb_used_data":11940,"kb_used_omap":0,"kb_used_meta":56576,"kb_avail":94303308,"statfs":{"total":96636764160,"available":96566587392,"internally_reserved":0,"allocated":12226560,"data_stored":187814040,"data_compressed":8911680,"data_compressed_allocated":11730944,"data_compressed_original":187613184,"omap_allocated":0,"internal_metadata":57933824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706621,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51276,"kb_used_data":7996,"kb_used_omap":0,"kb_used_meta":43264,"kb_avail":94320564,"statfs":{"total":96636764160,"available":96584257536,"internally_reserved":0,"allocated":8187904,"data_stored":123130027,"data_compressed":5840136,"data_compressed_allocated":7688192,"data_compressed_original":122929152,"omap_allocated":0,"internal_metadata":44302336},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706621,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54080,"kb_used_data":11120,"kb_used_omap":0,"kb_used_meta":42944,"kb_avail":94317760,"statfs":{"total":96636764160,"available":96581386240,"internally_reserved":0,"allocated":11386880,"data_stored":174706315,"data_compressed":8287256,"data_compressed_allocated":10907648,"data_compressed_original":174522368,"omap_allocated":0,"internal_metadata":43974656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706621,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47600,"kb_used_data":9184,"kb_used_omap":0,"kb_used_meta":38400,"kb_avail":94324240,"statfs":{"total":96636764160,"available":96588021760,"internally_reserved":0,"allocated":9404416,"data_stored":142659731,"data_compressed":6767512,"data_compressed_allocated":8908800,"data_compressed_original":142458880,"omap_allocated":0,"internal_metadata":39321600},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8503296,"data_stored":136052736,"data_compressed":6460512,"data_compressed_allocated":8503296,"data_compressed_original":136052736,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10387456,"data_stored":166133784,"data_compressed":7888920,"data_compressed_allocated":10383360,"data_compressed_original":166133760,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7311360,"data_stored":116916248,"data_compressed":5551808,"data_compressed_allocated":7307264,"data_compressed_original":116916224,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11223040,"data_stored":179503128,"data_compressed":8523768,"data_compressed_allocated":11218944,"data_compressed_original":179503104,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:34:49.862 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:34:50.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:50.012+0000 7f608bd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:50.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:50.026+0000 7f608bd11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:50.344 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:34:50.344 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:34:50.366 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":581,"stamp":"2024-09-15T12:34:49.894285+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":199033419,"num_objects":3033,"num_object_clones":0,"num_object_copies":9099,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":28172,"num_write_kb":996885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28146,"ondisk_log_size":28146,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":221488,"kb_used_data":40240,"kb_used_omap":0,"kb_used_meta":181184,"kb_avail":377265872,"statfs":{"total":386547056640,"available":386320252928,"internally_reserved":0,"allocated":41205760,"data_stored":628310113,"data_compressed":29806584,"data_compressed_allocated":39235584,"data_compressed_original":627523584,"omap_allocated":0,"internal_metadata":185532416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000700"},"pg_stats":[{"pgid":"7.f","version":"100'1768","reported_seq":1792,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:41.786909+0000","last_change":"2024-09-15T12:31:58.539371+0000","last_active":"2024-09-15T12:34:41.786909+0000","last_peered":"2024-09-15T12:34:41.786909+0000","last_clean":"2024-09-15T12:34:41.786909+0000","last_became_active":"2024-09-15T12:31:58.529616+0000","last_became_peered":"2024-09-15T12:31:58.529616+0000","last_unstale":"2024-09-15T12:34:41.786909+0000","last_undegraded":"2024-09-15T12:34:41.786909+0000","last_fullsized":"2024-09-15T12:34:41.786909+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1768,"log_dups_size":0,"ondisk_log_size":1768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":176,"num_object_clones":0,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1768,"num_write_kb":62208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"100'1708","reported_seq":1732,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:40.715226+0000","last_change":"2024-09-15T12:31:58.494396+0000","last_active":"2024-09-15T12:34:40.715226+0000","last_peered":"2024-09-15T12:34:40.715226+0000","last_clean":"2024-09-15T12:34:40.715226+0000","last_became_active":"2024-09-15T12:31:58.482932+0000","last_became_peered":"2024-09-15T12:31:58.482932+0000","last_unstale":"2024-09-15T12:34:40.715226+0000","last_undegraded":"2024-09-15T12:34:40.715226+0000","last_fullsized":"2024-09-15T12:34:40.715226+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1708,"log_dups_size":0,"ondisk_log_size":1708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13107200,"num_objects":200,"num_object_clones":0,"num_object_copies":600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1708,"num_write_kb":61056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"100'1716","reported_seq":1741,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:40.704011+0000","last_change":"2024-09-15T12:31:58.494069+0000","last_active":"2024-09-15T12:34:40.704011+0000","last_peered":"2024-09-15T12:34:40.704011+0000","last_clean":"2024-09-15T12:34:40.704011+0000","last_became_active":"2024-09-15T12:31:58.483561+0000","last_became_peered":"2024-09-15T12:31:58.483561+0000","last_unstale":"2024-09-15T12:34:40.704011+0000","last_undegraded":"2024-09-15T12:34:40.704011+0000","last_fullsized":"2024-09-15T12:34:40.704011+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1716,"log_dups_size":0,"ondisk_log_size":1716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14745624,"num_objects":226,"num_object_clones":0,"num_object_copies":678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1716,"num_write_kb":62081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"100'1650","reported_seq":1674,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:40.745291+0000","last_change":"2024-09-15T12:31:58.531562+0000","last_active":"2024-09-15T12:34:40.745291+0000","last_peered":"2024-09-15T12:34:40.745291+0000","last_clean":"2024-09-15T12:34:40.745291+0000","last_became_active":"2024-09-15T12:31:58.525598+0000","last_became_peered":"2024-09-15T12:31:58.525598+0000","last_unstale":"2024-09-15T12:34:40.745291+0000","last_undegraded":"2024-09-15T12:34:40.745291+0000","last_fullsized":"2024-09-15T12:34:40.745291+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1650,"log_dups_size":0,"ondisk_log_size":1650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1650,"num_write_kb":58944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"100'1711","reported_seq":1735,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:41.529659+0000","last_change":"2024-09-15T12:31:58.544695+0000","last_active":"2024-09-15T12:34:41.529659+0000","last_peered":"2024-09-15T12:34:41.529659+0000","last_clean":"2024-09-15T12:34:41.529659+0000","last_became_active":"2024-09-15T12:31:58.536224+0000","last_became_peered":"2024-09-15T12:31:58.536224+0000","last_unstale":"2024-09-15T12:34:41.529659+0000","last_undegraded":"2024-09-15T12:34:41.529659+0000","last_fullsized":"2024-09-15T12:34:41.529659+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1711,"log_dups_size":0,"ondisk_log_size":1711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11993088,"num_objects":183,"num_object_clones":0,"num_object_copies":549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1711,"num_write_kb":60608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"100'1778","reported_seq":1802,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:41.474285+0000","last_change":"2024-09-15T12:31:58.503374+0000","last_active":"2024-09-15T12:34:41.474285+0000","last_peered":"2024-09-15T12:34:41.474285+0000","last_clean":"2024-09-15T12:34:41.474285+0000","last_became_active":"2024-09-15T12:31:58.483732+0000","last_became_peered":"2024-09-15T12:31:58.483732+0000","last_unstale":"2024-09-15T12:34:41.474285+0000","last_undegraded":"2024-09-15T12:34:41.474285+0000","last_fullsized":"2024-09-15T12:34:41.474285+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1778,"log_dups_size":0,"ondisk_log_size":1778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11141120,"num_objects":170,"num_object_clones":0,"num_object_copies":510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1778,"num_write_kb":62336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"100'1843","reported_seq":1867,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:40.579507+0000","last_change":"2024-09-15T12:31:58.497018+0000","last_active":"2024-09-15T12:34:40.579507+0000","last_peered":"2024-09-15T12:34:40.579507+0000","last_clean":"2024-09-15T12:34:40.579507+0000","last_became_active":"2024-09-15T12:31:58.489173+0000","last_became_peered":"2024-09-15T12:31:58.489173+0000","last_unstale":"2024-09-15T12:34:40.579507+0000","last_undegraded":"2024-09-15T12:34:40.579507+0000","last_fullsized":"2024-09-15T12:34:40.579507+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1843,"log_dups_size":0,"ondisk_log_size":1843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14745600,"num_objects":225,"num_object_clones":0,"num_object_copies":675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1843,"num_write_kb":66176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"100'1744","reported_seq":1768,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:40.700385+0000","last_change":"2024-09-15T12:31:58.524969+0000","last_active":"2024-09-15T12:34:40.700385+0000","last_peered":"2024-09-15T12:34:40.700385+0000","last_clean":"2024-09-15T12:34:40.700385+0000","last_became_active":"2024-09-15T12:31:58.516994+0000","last_became_peered":"2024-09-15T12:31:58.516994+0000","last_unstale":"2024-09-15T12:34:40.700385+0000","last_undegraded":"2024-09-15T12:34:40.700385+0000","last_fullsized":"2024-09-15T12:34:40.700385+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1744,"log_dups_size":0,"ondisk_log_size":1744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12058624,"num_objects":184,"num_object_clones":0,"num_object_copies":552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1744,"num_write_kb":61696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"100'1751","reported_seq":1775,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:41.645120+0000","last_change":"2024-09-15T12:31:58.495776+0000","last_active":"2024-09-15T12:34:41.645120+0000","last_peered":"2024-09-15T12:34:41.645120+0000","last_clean":"2024-09-15T12:34:41.645120+0000","last_became_active":"2024-09-15T12:31:58.474993+0000","last_became_peered":"2024-09-15T12:31:58.474993+0000","last_unstale":"2024-09-15T12:34:41.645120+0000","last_undegraded":"2024-09-15T12:34:41.645120+0000","last_fullsized":"2024-09-15T12:34:41.645120+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1751,"log_dups_size":0,"ondisk_log_size":1751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11599872,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1751,"num_write_kb":61696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":343,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.424663+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:34:32.424663+0000","last_peered":"2024-09-15T12:34:32.424663+0000","last_clean":"2024-09-15T12:34:32.424663+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:34:32.424663+0000","last_undegraded":"2024-09-15T12:34:32.424663+0000","last_fullsized":"2024-09-15T12:34:32.424663+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":272,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.424426+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:34:32.424426+0000","last_peered":"2024-09-15T12:34:32.424426+0000","last_clean":"2024-09-15T12:34:32.424426+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:34:32.424426+0000","last_undegraded":"2024-09-15T12:34:32.424426+0000","last_fullsized":"2024-09-15T12:34:32.424426+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"100'1777","reported_seq":1801,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:40.499196+0000","last_change":"2024-09-15T12:31:58.498915+0000","last_active":"2024-09-15T12:34:40.499196+0000","last_peered":"2024-09-15T12:34:40.499196+0000","last_clean":"2024-09-15T12:34:40.499196+0000","last_became_active":"2024-09-15T12:31:58.487521+0000","last_became_peered":"2024-09-15T12:31:58.487521+0000","last_unstale":"2024-09-15T12:34:40.499196+0000","last_undegraded":"2024-09-15T12:34:40.499196+0000","last_fullsized":"2024-09-15T12:34:40.499196+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1777,"log_dups_size":0,"ondisk_log_size":1777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12910592,"num_objects":197,"num_object_clones":0,"num_object_copies":591,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1777,"num_write_kb":63168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.430074+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:34:32.430074+0000","last_peered":"2024-09-15T12:34:32.430074+0000","last_clean":"2024-09-15T12:34:32.430074+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:34:32.430074+0000","last_undegraded":"2024-09-15T12:34:32.430074+0000","last_fullsized":"2024-09-15T12:34:32.430074+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"100'1791","reported_seq":1815,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:40.694449+0000","last_change":"2024-09-15T12:31:58.468104+0000","last_active":"2024-09-15T12:34:40.694449+0000","last_peered":"2024-09-15T12:34:40.694449+0000","last_clean":"2024-09-15T12:34:40.694449+0000","last_became_active":"2024-09-15T12:31:58.462443+0000","last_became_peered":"2024-09-15T12:31:58.462443+0000","last_unstale":"2024-09-15T12:34:40.694449+0000","last_undegraded":"2024-09-15T12:34:40.694449+0000","last_fullsized":"2024-09-15T12:34:40.694449+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1791,"log_dups_size":0,"ondisk_log_size":1791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12124160,"num_objects":185,"num_object_clones":0,"num_object_copies":555,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1791,"num_write_kb":63232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.408569+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:34:32.408569+0000","last_peered":"2024-09-15T12:34:32.408569+0000","last_clean":"2024-09-15T12:34:32.408569+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:34:32.408569+0000","last_undegraded":"2024-09-15T12:34:32.408569+0000","last_fullsized":"2024-09-15T12:34:32.408569+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"100'1722","reported_seq":1746,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:40.670092+0000","last_change":"2024-09-15T12:31:58.480532+0000","last_active":"2024-09-15T12:34:40.670092+0000","last_peered":"2024-09-15T12:34:40.670092+0000","last_clean":"2024-09-15T12:34:40.670092+0000","last_became_active":"2024-09-15T12:31:58.468452+0000","last_became_peered":"2024-09-15T12:31:58.468452+0000","last_unstale":"2024-09-15T12:34:40.670092+0000","last_undegraded":"2024-09-15T12:34:40.670092+0000","last_fullsized":"2024-09-15T12:34:40.670092+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1722,"log_dups_size":0,"ondisk_log_size":1722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11796480,"num_objects":180,"num_object_clones":0,"num_object_copies":540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1722,"num_write_kb":60864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":273,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.417298+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:34:32.417298+0000","last_peered":"2024-09-15T12:34:32.417298+0000","last_clean":"2024-09-15T12:34:32.417298+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:34:32.417298+0000","last_undegraded":"2024-09-15T12:34:32.417298+0000","last_fullsized":"2024-09-15T12:34:32.417298+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"100'1804","reported_seq":1828,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:40.477620+0000","last_change":"2024-09-15T12:31:58.472814+0000","last_active":"2024-09-15T12:34:40.477620+0000","last_peered":"2024-09-15T12:34:40.477620+0000","last_clean":"2024-09-15T12:34:40.477620+0000","last_became_active":"2024-09-15T12:31:58.466600+0000","last_became_peered":"2024-09-15T12:31:58.466600+0000","last_unstale":"2024-09-15T12:34:40.477620+0000","last_undegraded":"2024-09-15T12:34:40.477620+0000","last_fullsized":"2024-09-15T12:34:40.477620+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1804,"log_dups_size":0,"ondisk_log_size":1804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1804,"num_write_kb":63872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.393227+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:34:32.393227+0000","last_peered":"2024-09-15T12:34:32.393227+0000","last_clean":"2024-09-15T12:34:32.393227+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:34:32.393227+0000","last_undegraded":"2024-09-15T12:34:32.393227+0000","last_fullsized":"2024-09-15T12:34:32.393227+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"100'1810","reported_seq":1834,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:40.564346+0000","last_change":"2024-09-15T12:31:58.435605+0000","last_active":"2024-09-15T12:34:40.564346+0000","last_peered":"2024-09-15T12:34:40.564346+0000","last_clean":"2024-09-15T12:34:40.564346+0000","last_became_active":"2024-09-15T12:31:58.429332+0000","last_became_peered":"2024-09-15T12:31:58.429332+0000","last_unstale":"2024-09-15T12:34:40.564346+0000","last_undegraded":"2024-09-15T12:34:40.564346+0000","last_fullsized":"2024-09-15T12:34:40.564346+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1810,"log_dups_size":0,"ondisk_log_size":1810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11796480,"num_objects":180,"num_object_clones":0,"num_object_copies":540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1810,"num_write_kb":63680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.443677+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:34:32.443677+0000","last_peered":"2024-09-15T12:34:32.443677+0000","last_clean":"2024-09-15T12:34:32.443677+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:34:32.443677+0000","last_undegraded":"2024-09-15T12:34:32.443677+0000","last_fullsized":"2024-09-15T12:34:32.443677+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"100'1767","reported_seq":1791,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:41.798766+0000","last_change":"2024-09-15T12:31:58.492392+0000","last_active":"2024-09-15T12:34:41.798766+0000","last_peered":"2024-09-15T12:34:41.798766+0000","last_clean":"2024-09-15T12:34:41.798766+0000","last_became_active":"2024-09-15T12:31:58.466633+0000","last_became_peered":"2024-09-15T12:31:58.466633+0000","last_unstale":"2024-09-15T12:34:41.798766+0000","last_undegraded":"2024-09-15T12:34:41.798766+0000","last_fullsized":"2024-09-15T12:34:41.798766+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1767,"log_dups_size":0,"ondisk_log_size":1767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12255232,"num_objects":187,"num_object_clones":0,"num_object_copies":561,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1767,"num_write_kb":62528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.388876+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:34:32.388876+0000","last_peered":"2024-09-15T12:34:32.388876+0000","last_clean":"2024-09-15T12:34:32.388876+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:34:32.388876+0000","last_undegraded":"2024-09-15T12:34:32.388876+0000","last_fullsized":"2024-09-15T12:34:32.388876+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"100'1751","reported_seq":1775,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:41.801941+0000","last_change":"2024-09-15T12:31:58.524245+0000","last_active":"2024-09-15T12:34:41.801941+0000","last_peered":"2024-09-15T12:34:41.801941+0000","last_clean":"2024-09-15T12:34:41.801941+0000","last_became_active":"2024-09-15T12:31:58.516700+0000","last_became_peered":"2024-09-15T12:31:58.516700+0000","last_unstale":"2024-09-15T12:34:41.801941+0000","last_undegraded":"2024-09-15T12:34:41.801941+0000","last_fullsized":"2024-09-15T12:34:41.801941+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1751,"log_dups_size":0,"ondisk_log_size":1751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11468800,"num_objects":175,"num_object_clones":0,"num_object_copies":525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1751,"num_write_kb":61632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.415946+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:34:32.415946+0000","last_peered":"2024-09-15T12:34:32.415946+0000","last_clean":"2024-09-15T12:34:32.415946+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:34:32.415946+0000","last_undegraded":"2024-09-15T12:34:32.415946+0000","last_fullsized":"2024-09-15T12:34:32.415946+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":198443032,"num_objects":3029,"num_object_clones":0,"num_object_copies":9087,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":28091,"num_write_kb":995777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":37425152,"data_stored":598605896,"data_compressed":28425008,"data_compressed_allocated":37412864,"data_compressed_original":598605824,"omap_allocated":0,"internal_metadata":0},"log_size":28091,"ondisk_log_size":28091,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68532,"kb_used_data":11940,"kb_used_omap":0,"kb_used_meta":56576,"kb_avail":94303308,"statfs":{"total":96636764160,"available":96566587392,"internally_reserved":0,"allocated":12226560,"data_stored":187814040,"data_compressed":8911680,"data_compressed_allocated":11730944,"data_compressed_original":187613184,"omap_allocated":0,"internal_metadata":57933824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706621,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51276,"kb_used_data":7996,"kb_used_omap":0,"kb_used_meta":43264,"kb_avail":94320564,"statfs":{"total":96636764160,"available":96584257536,"internally_reserved":0,"allocated":8187904,"data_stored":123130027,"data_compressed":5840136,"data_compressed_allocated":7688192,"data_compressed_original":122929152,"omap_allocated":0,"internal_metadata":44302336},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706621,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54080,"kb_used_data":11120,"kb_used_omap":0,"kb_used_meta":42944,"kb_avail":94317760,"statfs":{"total":96636764160,"available":96581386240,"internally_reserved":0,"allocated":11386880,"data_stored":174706315,"data_compressed":8287256,"data_compressed_allocated":10907648,"data_compressed_original":174522368,"omap_allocated":0,"internal_metadata":43974656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706621,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47600,"kb_used_data":9184,"kb_used_omap":0,"kb_used_meta":38400,"kb_avail":94324240,"statfs":{"total":96636764160,"available":96588021760,"internally_reserved":0,"allocated":9404416,"data_stored":142659731,"data_compressed":6767512,"data_compressed_allocated":8908800,"data_compressed_original":142458880,"omap_allocated":0,"internal_metadata":39321600},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8503296,"data_stored":136052736,"data_compressed":6460512,"data_compressed_allocated":8503296,"data_compressed_original":136052736,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10387456,"data_stored":166133784,"data_compressed":7888920,"data_compressed_allocated":10383360,"data_compressed_original":166133760,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7311360,"data_stored":116916248,"data_compressed":5551808,"data_compressed_allocated":7307264,"data_compressed_original":116916224,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11223040,"data_stored":179503128,"data_compressed":8523768,"data_compressed_allocated":11218944,"data_compressed_original":179503104,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:34:50.368 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-15T12:34:50.368 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:34:50.368 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:34:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:50.505+0000 7f730ce6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:50.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:50.521+0000 7f730ce6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:50.792 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:34:50.792 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:34:50.805 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":581,"stamp":"2024-09-15T12:34:49.894285+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":199033419,"num_objects":3033,"num_object_clones":0,"num_object_copies":9099,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":47,"num_write":28172,"num_write_kb":996885,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28146,"ondisk_log_size":28146,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":221488,"kb_used_data":40240,"kb_used_omap":0,"kb_used_meta":181184,"kb_avail":377265872,"statfs":{"total":386547056640,"available":386320252928,"internally_reserved":0,"allocated":41205760,"data_stored":628310113,"data_compressed":29806584,"data_compressed_allocated":39235584,"data_compressed_original":627523584,"omap_allocated":0,"internal_metadata":185532416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000700"},"pg_stats":[{"pgid":"7.f","version":"100'1768","reported_seq":1792,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:41.786909+0000","last_change":"2024-09-15T12:31:58.539371+0000","last_active":"2024-09-15T12:34:41.786909+0000","last_peered":"2024-09-15T12:34:41.786909+0000","last_clean":"2024-09-15T12:34:41.786909+0000","last_became_active":"2024-09-15T12:31:58.529616+0000","last_became_peered":"2024-09-15T12:31:58.529616+0000","last_unstale":"2024-09-15T12:34:41.786909+0000","last_undegraded":"2024-09-15T12:34:41.786909+0000","last_fullsized":"2024-09-15T12:34:41.786909+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1768,"log_dups_size":0,"ondisk_log_size":1768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":176,"num_object_clones":0,"num_object_copies":528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1768,"num_write_kb":62208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"100'1708","reported_seq":1732,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:40.715226+0000","last_change":"2024-09-15T12:31:58.494396+0000","last_active":"2024-09-15T12:34:40.715226+0000","last_peered":"2024-09-15T12:34:40.715226+0000","last_clean":"2024-09-15T12:34:40.715226+0000","last_became_active":"2024-09-15T12:31:58.482932+0000","last_became_peered":"2024-09-15T12:31:58.482932+0000","last_unstale":"2024-09-15T12:34:40.715226+0000","last_undegraded":"2024-09-15T12:34:40.715226+0000","last_fullsized":"2024-09-15T12:34:40.715226+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1708,"log_dups_size":0,"ondisk_log_size":1708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13107200,"num_objects":200,"num_object_clones":0,"num_object_copies":600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1708,"num_write_kb":61056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"100'1716","reported_seq":1741,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:40.704011+0000","last_change":"2024-09-15T12:31:58.494069+0000","last_active":"2024-09-15T12:34:40.704011+0000","last_peered":"2024-09-15T12:34:40.704011+0000","last_clean":"2024-09-15T12:34:40.704011+0000","last_became_active":"2024-09-15T12:31:58.483561+0000","last_became_peered":"2024-09-15T12:31:58.483561+0000","last_unstale":"2024-09-15T12:34:40.704011+0000","last_undegraded":"2024-09-15T12:34:40.704011+0000","last_fullsized":"2024-09-15T12:34:40.704011+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1716,"log_dups_size":0,"ondisk_log_size":1716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14745624,"num_objects":226,"num_object_clones":0,"num_object_copies":678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1716,"num_write_kb":62081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.c","version":"100'1650","reported_seq":1674,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:40.745291+0000","last_change":"2024-09-15T12:31:58.531562+0000","last_active":"2024-09-15T12:34:40.745291+0000","last_peered":"2024-09-15T12:34:40.745291+0000","last_clean":"2024-09-15T12:34:40.745291+0000","last_became_active":"2024-09-15T12:31:58.525598+0000","last_became_peered":"2024-09-15T12:31:58.525598+0000","last_unstale":"2024-09-15T12:34:40.745291+0000","last_undegraded":"2024-09-15T12:34:40.745291+0000","last_fullsized":"2024-09-15T12:34:40.745291+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1650,"log_dups_size":0,"ondisk_log_size":1650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1650,"num_write_kb":58944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"100'1711","reported_seq":1735,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:41.529659+0000","last_change":"2024-09-15T12:31:58.544695+0000","last_active":"2024-09-15T12:34:41.529659+0000","last_peered":"2024-09-15T12:34:41.529659+0000","last_clean":"2024-09-15T12:34:41.529659+0000","last_became_active":"2024-09-15T12:31:58.536224+0000","last_became_peered":"2024-09-15T12:31:58.536224+0000","last_unstale":"2024-09-15T12:34:41.529659+0000","last_undegraded":"2024-09-15T12:34:41.529659+0000","last_fullsized":"2024-09-15T12:34:41.529659+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1711,"log_dups_size":0,"ondisk_log_size":1711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11993088,"num_objects":183,"num_object_clones":0,"num_object_copies":549,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1711,"num_write_kb":60608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"100'1778","reported_seq":1802,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:41.474285+0000","last_change":"2024-09-15T12:31:58.503374+0000","last_active":"2024-09-15T12:34:41.474285+0000","last_peered":"2024-09-15T12:34:41.474285+0000","last_clean":"2024-09-15T12:34:41.474285+0000","last_became_active":"2024-09-15T12:31:58.483732+0000","last_became_peered":"2024-09-15T12:31:58.483732+0000","last_unstale":"2024-09-15T12:34:41.474285+0000","last_undegraded":"2024-09-15T12:34:41.474285+0000","last_fullsized":"2024-09-15T12:34:41.474285+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1778,"log_dups_size":0,"ondisk_log_size":1778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11141120,"num_objects":170,"num_object_clones":0,"num_object_copies":510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1778,"num_write_kb":62336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"100'1843","reported_seq":1867,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:40.579507+0000","last_change":"2024-09-15T12:31:58.497018+0000","last_active":"2024-09-15T12:34:40.579507+0000","last_peered":"2024-09-15T12:34:40.579507+0000","last_clean":"2024-09-15T12:34:40.579507+0000","last_became_active":"2024-09-15T12:31:58.489173+0000","last_became_peered":"2024-09-15T12:31:58.489173+0000","last_unstale":"2024-09-15T12:34:40.579507+0000","last_undegraded":"2024-09-15T12:34:40.579507+0000","last_fullsized":"2024-09-15T12:34:40.579507+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1843,"log_dups_size":0,"ondisk_log_size":1843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14745600,"num_objects":225,"num_object_clones":0,"num_object_copies":675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1843,"num_write_kb":66176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.8","version":"100'1744","reported_seq":1768,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:40.700385+0000","last_change":"2024-09-15T12:31:58.524969+0000","last_active":"2024-09-15T12:34:40.700385+0000","last_peered":"2024-09-15T12:34:40.700385+0000","last_clean":"2024-09-15T12:34:40.700385+0000","last_became_active":"2024-09-15T12:31:58.516994+0000","last_became_peered":"2024-09-15T12:31:58.516994+0000","last_unstale":"2024-09-15T12:34:40.700385+0000","last_undegraded":"2024-09-15T12:34:40.700385+0000","last_fullsized":"2024-09-15T12:34:40.700385+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1744,"log_dups_size":0,"ondisk_log_size":1744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12058624,"num_objects":184,"num_object_clones":0,"num_object_copies":552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1744,"num_write_kb":61696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"100'1751","reported_seq":1775,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:41.645120+0000","last_change":"2024-09-15T12:31:58.495776+0000","last_active":"2024-09-15T12:34:41.645120+0000","last_peered":"2024-09-15T12:34:41.645120+0000","last_clean":"2024-09-15T12:34:41.645120+0000","last_became_active":"2024-09-15T12:31:58.474993+0000","last_became_peered":"2024-09-15T12:31:58.474993+0000","last_unstale":"2024-09-15T12:34:41.645120+0000","last_undegraded":"2024-09-15T12:34:41.645120+0000","last_fullsized":"2024-09-15T12:34:41.645120+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1751,"log_dups_size":0,"ondisk_log_size":1751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11599872,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1751,"num_write_kb":61696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'52","reported_seq":343,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.424663+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:34:32.424663+0000","last_peered":"2024-09-15T12:34:32.424663+0000","last_clean":"2024-09-15T12:34:32.424663+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:34:32.424663+0000","last_undegraded":"2024-09-15T12:34:32.424663+0000","last_fullsized":"2024-09-15T12:34:32.424663+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":272,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.424426+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:34:32.424426+0000","last_peered":"2024-09-15T12:34:32.424426+0000","last_clean":"2024-09-15T12:34:32.424426+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:34:32.424426+0000","last_undegraded":"2024-09-15T12:34:32.424426+0000","last_fullsized":"2024-09-15T12:34:32.424426+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"100'1777","reported_seq":1801,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:40.499196+0000","last_change":"2024-09-15T12:31:58.498915+0000","last_active":"2024-09-15T12:34:40.499196+0000","last_peered":"2024-09-15T12:34:40.499196+0000","last_clean":"2024-09-15T12:34:40.499196+0000","last_became_active":"2024-09-15T12:31:58.487521+0000","last_became_peered":"2024-09-15T12:31:58.487521+0000","last_unstale":"2024-09-15T12:34:40.499196+0000","last_undegraded":"2024-09-15T12:34:40.499196+0000","last_fullsized":"2024-09-15T12:34:40.499196+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1777,"log_dups_size":0,"ondisk_log_size":1777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12910592,"num_objects":197,"num_object_clones":0,"num_object_copies":591,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1777,"num_write_kb":63168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.430074+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:34:32.430074+0000","last_peered":"2024-09-15T12:34:32.430074+0000","last_clean":"2024-09-15T12:34:32.430074+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:34:32.430074+0000","last_undegraded":"2024-09-15T12:34:32.430074+0000","last_fullsized":"2024-09-15T12:34:32.430074+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"100'1791","reported_seq":1815,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:40.694449+0000","last_change":"2024-09-15T12:31:58.468104+0000","last_active":"2024-09-15T12:34:40.694449+0000","last_peered":"2024-09-15T12:34:40.694449+0000","last_clean":"2024-09-15T12:34:40.694449+0000","last_became_active":"2024-09-15T12:31:58.462443+0000","last_became_peered":"2024-09-15T12:31:58.462443+0000","last_unstale":"2024-09-15T12:34:40.694449+0000","last_undegraded":"2024-09-15T12:34:40.694449+0000","last_fullsized":"2024-09-15T12:34:40.694449+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1791,"log_dups_size":0,"ondisk_log_size":1791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12124160,"num_objects":185,"num_object_clones":0,"num_object_copies":555,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1791,"num_write_kb":63232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.408569+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:34:32.408569+0000","last_peered":"2024-09-15T12:34:32.408569+0000","last_clean":"2024-09-15T12:34:32.408569+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:34:32.408569+0000","last_undegraded":"2024-09-15T12:34:32.408569+0000","last_fullsized":"2024-09-15T12:34:32.408569+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"100'1722","reported_seq":1746,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:40.670092+0000","last_change":"2024-09-15T12:31:58.480532+0000","last_active":"2024-09-15T12:34:40.670092+0000","last_peered":"2024-09-15T12:34:40.670092+0000","last_clean":"2024-09-15T12:34:40.670092+0000","last_became_active":"2024-09-15T12:31:58.468452+0000","last_became_peered":"2024-09-15T12:31:58.468452+0000","last_unstale":"2024-09-15T12:34:40.670092+0000","last_undegraded":"2024-09-15T12:34:40.670092+0000","last_fullsized":"2024-09-15T12:34:40.670092+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1722,"log_dups_size":0,"ondisk_log_size":1722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11796480,"num_objects":180,"num_object_clones":0,"num_object_copies":540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1722,"num_write_kb":60864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":273,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.417298+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:34:32.417298+0000","last_peered":"2024-09-15T12:34:32.417298+0000","last_clean":"2024-09-15T12:34:32.417298+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:34:32.417298+0000","last_undegraded":"2024-09-15T12:34:32.417298+0000","last_fullsized":"2024-09-15T12:34:32.417298+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"100'1804","reported_seq":1828,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:40.477620+0000","last_change":"2024-09-15T12:31:58.472814+0000","last_active":"2024-09-15T12:34:40.477620+0000","last_peered":"2024-09-15T12:34:40.477620+0000","last_clean":"2024-09-15T12:34:40.477620+0000","last_became_active":"2024-09-15T12:31:58.466600+0000","last_became_peered":"2024-09-15T12:31:58.466600+0000","last_unstale":"2024-09-15T12:34:40.477620+0000","last_undegraded":"2024-09-15T12:34:40.477620+0000","last_fullsized":"2024-09-15T12:34:40.477620+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1804,"log_dups_size":0,"ondisk_log_size":1804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1804,"num_write_kb":63872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.393227+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:34:32.393227+0000","last_peered":"2024-09-15T12:34:32.393227+0000","last_clean":"2024-09-15T12:34:32.393227+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:34:32.393227+0000","last_undegraded":"2024-09-15T12:34:32.393227+0000","last_fullsized":"2024-09-15T12:34:32.393227+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.0","version":"100'1810","reported_seq":1834,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:40.564346+0000","last_change":"2024-09-15T12:31:58.435605+0000","last_active":"2024-09-15T12:34:40.564346+0000","last_peered":"2024-09-15T12:34:40.564346+0000","last_clean":"2024-09-15T12:34:40.564346+0000","last_became_active":"2024-09-15T12:31:58.429332+0000","last_became_peered":"2024-09-15T12:31:58.429332+0000","last_unstale":"2024-09-15T12:34:40.564346+0000","last_undegraded":"2024-09-15T12:34:40.564346+0000","last_fullsized":"2024-09-15T12:34:40.564346+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1810,"log_dups_size":0,"ondisk_log_size":1810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11796480,"num_objects":180,"num_object_clones":0,"num_object_copies":540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1810,"num_write_kb":63680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.443677+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:34:32.443677+0000","last_peered":"2024-09-15T12:34:32.443677+0000","last_clean":"2024-09-15T12:34:32.443677+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:34:32.443677+0000","last_undegraded":"2024-09-15T12:34:32.443677+0000","last_fullsized":"2024-09-15T12:34:32.443677+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"100'1767","reported_seq":1791,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:41.798766+0000","last_change":"2024-09-15T12:31:58.492392+0000","last_active":"2024-09-15T12:34:41.798766+0000","last_peered":"2024-09-15T12:34:41.798766+0000","last_clean":"2024-09-15T12:34:41.798766+0000","last_became_active":"2024-09-15T12:31:58.466633+0000","last_became_peered":"2024-09-15T12:31:58.466633+0000","last_unstale":"2024-09-15T12:34:41.798766+0000","last_undegraded":"2024-09-15T12:34:41.798766+0000","last_fullsized":"2024-09-15T12:34:41.798766+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1767,"log_dups_size":0,"ondisk_log_size":1767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12255232,"num_objects":187,"num_object_clones":0,"num_object_copies":561,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1767,"num_write_kb":62528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.388876+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:34:32.388876+0000","last_peered":"2024-09-15T12:34:32.388876+0000","last_clean":"2024-09-15T12:34:32.388876+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:34:32.388876+0000","last_undegraded":"2024-09-15T12:34:32.388876+0000","last_fullsized":"2024-09-15T12:34:32.388876+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"100'1751","reported_seq":1775,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:41.801941+0000","last_change":"2024-09-15T12:31:58.524245+0000","last_active":"2024-09-15T12:34:41.801941+0000","last_peered":"2024-09-15T12:34:41.801941+0000","last_clean":"2024-09-15T12:34:41.801941+0000","last_became_active":"2024-09-15T12:31:58.516700+0000","last_became_peered":"2024-09-15T12:31:58.516700+0000","last_unstale":"2024-09-15T12:34:41.801941+0000","last_undegraded":"2024-09-15T12:34:41.801941+0000","last_fullsized":"2024-09-15T12:34:41.801941+0000","mapping_epoch":94,"log_start":"0'0","ondisk_log_start":"0'0","created":94,"last_epoch_clean":95,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:31:57.333072+0000","last_clean_scrub_stamp":"2024-09-15T12:31:57.333072+0000","objects_scrubbed":0,"log_size":1751,"log_dups_size":0,"ondisk_log_size":1751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11468800,"num_objects":175,"num_object_clones":0,"num_object_copies":525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1751,"num_write_kb":61632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.415946+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:34:32.415946+0000","last_peered":"2024-09-15T12:34:32.415946+0000","last_clean":"2024-09-15T12:34:32.415946+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:34:32.415946+0000","last_undegraded":"2024-09-15T12:34:32.415946+0000","last_fullsized":"2024-09-15T12:34:32.415946+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":16,"stat_sum":{"num_bytes":198443032,"num_objects":3029,"num_object_clones":0,"num_object_copies":9087,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":28091,"num_write_kb":995777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":37425152,"data_stored":598605896,"data_compressed":28425008,"data_compressed_allocated":37412864,"data_compressed_original":598605824,"omap_allocated":0,"internal_metadata":0},"log_size":28091,"ondisk_log_size":28091,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68532,"kb_used_data":11940,"kb_used_omap":0,"kb_used_meta":56576,"kb_avail":94303308,"statfs":{"total":96636764160,"available":96566587392,"internally_reserved":0,"allocated":12226560,"data_stored":187814040,"data_compressed":8911680,"data_compressed_allocated":11730944,"data_compressed_original":187613184,"omap_allocated":0,"internal_metadata":57933824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706621,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51276,"kb_used_data":7996,"kb_used_omap":0,"kb_used_meta":43264,"kb_avail":94320564,"statfs":{"total":96636764160,"available":96584257536,"internally_reserved":0,"allocated":8187904,"data_stored":123130027,"data_compressed":5840136,"data_compressed_allocated":7688192,"data_compressed_original":122929152,"omap_allocated":0,"internal_metadata":44302336},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706621,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54080,"kb_used_data":11120,"kb_used_omap":0,"kb_used_meta":42944,"kb_avail":94317760,"statfs":{"total":96636764160,"available":96581386240,"internally_reserved":0,"allocated":11386880,"data_stored":174706315,"data_compressed":8287256,"data_compressed_allocated":10907648,"data_compressed_original":174522368,"omap_allocated":0,"internal_metadata":43974656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706621,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47600,"kb_used_data":9184,"kb_used_omap":0,"kb_used_meta":38400,"kb_avail":94324240,"statfs":{"total":96636764160,"available":96588021760,"internally_reserved":0,"allocated":9404416,"data_stored":142659731,"data_compressed":6767512,"data_compressed_allocated":8908800,"data_compressed_original":142458880,"omap_allocated":0,"internal_metadata":39321600},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8503296,"data_stored":136052736,"data_compressed":6460512,"data_compressed_allocated":8503296,"data_compressed_original":136052736,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":10387456,"data_stored":166133784,"data_compressed":7888920,"data_compressed_allocated":10383360,"data_compressed_original":166133760,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7311360,"data_stored":116916248,"data_compressed":5551808,"data_compressed_allocated":7307264,"data_compressed_original":116916224,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11223040,"data_stored":179503128,"data_compressed":8523768,"data_compressed_allocated":11218944,"data_compressed_original":179503104,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:34:51.192 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:34:51.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:51.327+0000 7f93cdb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:51.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:51.336+0000 7f93cdb91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:53.744 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:34:53.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:53.892+0000 7fced2751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:53.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:53.899+0000 7fced2751640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:55.806 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:34:55.807 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:34:55.807 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:34:55.807 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:34:55.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:55.945+0000 7ff515b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:55.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:55.956+0000 7ff515b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:55.978 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:34:55.978 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:34:55.978 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:34:55.978 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:34:55.978 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:34:55.978 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:34:55.978 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:34:55.978 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:34:55.978 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:34:55.978 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:34:55.978 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:34:55.978 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:34:55.982 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:34:55.982 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:34:55.983 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:34:56.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:56.125+0000 7f6e7f8a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:56.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:56.135+0000 7f6e7f8a3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:56.157 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:34:56.157 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:34:56.157 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:34:56.157 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:34:56.157 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:34:56.157 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:34:56.157 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:34:56.157 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:34:56.157 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:34:56.157 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:34:56.157 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:34:56.157 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:34:56.161 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:34:56.162 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:34:56.162 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:34:56.257 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:34:56.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:56.317+0000 7f921f67d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:56.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:56.331+0000 7f921f67d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:56.363 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:34:56.364 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:34:56.364 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:34:56.364 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:34:56.364 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:34:56.364 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:34:56.364 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:34:56.364 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:34:56.364 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:34:56.364 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:34:56.364 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:34:56.364 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:34:56.370 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:34:56.371 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:34:56.371 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:34:56.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:56.417+0000 7f0e3bd91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:56.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:56.426+0000 7f0e3ab2f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:56.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:56.524+0000 7fe3758c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:56.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:56.536+0000 7fe3758c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:56.573 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:34:56.573 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:34:56.573 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:34:56.573 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:34:56.574 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:34:56.574 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:34:56.574 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:34:56.574 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:34:56.574 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:34:56.574 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:34:56.574 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:34:56.574 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:34:56.577 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:34:56.577 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:34:58.869 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-15T12:34:59.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:59.019+0000 7ff869111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:34:59.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:34:59.026+0000 7ff869111640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:00.165 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Removed 15559 objects 2024-09-15T12:35:00.165 INFO:tasks.radosbench.radosbench.0.smithi077.stdout:Clean up completed and total clean up time :89.6886 2024-09-15T12:35:01.334 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-15T12:35:01.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:01.446+0000 7f4a45151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:01.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:01.451+0000 7f4a45151640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:01.578 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-15T12:35:01.579 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-15T12:35:01.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:01.682+0000 7fc5c0391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:01.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:01.692+0000 7fc5c0391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:02.351 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.0 to 1 (10000) 2024-09-15T12:35:02.374 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-15T12:35:02.412 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_4 2024-09-15T12:35:02.412 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_4 unique_pool_4 --yes-i-really-really-mean-it 2024-09-15T12:35:02.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:02.481+0000 7efbfdf11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:02.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:02.495+0000 7efbfdf11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:02.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:02.531+0000 7f2a442bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:02.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:02.547+0000 7f2a442bd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:03.351 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.1 to 1 (10000) 2024-09-15T12:35:03.352 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'unique_pool_4' removed 2024-09-15T12:35:03.371 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-15T12:35:03.382 INFO:tasks.thrashosds:joining thrashosds 2024-09-15T12:35:03.383 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-15T12:35:03.570 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:03.561+0000 7f5368b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:03.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:03.573+0000 7f5368b51640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:04.360 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.2 to 1 (10000) 2024-09-15T12:35:04.376 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-15T12:35:04.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:04.483+0000 7f5bdcaa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:04.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:04.493+0000 7f5bdcaa3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:05.361 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.3 to 1 (10000) 2024-09-15T12:35:05.381 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-15T12:35:05.382 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:35:05.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:05.486+0000 7fccd7a6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:05.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:05.494+0000 7fccd7a6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:05.679 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:35:05.680 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:35:05.692 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":592,"stamp":"2024-09-15T12:35:05.361336+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":221488,"kb_used_data":40240,"kb_used_omap":0,"kb_used_meta":181184,"kb_avail":377265872,"statfs":{"total":386547056640,"available":386320252928,"internally_reserved":0,"allocated":41205760,"data_stored":628310113,"data_compressed":29806584,"data_compressed_allocated":39235584,"data_compressed_original":627523584,"omap_allocated":0,"internal_metadata":185532416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-198443032,"num_objects":-3029,"num_object_clones":0,"num_object_copies":-9087,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-28091,"num_write_kb":-995777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.465181"},"pg_stats":[{"pgid":"1.0","version":"11'52","reported_seq":343,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.424663+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:34:32.424663+0000","last_peered":"2024-09-15T12:34:32.424663+0000","last_clean":"2024-09-15T12:34:32.424663+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:34:32.424663+0000","last_undegraded":"2024-09-15T12:34:32.424663+0000","last_fullsized":"2024-09-15T12:34:32.424663+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":272,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.424426+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:34:32.424426+0000","last_peered":"2024-09-15T12:34:32.424426+0000","last_clean":"2024-09-15T12:34:32.424426+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:34:32.424426+0000","last_undegraded":"2024-09-15T12:34:32.424426+0000","last_fullsized":"2024-09-15T12:34:32.424426+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.430074+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:34:32.430074+0000","last_peered":"2024-09-15T12:34:32.430074+0000","last_clean":"2024-09-15T12:34:32.430074+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:34:32.430074+0000","last_undegraded":"2024-09-15T12:34:32.430074+0000","last_fullsized":"2024-09-15T12:34:32.430074+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.408569+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:34:32.408569+0000","last_peered":"2024-09-15T12:34:32.408569+0000","last_clean":"2024-09-15T12:34:32.408569+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:34:32.408569+0000","last_undegraded":"2024-09-15T12:34:32.408569+0000","last_fullsized":"2024-09-15T12:34:32.408569+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":273,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.417298+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:34:32.417298+0000","last_peered":"2024-09-15T12:34:32.417298+0000","last_clean":"2024-09-15T12:34:32.417298+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:34:32.417298+0000","last_undegraded":"2024-09-15T12:34:32.417298+0000","last_fullsized":"2024-09-15T12:34:32.417298+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.393227+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:34:32.393227+0000","last_peered":"2024-09-15T12:34:32.393227+0000","last_clean":"2024-09-15T12:34:32.393227+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:34:32.393227+0000","last_undegraded":"2024-09-15T12:34:32.393227+0000","last_fullsized":"2024-09-15T12:34:32.393227+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.443677+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:34:32.443677+0000","last_peered":"2024-09-15T12:34:32.443677+0000","last_clean":"2024-09-15T12:34:32.443677+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:34:32.443677+0000","last_undegraded":"2024-09-15T12:34:32.443677+0000","last_fullsized":"2024-09-15T12:34:32.443677+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.388876+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:34:32.388876+0000","last_peered":"2024-09-15T12:34:32.388876+0000","last_clean":"2024-09-15T12:34:32.388876+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:34:32.388876+0000","last_undegraded":"2024-09-15T12:34:32.388876+0000","last_fullsized":"2024-09-15T12:34:32.388876+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.415946+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:34:32.415946+0000","last_peered":"2024-09-15T12:34:32.415946+0000","last_clean":"2024-09-15T12:34:32.415946+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:34:32.415946+0000","last_undegraded":"2024-09-15T12:34:32.415946+0000","last_fullsized":"2024-09-15T12:34:32.415946+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68532,"kb_used_data":11940,"kb_used_omap":0,"kb_used_meta":56576,"kb_avail":94303308,"statfs":{"total":96636764160,"available":96566587392,"internally_reserved":0,"allocated":12226560,"data_stored":187814040,"data_compressed":8911680,"data_compressed_allocated":11730944,"data_compressed_original":187613184,"omap_allocated":0,"internal_metadata":57933824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706621,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51276,"kb_used_data":7996,"kb_used_omap":0,"kb_used_meta":43264,"kb_avail":94320564,"statfs":{"total":96636764160,"available":96584257536,"internally_reserved":0,"allocated":8187904,"data_stored":123130027,"data_compressed":5840136,"data_compressed_allocated":7688192,"data_compressed_original":122929152,"omap_allocated":0,"internal_metadata":44302336},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706621,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54080,"kb_used_data":11120,"kb_used_omap":0,"kb_used_meta":42944,"kb_avail":94317760,"statfs":{"total":96636764160,"available":96581386240,"internally_reserved":0,"allocated":11386880,"data_stored":174706315,"data_compressed":8287256,"data_compressed_allocated":10907648,"data_compressed_original":174522368,"omap_allocated":0,"internal_metadata":43974656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706621,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47600,"kb_used_data":9184,"kb_used_omap":0,"kb_used_meta":38400,"kb_avail":94324240,"statfs":{"total":96636764160,"available":96588021760,"internally_reserved":0,"allocated":9404416,"data_stored":142659731,"data_compressed":6767512,"data_compressed_allocated":8908800,"data_compressed_original":142458880,"omap_allocated":0,"internal_metadata":39321600},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:35:05.692 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:35:05.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:05.794+0000 7f5d72f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:05.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:05.801+0000 7f5d72f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:05.987 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:35:05.987 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:35:06.000 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":593,"stamp":"2024-09-15T12:35:05.897360+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":221488,"kb_used_data":40240,"kb_used_omap":0,"kb_used_meta":181184,"kb_avail":377265872,"statfs":{"total":386547056640,"available":386320252928,"internally_reserved":0,"allocated":41205760,"data_stored":628310113,"data_compressed":29806584,"data_compressed_allocated":39235584,"data_compressed_original":627523584,"omap_allocated":0,"internal_metadata":185532416},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-198443032,"num_objects":-3029,"num_object_clones":0,"num_object_copies":-9087,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-28091,"num_write_kb":-995777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000820"},"pg_stats":[{"pgid":"1.0","version":"11'52","reported_seq":343,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.424663+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:34:32.424663+0000","last_peered":"2024-09-15T12:34:32.424663+0000","last_clean":"2024-09-15T12:34:32.424663+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:34:32.424663+0000","last_undegraded":"2024-09-15T12:34:32.424663+0000","last_fullsized":"2024-09-15T12:34:32.424663+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":272,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.424426+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:34:32.424426+0000","last_peered":"2024-09-15T12:34:32.424426+0000","last_clean":"2024-09-15T12:34:32.424426+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:34:32.424426+0000","last_undegraded":"2024-09-15T12:34:32.424426+0000","last_fullsized":"2024-09-15T12:34:32.424426+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.430074+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:34:32.430074+0000","last_peered":"2024-09-15T12:34:32.430074+0000","last_clean":"2024-09-15T12:34:32.430074+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:34:32.430074+0000","last_undegraded":"2024-09-15T12:34:32.430074+0000","last_fullsized":"2024-09-15T12:34:32.430074+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.408569+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:34:32.408569+0000","last_peered":"2024-09-15T12:34:32.408569+0000","last_clean":"2024-09-15T12:34:32.408569+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:34:32.408569+0000","last_undegraded":"2024-09-15T12:34:32.408569+0000","last_fullsized":"2024-09-15T12:34:32.408569+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":273,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.417298+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:34:32.417298+0000","last_peered":"2024-09-15T12:34:32.417298+0000","last_clean":"2024-09-15T12:34:32.417298+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:34:32.417298+0000","last_undegraded":"2024-09-15T12:34:32.417298+0000","last_fullsized":"2024-09-15T12:34:32.417298+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.393227+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:34:32.393227+0000","last_peered":"2024-09-15T12:34:32.393227+0000","last_clean":"2024-09-15T12:34:32.393227+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:34:32.393227+0000","last_undegraded":"2024-09-15T12:34:32.393227+0000","last_fullsized":"2024-09-15T12:34:32.393227+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.443677+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:34:32.443677+0000","last_peered":"2024-09-15T12:34:32.443677+0000","last_clean":"2024-09-15T12:34:32.443677+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:34:32.443677+0000","last_undegraded":"2024-09-15T12:34:32.443677+0000","last_fullsized":"2024-09-15T12:34:32.443677+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.388876+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:34:32.388876+0000","last_peered":"2024-09-15T12:34:32.388876+0000","last_clean":"2024-09-15T12:34:32.388876+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:34:32.388876+0000","last_undegraded":"2024-09-15T12:34:32.388876+0000","last_fullsized":"2024-09-15T12:34:32.388876+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":271,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-15T12:34:32.415946+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:34:32.415946+0000","last_peered":"2024-09-15T12:34:32.415946+0000","last_clean":"2024-09-15T12:34:32.415946+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:34:32.415946+0000","last_undegraded":"2024-09-15T12:34:32.415946+0000","last_fullsized":"2024-09-15T12:34:32.415946+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":68532,"kb_used_data":11940,"kb_used_omap":0,"kb_used_meta":56576,"kb_avail":94303308,"statfs":{"total":96636764160,"available":96566587392,"internally_reserved":0,"allocated":12226560,"data_stored":187814040,"data_compressed":8911680,"data_compressed_allocated":11730944,"data_compressed_original":187613184,"omap_allocated":0,"internal_metadata":57933824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706621,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":51276,"kb_used_data":7996,"kb_used_omap":0,"kb_used_meta":43264,"kb_avail":94320564,"statfs":{"total":96636764160,"available":96584257536,"internally_reserved":0,"allocated":8187904,"data_stored":123130027,"data_compressed":5840136,"data_compressed_allocated":7688192,"data_compressed_original":122929152,"omap_allocated":0,"internal_metadata":44302336},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706621,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54080,"kb_used_data":11120,"kb_used_omap":0,"kb_used_meta":42944,"kb_avail":94317760,"statfs":{"total":96636764160,"available":96581386240,"internally_reserved":0,"allocated":11386880,"data_stored":174706315,"data_compressed":8287256,"data_compressed_allocated":10907648,"data_compressed_original":174522368,"omap_allocated":0,"internal_metadata":43974656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706621,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47600,"kb_used_data":9184,"kb_used_omap":0,"kb_used_meta":38400,"kb_avail":94324240,"statfs":{"total":96636764160,"available":96588021760,"internally_reserved":0,"allocated":9404416,"data_stored":142659731,"data_compressed":6767512,"data_compressed_allocated":8908800,"data_compressed_original":142458880,"omap_allocated":0,"internal_metadata":39321600},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:35:06.001 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-15T12:35:06.001 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-15T12:35:06.002 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-15T12:35:06.002 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-15T12:35:06.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:06.103+0000 7f98f709c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:06.114 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:06.112+0000 7f98f709c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:06.130 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:35:06.130 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:35:06.131 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:35:06.131 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:35:06.131 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:35:06.131 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:35:06.131 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:35:06.131 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:35:06.131 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:35:06.131 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:35:06.131 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:35:06.131 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:35:06.134 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:35:06.134 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:35:06.134 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-15T12:35:06.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:06.235+0000 7fea12a74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:06.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:06.244+0000 7fea12a74640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:06.261 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:35:06.261 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:35:06.261 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:35:06.261 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:35:06.261 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:35:06.261 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:35:06.261 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:35:06.261 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:35:06.261 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:35:06.261 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:35:06.261 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:35:06.261 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:35:06.264 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:35:06.264 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:35:06.265 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-15T12:35:06.374 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:06.367+0000 7f9d6e791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:06.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:06.376+0000 7f9d6e791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:06.396 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:35:06.396 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:35:06.396 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:35:06.396 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:35:06.396 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:35:06.396 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:35:06.396 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:35:06.396 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:35:06.396 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:35:06.396 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:35:06.396 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:35:06.397 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:35:06.399 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:35:06.399 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:35:06.400 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-15T12:35:06.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:06.501+0000 7f536c791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:06.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:06.510+0000 7f536c791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:06.527 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-09-15T12:35:06.527 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-09-15T12:35:06.527 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-09-15T12:35:06.527 INFO:teuthology.orchestra.run.smithi077.stderr:config help 2024-09-15T12:35:06.527 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-09-15T12:35:06.527 INFO:teuthology.orchestra.run.smithi077.stderr:config show 2024-09-15T12:35:06.528 INFO:teuthology.orchestra.run.smithi077.stderr:deep_scrub 2024-09-15T12:35:06.528 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_ops 2024-09-15T12:35:06.528 INFO:teuthology.orchestra.run.smithi077.stderr:dump_historic_slow_ops 2024-09-15T12:35:06.528 INFO:teuthology.orchestra.run.smithi077.stderr:dump_metrics [] 2024-09-15T12:35:06.528 INFO:teuthology.orchestra.run.smithi077.stderr:dump_ops_in_flight 2024-09-15T12:35:06.528 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-09-15T12:35:06.530 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-15T12:35:06.531 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-15T12:35:11.532 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-15T12:35:11.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:11.648+0000 7f1d6ece3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:11.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:11.654+0000 7f1d6ece3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:11.670 INFO:teuthology.orchestra.run.smithi077.stdout:{} 2024-09-15T12:35:11.670 INFO:teuthology.orchestra.run.smithi077.stderr:mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-15T12:35:11.682 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-15T12:35:11.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:11.783+0000 7f73454c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:11.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:11.793+0000 7f73454c8640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:12.351 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.0 to 1 (10000) 2024-09-15T12:35:12.375 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-15T12:35:12.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:12.478+0000 7f14d4b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:12.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:12.488+0000 7f14d4b91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:13.352 INFO:teuthology.orchestra.run.smithi077.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-15T12:35:13.373 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-15T12:35:13.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:13.477+0000 7f15e4cb4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:13.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:13.487+0000 7f15e4cb4640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:14.361 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.1 to 1 (10000) 2024-09-15T12:35:14.380 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-15T12:35:14.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:14.483+0000 7f0fbdea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:14.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:14.493+0000 7f0fbdea3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:15.361 INFO:teuthology.orchestra.run.smithi077.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-15T12:35:15.386 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-15T12:35:15.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:15.490+0000 7f45fab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:15.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:15.499+0000 7f45fab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:16.368 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.2 to 1 (10000) 2024-09-15T12:35:16.390 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-15T12:35:16.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:16.494+0000 7fbf220d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:16.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:16.505+0000 7fbf220d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:17.375 INFO:teuthology.orchestra.run.smithi077.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-15T12:35:17.396 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-15T12:35:17.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:17.498+0000 7fa450f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:17.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:17.507+0000 7fa450f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:18.382 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.3 to 1 (10000) 2024-09-15T12:35:18.403 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-15T12:35:18.514 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:18.506+0000 7fc30be4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:18.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:18.517+0000 7fc30be4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:19.384 INFO:teuthology.orchestra.run.smithi077.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-15T12:35:19.408 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-15T12:35:19.408 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-15T12:35:19.409 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T12:35:19.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:19.517+0000 7f3151791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:19.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:19.525+0000 7f3151791640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:19.717 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:35:19.717 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":116,"fsid":"0010d80b-83bc-42b2-8185-928cfe1dc364","created":"2024-09-15T12:18:33.201019+0000","modified":"2024-09-15T12:35:19.381801+0000","last_up_change":"2024-09-15T12:18:41.719581+0000","last_in_change":"2024-09-15T12:18:35.315168+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T12:18:41.719481+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-15T12:18:43.510888+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5c8d66b-d3a4-47b4-ba1f-789441932c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2693145533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6801","nonce":2693145533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2693145533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6805","nonce":2693145533}]},"public_addr":"172.21.15.77:6800/2693145533","cluster_addr":"172.21.15.77:6801/2693145533","heartbeat_back_addr":"172.21.15.77:6802/2693145533","heartbeat_front_addr":"172.21.15.77:6805/2693145533","state":["exists","up"]},{"osd":1,"uuid":"349261f9-8426-4182-9f6d-19d1d4d00cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2237638298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6803","nonce":2237638298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2237638298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6807","nonce":2237638298}]},"public_addr":"172.21.15.77:6804/2237638298","cluster_addr":"172.21.15.77:6803/2237638298","heartbeat_back_addr":"172.21.15.77:6806/2237638298","heartbeat_front_addr":"172.21.15.77:6807/2237638298","state":["exists","up"]},{"osd":2,"uuid":"83bafe3c-2087-47d8-a2a1-1d5a1ec34144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":2379501345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":2379501345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6805","nonce":2379501345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":2379501345}]},"public_addr":"172.21.15.138:6804/2379501345","cluster_addr":"172.21.15.138:6803/2379501345","heartbeat_back_addr":"172.21.15.138:6805/2379501345","heartbeat_front_addr":"172.21.15.138:6802/2379501345","state":["exists","up"]},{"osd":3,"uuid":"3ec80261-3fac-47d0-a7e5-b49f4289dee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":364329868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":364329868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":364329868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":364329868}]},"public_addr":"172.21.15.138:6810/364329868","cluster_addr":"172.21.15.138:6811/364329868","heartbeat_back_addr":"172.21.15.138:6813/364329868","heartbeat_front_addr":"172.21.15.138:6814/364329868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T12:35:19.731 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-15T12:35:19.731 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T12:35:19.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:19.833+0000 7fa03e4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:19.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:19.841+0000 7fa03e4d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:20.029 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:35:20.030 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":116,"fsid":"0010d80b-83bc-42b2-8185-928cfe1dc364","created":"2024-09-15T12:18:33.201019+0000","modified":"2024-09-15T12:35:19.381801+0000","last_up_change":"2024-09-15T12:18:41.719581+0000","last_in_change":"2024-09-15T12:18:35.315168+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T12:18:41.719481+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-15T12:18:43.510888+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5c8d66b-d3a4-47b4-ba1f-789441932c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2693145533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6801","nonce":2693145533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2693145533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6805","nonce":2693145533}]},"public_addr":"172.21.15.77:6800/2693145533","cluster_addr":"172.21.15.77:6801/2693145533","heartbeat_back_addr":"172.21.15.77:6802/2693145533","heartbeat_front_addr":"172.21.15.77:6805/2693145533","state":["exists","up"]},{"osd":1,"uuid":"349261f9-8426-4182-9f6d-19d1d4d00cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2237638298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6803","nonce":2237638298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2237638298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6807","nonce":2237638298}]},"public_addr":"172.21.15.77:6804/2237638298","cluster_addr":"172.21.15.77:6803/2237638298","heartbeat_back_addr":"172.21.15.77:6806/2237638298","heartbeat_front_addr":"172.21.15.77:6807/2237638298","state":["exists","up"]},{"osd":2,"uuid":"83bafe3c-2087-47d8-a2a1-1d5a1ec34144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":2379501345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":2379501345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6805","nonce":2379501345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":2379501345}]},"public_addr":"172.21.15.138:6804/2379501345","cluster_addr":"172.21.15.138:6803/2379501345","heartbeat_back_addr":"172.21.15.138:6805/2379501345","heartbeat_front_addr":"172.21.15.138:6802/2379501345","state":["exists","up"]},{"osd":3,"uuid":"3ec80261-3fac-47d0-a7e5-b49f4289dee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":364329868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":364329868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":364329868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":364329868}]},"public_addr":"172.21.15.138:6810/364329868","cluster_addr":"172.21.15.138:6811/364329868","heartbeat_back_addr":"172.21.15.138:6813/364329868","heartbeat_front_addr":"172.21.15.138:6814/364329868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T12:35:20.043 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-15T12:35:20.044 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-15T12:35:20.044 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-15T12:35:20.044 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-15T12:35:20.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:20.156+0000 7f3aee711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:20.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:20.156+0000 7f06a2991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:20.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:20.156+0000 7fc379d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:20.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:20.156+0000 7f1e93057640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:20.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:20.166+0000 7f06a2991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:20.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:20.166+0000 7f3aee711640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:20.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:20.166+0000 7fc379d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:20.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:20.167+0000 7f1e93057640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:20.202 INFO:teuthology.orchestra.run.smithi077.stdout:38654706661 2024-09-15T12:35:20.203 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-15T12:35:20.203 INFO:teuthology.orchestra.run.smithi077.stdout:38654706661 2024-09-15T12:35:20.204 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-15T12:35:20.205 INFO:teuthology.orchestra.run.smithi077.stdout:42949673956 2024-09-15T12:35:20.206 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-15T12:35:20.207 INFO:teuthology.orchestra.run.smithi077.stdout:38654706661 2024-09-15T12:35:20.207 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-15T12:35:20.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:20.310+0000 7fa77ff91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:20.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:20.323+0000 7fa77ff91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:20.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:20.356+0000 7f1b98f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:20.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:20.356+0000 7f95c3f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:20.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:20.360+0000 7f146d991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:20.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:20.366+0000 7f1b98f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:20.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:20.366+0000 7f95c3f91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:20.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:20.371+0000 7f146d991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:20.544 INFO:teuthology.orchestra.run.smithi077.stdout:38654706651 2024-09-15T12:35:20.557 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706661 got 38654706651 for osd.1 2024-09-15T12:35:20.574 INFO:teuthology.orchestra.run.smithi077.stdout:38654706651 2024-09-15T12:35:20.578 INFO:teuthology.orchestra.run.smithi077.stdout:42949673947 2024-09-15T12:35:20.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706661 got 38654706651 for osd.2 2024-09-15T12:35:20.591 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673956 got 42949673947 for osd.3 2024-09-15T12:35:20.597 INFO:teuthology.orchestra.run.smithi077.stdout:38654706651 2024-09-15T12:35:20.610 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706661 got 38654706651 for osd.0 2024-09-15T12:35:21.558 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-15T12:35:21.591 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-15T12:35:21.593 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-15T12:35:21.611 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-15T12:35:21.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:21.676+0000 7f4357391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:21.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:21.689+0000 7f4357391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:21.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:21.717+0000 7f614c6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:21.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:21.717+0000 7f758df11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:21.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:21.729+0000 7f614c6d1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:21.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:21.729+0000 7f758df11640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:21.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:21.759+0000 7fe3c9a6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:21.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:21.769+0000 7fe3c9a6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:21.913 INFO:teuthology.orchestra.run.smithi077.stdout:38654706651 2024-09-15T12:35:21.928 INFO:teuthology.orchestra.run.smithi077.stdout:38654706651 2024-09-15T12:35:21.931 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706661 got 38654706651 for osd.1 2024-09-15T12:35:21.941 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706661 got 38654706651 for osd.2 2024-09-15T12:35:21.948 INFO:teuthology.orchestra.run.smithi077.stdout:42949673947 2024-09-15T12:35:21.962 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673956 got 42949673947 for osd.3 2024-09-15T12:35:21.978 INFO:teuthology.orchestra.run.smithi077.stdout:38654706651 2024-09-15T12:35:21.991 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706661 got 38654706651 for osd.0 2024-09-15T12:35:22.932 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-15T12:35:22.942 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-15T12:35:22.962 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-15T12:35:22.992 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-15T12:35:23.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:23.039+0000 7f485ab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:23.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:23.051+0000 7f485ab91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:23.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:23.082+0000 7f5baecd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:23.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:23.083+0000 7efe4a697640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:23.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:23.092+0000 7f5baecd1640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:23.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:23.092+0000 7efe4a697640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:23.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:23.139+0000 7f19cf311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:23.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:23.149+0000 7f19cf311640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:23.258 INFO:teuthology.orchestra.run.smithi077.stdout:38654706661 2024-09-15T12:35:23.272 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706661 got 38654706661 for osd.1 2024-09-15T12:35:23.272 DEBUG:teuthology.parallel:result is None 2024-09-15T12:35:23.300 INFO:teuthology.orchestra.run.smithi077.stdout:38654706661 2024-09-15T12:35:23.318 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706661 got 38654706661 for osd.2 2024-09-15T12:35:23.318 DEBUG:teuthology.parallel:result is None 2024-09-15T12:35:23.334 INFO:teuthology.orchestra.run.smithi077.stdout:42949673956 2024-09-15T12:35:23.348 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673956 got 42949673956 for osd.3 2024-09-15T12:35:23.348 DEBUG:teuthology.parallel:result is None 2024-09-15T12:35:23.391 INFO:teuthology.orchestra.run.smithi077.stdout:38654706661 2024-09-15T12:35:23.405 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706661 got 38654706661 for osd.0 2024-09-15T12:35:23.405 DEBUG:teuthology.parallel:result is None 2024-09-15T12:35:23.405 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-15T12:35:23.405 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:35:23.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:23.506+0000 7f1ea88fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:23.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:23.513+0000 7f1ea88fd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:23.700 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:35:23.701 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:35:23.714 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":609,"stamp":"2024-09-15T12:35:21.901389+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":162624,"kb_used_data":2176,"kb_used_omap":0,"kb_used_meta":160384,"kb_avail":377324736,"statfs":{"total":386547056640,"available":386380529664,"internally_reserved":0,"allocated":2228224,"data_stored":2543657,"data_compressed":90096,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":164233216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.533613"},"pg_stats":[{"pgid":"1.0","version":"11'52","reported_seq":391,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.395277+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:35:19.395277+0000","last_peered":"2024-09-15T12:35:19.395277+0000","last_clean":"2024-09-15T12:35:19.395277+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:35:19.395277+0000","last_undegraded":"2024-09-15T12:35:19.395277+0000","last_fullsized":"2024-09-15T12:35:19.395277+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":320,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.398383+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:35:19.398383+0000","last_peered":"2024-09-15T12:35:19.398383+0000","last_clean":"2024-09-15T12:35:19.398383+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:35:19.398383+0000","last_undegraded":"2024-09-15T12:35:19.398383+0000","last_fullsized":"2024-09-15T12:35:19.398383+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.399684+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:35:19.399684+0000","last_peered":"2024-09-15T12:35:19.399684+0000","last_clean":"2024-09-15T12:35:19.399684+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:35:19.399684+0000","last_undegraded":"2024-09-15T12:35:19.399684+0000","last_fullsized":"2024-09-15T12:35:19.399684+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.395315+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:35:19.395315+0000","last_peered":"2024-09-15T12:35:19.395315+0000","last_clean":"2024-09-15T12:35:19.395315+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:35:19.395315+0000","last_undegraded":"2024-09-15T12:35:19.395315+0000","last_fullsized":"2024-09-15T12:35:19.395315+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":321,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.395764+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:35:19.395764+0000","last_peered":"2024-09-15T12:35:19.395764+0000","last_clean":"2024-09-15T12:35:19.395764+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:35:19.395764+0000","last_undegraded":"2024-09-15T12:35:19.395764+0000","last_fullsized":"2024-09-15T12:35:19.395764+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.398367+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:35:19.398367+0000","last_peered":"2024-09-15T12:35:19.398367+0000","last_clean":"2024-09-15T12:35:19.398367+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:35:19.398367+0000","last_undegraded":"2024-09-15T12:35:19.398367+0000","last_fullsized":"2024-09-15T12:35:19.398367+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.397594+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:35:19.397594+0000","last_peered":"2024-09-15T12:35:19.397594+0000","last_clean":"2024-09-15T12:35:19.397594+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:35:19.397594+0000","last_undegraded":"2024-09-15T12:35:19.397594+0000","last_fullsized":"2024-09-15T12:35:19.397594+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.397246+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:35:19.397246+0000","last_peered":"2024-09-15T12:35:19.397246+0000","last_clean":"2024-09-15T12:35:19.397246+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:35:19.397246+0000","last_undegraded":"2024-09-15T12:35:19.397246+0000","last_fullsized":"2024-09-15T12:35:19.397246+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.397784+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:35:19.397784+0000","last_peered":"2024-09-15T12:35:19.397784+0000","last_clean":"2024-09-15T12:35:19.397784+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:35:19.397784+0000","last_undegraded":"2024-09-15T12:35:19.397784+0000","last_fullsized":"2024-09-15T12:35:19.397784+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673956,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52988,"kb_used_data":556,"kb_used_omap":0,"kb_used_meta":52416,"kb_avail":94318852,"statfs":{"total":96636764160,"available":96582504448,"internally_reserved":0,"allocated":569344,"data_stored":783492,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":53673984},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706661,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35520,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":34944,"kb_avail":94336320,"statfs":{"total":96636764160,"available":96600391680,"internally_reserved":0,"allocated":573440,"data_stored":783511,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":35782656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706661,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":39300,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":38784,"kb_avail":94332540,"statfs":{"total":96636764160,"available":96596520960,"internally_reserved":0,"allocated":512000,"data_stored":193143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":39714816},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706661,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":34816,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":34240,"kb_avail":94337024,"statfs":{"total":96636764160,"available":96601112576,"internally_reserved":0,"allocated":573440,"data_stored":783511,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":35061760},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:35:23.715 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:35:23.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:23.816+0000 7f61f2d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:23.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:23.823+0000 7f61f2d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:24.011 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:35:24.011 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:35:24.024 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":610,"stamp":"2024-09-15T12:35:23.901839+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":162624,"kb_used_data":2176,"kb_used_omap":0,"kb_used_meta":160384,"kb_avail":377324736,"statfs":{"total":386547056640,"available":386380529664,"internally_reserved":0,"allocated":2228224,"data_stored":2543657,"data_compressed":90096,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":164233216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.527176"},"pg_stats":[{"pgid":"1.0","version":"11'52","reported_seq":391,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.395277+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:35:19.395277+0000","last_peered":"2024-09-15T12:35:19.395277+0000","last_clean":"2024-09-15T12:35:19.395277+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:35:19.395277+0000","last_undegraded":"2024-09-15T12:35:19.395277+0000","last_fullsized":"2024-09-15T12:35:19.395277+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":320,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.398383+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:35:19.398383+0000","last_peered":"2024-09-15T12:35:19.398383+0000","last_clean":"2024-09-15T12:35:19.398383+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:35:19.398383+0000","last_undegraded":"2024-09-15T12:35:19.398383+0000","last_fullsized":"2024-09-15T12:35:19.398383+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.399684+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:35:19.399684+0000","last_peered":"2024-09-15T12:35:19.399684+0000","last_clean":"2024-09-15T12:35:19.399684+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:35:19.399684+0000","last_undegraded":"2024-09-15T12:35:19.399684+0000","last_fullsized":"2024-09-15T12:35:19.399684+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.395315+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:35:19.395315+0000","last_peered":"2024-09-15T12:35:19.395315+0000","last_clean":"2024-09-15T12:35:19.395315+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:35:19.395315+0000","last_undegraded":"2024-09-15T12:35:19.395315+0000","last_fullsized":"2024-09-15T12:35:19.395315+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":321,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.395764+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:35:19.395764+0000","last_peered":"2024-09-15T12:35:19.395764+0000","last_clean":"2024-09-15T12:35:19.395764+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:35:19.395764+0000","last_undegraded":"2024-09-15T12:35:19.395764+0000","last_fullsized":"2024-09-15T12:35:19.395764+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.398367+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:35:19.398367+0000","last_peered":"2024-09-15T12:35:19.398367+0000","last_clean":"2024-09-15T12:35:19.398367+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:35:19.398367+0000","last_undegraded":"2024-09-15T12:35:19.398367+0000","last_fullsized":"2024-09-15T12:35:19.398367+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.397594+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:35:19.397594+0000","last_peered":"2024-09-15T12:35:19.397594+0000","last_clean":"2024-09-15T12:35:19.397594+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:35:19.397594+0000","last_undegraded":"2024-09-15T12:35:19.397594+0000","last_fullsized":"2024-09-15T12:35:19.397594+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.397246+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:35:19.397246+0000","last_peered":"2024-09-15T12:35:19.397246+0000","last_clean":"2024-09-15T12:35:19.397246+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:35:19.397246+0000","last_undegraded":"2024-09-15T12:35:19.397246+0000","last_fullsized":"2024-09-15T12:35:19.397246+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.397784+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:35:19.397784+0000","last_peered":"2024-09-15T12:35:19.397784+0000","last_clean":"2024-09-15T12:35:19.397784+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:35:19.397784+0000","last_undegraded":"2024-09-15T12:35:19.397784+0000","last_fullsized":"2024-09-15T12:35:19.397784+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673956,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52988,"kb_used_data":556,"kb_used_omap":0,"kb_used_meta":52416,"kb_avail":94318852,"statfs":{"total":96636764160,"available":96582504448,"internally_reserved":0,"allocated":569344,"data_stored":783492,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":53673984},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706661,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35520,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":34944,"kb_avail":94336320,"statfs":{"total":96636764160,"available":96600391680,"internally_reserved":0,"allocated":573440,"data_stored":783511,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":35782656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706661,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":39300,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":38784,"kb_avail":94332540,"statfs":{"total":96636764160,"available":96596520960,"internally_reserved":0,"allocated":512000,"data_stored":193143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":39714816},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706661,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":34816,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":34240,"kb_avail":94337024,"statfs":{"total":96636764160,"available":96601112576,"internally_reserved":0,"allocated":573440,"data_stored":783511,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":35061760},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:35:24.024 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-15T12:35:24.025 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-15T12:35:24.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:24.128+0000 7fa418abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:24.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:24.137+0000 7fa418abd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:24.345 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-15T12:35:24.355 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T12:35:24.355 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:35:24.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:24.457+0000 7faaf6551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:24.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:24.464+0000 7faaf6551640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:24.650 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:35:24.650 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:35:24.663 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":610,"stamp":"2024-09-15T12:35:23.901839+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":162624,"kb_used_data":2176,"kb_used_omap":0,"kb_used_meta":160384,"kb_avail":377324736,"statfs":{"total":386547056640,"available":386380529664,"internally_reserved":0,"allocated":2228224,"data_stored":2543657,"data_compressed":90096,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":164233216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.527176"},"pg_stats":[{"pgid":"1.0","version":"11'52","reported_seq":391,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.395277+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:35:19.395277+0000","last_peered":"2024-09-15T12:35:19.395277+0000","last_clean":"2024-09-15T12:35:19.395277+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:35:19.395277+0000","last_undegraded":"2024-09-15T12:35:19.395277+0000","last_fullsized":"2024-09-15T12:35:19.395277+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":320,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.398383+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:35:19.398383+0000","last_peered":"2024-09-15T12:35:19.398383+0000","last_clean":"2024-09-15T12:35:19.398383+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:35:19.398383+0000","last_undegraded":"2024-09-15T12:35:19.398383+0000","last_fullsized":"2024-09-15T12:35:19.398383+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.399684+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:35:19.399684+0000","last_peered":"2024-09-15T12:35:19.399684+0000","last_clean":"2024-09-15T12:35:19.399684+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:35:19.399684+0000","last_undegraded":"2024-09-15T12:35:19.399684+0000","last_fullsized":"2024-09-15T12:35:19.399684+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.395315+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:35:19.395315+0000","last_peered":"2024-09-15T12:35:19.395315+0000","last_clean":"2024-09-15T12:35:19.395315+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:35:19.395315+0000","last_undegraded":"2024-09-15T12:35:19.395315+0000","last_fullsized":"2024-09-15T12:35:19.395315+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":321,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.395764+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:35:19.395764+0000","last_peered":"2024-09-15T12:35:19.395764+0000","last_clean":"2024-09-15T12:35:19.395764+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:35:19.395764+0000","last_undegraded":"2024-09-15T12:35:19.395764+0000","last_fullsized":"2024-09-15T12:35:19.395764+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.398367+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:35:19.398367+0000","last_peered":"2024-09-15T12:35:19.398367+0000","last_clean":"2024-09-15T12:35:19.398367+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:35:19.398367+0000","last_undegraded":"2024-09-15T12:35:19.398367+0000","last_fullsized":"2024-09-15T12:35:19.398367+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.397594+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:35:19.397594+0000","last_peered":"2024-09-15T12:35:19.397594+0000","last_clean":"2024-09-15T12:35:19.397594+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:35:19.397594+0000","last_undegraded":"2024-09-15T12:35:19.397594+0000","last_fullsized":"2024-09-15T12:35:19.397594+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.397246+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:35:19.397246+0000","last_peered":"2024-09-15T12:35:19.397246+0000","last_clean":"2024-09-15T12:35:19.397246+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:35:19.397246+0000","last_undegraded":"2024-09-15T12:35:19.397246+0000","last_fullsized":"2024-09-15T12:35:19.397246+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.397784+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:35:19.397784+0000","last_peered":"2024-09-15T12:35:19.397784+0000","last_clean":"2024-09-15T12:35:19.397784+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:35:19.397784+0000","last_undegraded":"2024-09-15T12:35:19.397784+0000","last_fullsized":"2024-09-15T12:35:19.397784+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673956,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52988,"kb_used_data":556,"kb_used_omap":0,"kb_used_meta":52416,"kb_avail":94318852,"statfs":{"total":96636764160,"available":96582504448,"internally_reserved":0,"allocated":569344,"data_stored":783492,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":53673984},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706661,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35520,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":34944,"kb_avail":94336320,"statfs":{"total":96636764160,"available":96600391680,"internally_reserved":0,"allocated":573440,"data_stored":783511,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":35782656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706661,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":39300,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":38784,"kb_avail":94332540,"statfs":{"total":96636764160,"available":96596520960,"internally_reserved":0,"allocated":512000,"data_stored":193143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":39714816},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706661,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":34816,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":34240,"kb_avail":94337024,"statfs":{"total":96636764160,"available":96601112576,"internally_reserved":0,"allocated":573440,"data_stored":783511,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":35061760},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:35:24.664 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:35:24.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:24.765+0000 7fc78b391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:24.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:24.772+0000 7fc78b391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:24.961 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:35:24.961 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:35:24.974 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":610,"stamp":"2024-09-15T12:35:23.901839+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":162624,"kb_used_data":2176,"kb_used_omap":0,"kb_used_meta":160384,"kb_avail":377324736,"statfs":{"total":386547056640,"available":386380529664,"internally_reserved":0,"allocated":2228224,"data_stored":2543657,"data_compressed":90096,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":164233216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.527176"},"pg_stats":[{"pgid":"1.0","version":"11'52","reported_seq":391,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.395277+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:35:19.395277+0000","last_peered":"2024-09-15T12:35:19.395277+0000","last_clean":"2024-09-15T12:35:19.395277+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:35:19.395277+0000","last_undegraded":"2024-09-15T12:35:19.395277+0000","last_fullsized":"2024-09-15T12:35:19.395277+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":320,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.398383+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:35:19.398383+0000","last_peered":"2024-09-15T12:35:19.398383+0000","last_clean":"2024-09-15T12:35:19.398383+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:35:19.398383+0000","last_undegraded":"2024-09-15T12:35:19.398383+0000","last_fullsized":"2024-09-15T12:35:19.398383+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.399684+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:35:19.399684+0000","last_peered":"2024-09-15T12:35:19.399684+0000","last_clean":"2024-09-15T12:35:19.399684+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:35:19.399684+0000","last_undegraded":"2024-09-15T12:35:19.399684+0000","last_fullsized":"2024-09-15T12:35:19.399684+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.395315+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:35:19.395315+0000","last_peered":"2024-09-15T12:35:19.395315+0000","last_clean":"2024-09-15T12:35:19.395315+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:35:19.395315+0000","last_undegraded":"2024-09-15T12:35:19.395315+0000","last_fullsized":"2024-09-15T12:35:19.395315+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":321,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.395764+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:35:19.395764+0000","last_peered":"2024-09-15T12:35:19.395764+0000","last_clean":"2024-09-15T12:35:19.395764+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:35:19.395764+0000","last_undegraded":"2024-09-15T12:35:19.395764+0000","last_fullsized":"2024-09-15T12:35:19.395764+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.398367+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:35:19.398367+0000","last_peered":"2024-09-15T12:35:19.398367+0000","last_clean":"2024-09-15T12:35:19.398367+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:35:19.398367+0000","last_undegraded":"2024-09-15T12:35:19.398367+0000","last_fullsized":"2024-09-15T12:35:19.398367+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.397594+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:35:19.397594+0000","last_peered":"2024-09-15T12:35:19.397594+0000","last_clean":"2024-09-15T12:35:19.397594+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:35:19.397594+0000","last_undegraded":"2024-09-15T12:35:19.397594+0000","last_fullsized":"2024-09-15T12:35:19.397594+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.397246+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:35:19.397246+0000","last_peered":"2024-09-15T12:35:19.397246+0000","last_clean":"2024-09-15T12:35:19.397246+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:35:19.397246+0000","last_undegraded":"2024-09-15T12:35:19.397246+0000","last_fullsized":"2024-09-15T12:35:19.397246+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.397784+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:35:19.397784+0000","last_peered":"2024-09-15T12:35:19.397784+0000","last_clean":"2024-09-15T12:35:19.397784+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:35:19.397784+0000","last_undegraded":"2024-09-15T12:35:19.397784+0000","last_fullsized":"2024-09-15T12:35:19.397784+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673956,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52988,"kb_used_data":556,"kb_used_omap":0,"kb_used_meta":52416,"kb_avail":94318852,"statfs":{"total":96636764160,"available":96582504448,"internally_reserved":0,"allocated":569344,"data_stored":783492,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":53673984},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706661,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35520,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":34944,"kb_avail":94336320,"statfs":{"total":96636764160,"available":96600391680,"internally_reserved":0,"allocated":573440,"data_stored":783511,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":35782656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706661,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":39300,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":38784,"kb_avail":94332540,"statfs":{"total":96636764160,"available":96596520960,"internally_reserved":0,"allocated":512000,"data_stored":193143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":39714816},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706661,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":34816,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":34240,"kb_avail":94337024,"statfs":{"total":96636764160,"available":96601112576,"internally_reserved":0,"allocated":573440,"data_stored":783511,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":35061760},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:35:24.975 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T12:35:24.975 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:35:25.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:25.090+0000 7f75e0391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:25.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:25.096+0000 7f75e0391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:25.289 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:35:25.290 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:35:25.302 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":610,"stamp":"2024-09-15T12:35:23.901839+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":162624,"kb_used_data":2176,"kb_used_omap":0,"kb_used_meta":160384,"kb_avail":377324736,"statfs":{"total":386547056640,"available":386380529664,"internally_reserved":0,"allocated":2228224,"data_stored":2543657,"data_compressed":90096,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":164233216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.527176"},"pg_stats":[{"pgid":"1.0","version":"11'52","reported_seq":391,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.395277+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:35:19.395277+0000","last_peered":"2024-09-15T12:35:19.395277+0000","last_clean":"2024-09-15T12:35:19.395277+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:35:19.395277+0000","last_undegraded":"2024-09-15T12:35:19.395277+0000","last_fullsized":"2024-09-15T12:35:19.395277+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":320,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.398383+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:35:19.398383+0000","last_peered":"2024-09-15T12:35:19.398383+0000","last_clean":"2024-09-15T12:35:19.398383+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:35:19.398383+0000","last_undegraded":"2024-09-15T12:35:19.398383+0000","last_fullsized":"2024-09-15T12:35:19.398383+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.399684+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:35:19.399684+0000","last_peered":"2024-09-15T12:35:19.399684+0000","last_clean":"2024-09-15T12:35:19.399684+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:35:19.399684+0000","last_undegraded":"2024-09-15T12:35:19.399684+0000","last_fullsized":"2024-09-15T12:35:19.399684+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.395315+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:35:19.395315+0000","last_peered":"2024-09-15T12:35:19.395315+0000","last_clean":"2024-09-15T12:35:19.395315+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:35:19.395315+0000","last_undegraded":"2024-09-15T12:35:19.395315+0000","last_fullsized":"2024-09-15T12:35:19.395315+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":321,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.395764+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:35:19.395764+0000","last_peered":"2024-09-15T12:35:19.395764+0000","last_clean":"2024-09-15T12:35:19.395764+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:35:19.395764+0000","last_undegraded":"2024-09-15T12:35:19.395764+0000","last_fullsized":"2024-09-15T12:35:19.395764+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.398367+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:35:19.398367+0000","last_peered":"2024-09-15T12:35:19.398367+0000","last_clean":"2024-09-15T12:35:19.398367+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:35:19.398367+0000","last_undegraded":"2024-09-15T12:35:19.398367+0000","last_fullsized":"2024-09-15T12:35:19.398367+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.397594+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:35:19.397594+0000","last_peered":"2024-09-15T12:35:19.397594+0000","last_clean":"2024-09-15T12:35:19.397594+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:35:19.397594+0000","last_undegraded":"2024-09-15T12:35:19.397594+0000","last_fullsized":"2024-09-15T12:35:19.397594+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.397246+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:35:19.397246+0000","last_peered":"2024-09-15T12:35:19.397246+0000","last_clean":"2024-09-15T12:35:19.397246+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:35:19.397246+0000","last_undegraded":"2024-09-15T12:35:19.397246+0000","last_fullsized":"2024-09-15T12:35:19.397246+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.397784+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:35:19.397784+0000","last_peered":"2024-09-15T12:35:19.397784+0000","last_clean":"2024-09-15T12:35:19.397784+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:35:19.397784+0000","last_undegraded":"2024-09-15T12:35:19.397784+0000","last_fullsized":"2024-09-15T12:35:19.397784+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673956,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52988,"kb_used_data":556,"kb_used_omap":0,"kb_used_meta":52416,"kb_avail":94318852,"statfs":{"total":96636764160,"available":96582504448,"internally_reserved":0,"allocated":569344,"data_stored":783492,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":53673984},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706661,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35520,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":34944,"kb_avail":94336320,"statfs":{"total":96636764160,"available":96600391680,"internally_reserved":0,"allocated":573440,"data_stored":783511,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":35782656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706661,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":39300,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":38784,"kb_avail":94332540,"statfs":{"total":96636764160,"available":96596520960,"internally_reserved":0,"allocated":512000,"data_stored":193143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":39714816},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706661,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":34816,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":34240,"kb_avail":94337024,"statfs":{"total":96636764160,"available":96601112576,"internally_reserved":0,"allocated":573440,"data_stored":783511,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":35061760},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:35:25.303 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T12:35:25.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:25.407+0000 7f77b22ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:25.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:25.417+0000 7f77b22ac640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:25.602 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:35:25.603 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":116,"fsid":"0010d80b-83bc-42b2-8185-928cfe1dc364","created":"2024-09-15T12:18:33.201019+0000","modified":"2024-09-15T12:35:19.381801+0000","last_up_change":"2024-09-15T12:18:41.719581+0000","last_in_change":"2024-09-15T12:18:35.315168+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T12:18:41.719481+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-15T12:18:43.510888+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":15,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5c8d66b-d3a4-47b4-ba1f-789441932c0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2693145533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6801","nonce":2693145533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2693145533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6805","nonce":2693145533}]},"public_addr":"172.21.15.77:6800/2693145533","cluster_addr":"172.21.15.77:6801/2693145533","heartbeat_back_addr":"172.21.15.77:6802/2693145533","heartbeat_front_addr":"172.21.15.77:6805/2693145533","state":["exists","up"]},{"osd":1,"uuid":"349261f9-8426-4182-9f6d-19d1d4d00cfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2237638298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6803","nonce":2237638298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2237638298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6807","nonce":2237638298}]},"public_addr":"172.21.15.77:6804/2237638298","cluster_addr":"172.21.15.77:6803/2237638298","heartbeat_back_addr":"172.21.15.77:6806/2237638298","heartbeat_front_addr":"172.21.15.77:6807/2237638298","state":["exists","up"]},{"osd":2,"uuid":"83bafe3c-2087-47d8-a2a1-1d5a1ec34144","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":2379501345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6803","nonce":2379501345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6805","nonce":2379501345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":2379501345}]},"public_addr":"172.21.15.138:6804/2379501345","cluster_addr":"172.21.15.138:6803/2379501345","heartbeat_back_addr":"172.21.15.138:6805/2379501345","heartbeat_front_addr":"172.21.15.138:6802/2379501345","state":["exists","up"]},{"osd":3,"uuid":"3ec80261-3fac-47d0-a7e5-b49f4289dee8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":364329868}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":364329868}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6813","nonce":364329868}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":364329868}]},"public_addr":"172.21.15.138:6810/364329868","cluster_addr":"172.21.15.138:6811/364329868","heartbeat_back_addr":"172.21.15.138:6813/364329868","heartbeat_front_addr":"172.21.15.138:6814/364329868","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T12:35:26.617 INFO:tasks.ceph:Scrubbing osd.0 2024-09-15T12:35:26.617 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-15T12:35:26.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:26.726+0000 7f23be991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:26.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:26.739+0000 7f23be991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:26.756 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T12:35:26.756 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "" 2024-09-15T12:35:26.756 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T12:35:26.768 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-15T12:35:26.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:26.870+0000 7f8ee765c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:26.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:26.879+0000 7f8ee765c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:27.068 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 0 to deep-scrub 2024-09-15T12:35:27.087 INFO:tasks.ceph:Scrubbing osd.1 2024-09-15T12:35:27.087 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-15T12:35:27.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:27.189+0000 7f9719d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:27.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:27.201+0000 7f9719d91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:27.217 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T12:35:27.217 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "" 2024-09-15T12:35:27.217 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T12:35:27.229 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-15T12:35:27.337 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:27.330+0000 7fb23df91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:27.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:27.339+0000 7fb23df91640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:27.529 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 1 to deep-scrub 2024-09-15T12:35:27.545 INFO:tasks.ceph:Scrubbing osd.2 2024-09-15T12:35:27.545 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-15T12:35:27.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:27.658+0000 7f2e5a991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:27.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:27.671+0000 7f2e5a991640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:27.689 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T12:35:27.689 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "" 2024-09-15T12:35:27.689 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T12:35:27.700 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-15T12:35:27.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:27.801+0000 7f7bcd391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:27.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:27.810+0000 7f7bcd391640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:27.996 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 2 to deep-scrub 2024-09-15T12:35:28.010 INFO:tasks.ceph:Scrubbing osd.3 2024-09-15T12:35:28.011 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-15T12:35:28.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:28.113+0000 7f7a11e9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:28.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:28.125+0000 7f7a11e9c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:28.143 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T12:35:28.143 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "" 2024-09-15T12:35:28.143 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T12:35:28.155 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-15T12:35:28.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:28.257+0000 7f7e84afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:28.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:28.266+0000 7f7e84afd640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:28.455 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 3 to deep-scrub 2024-09-15T12:35:28.470 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:35:28.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:28.573+0000 7f190a26c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:28.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:28.582+0000 7f190a26c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:28.767 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:35:28.767 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:35:28.780 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":612,"stamp":"2024-09-15T12:35:27.902651+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":162624,"kb_used_data":2176,"kb_used_omap":0,"kb_used_meta":160384,"kb_avail":377324736,"statfs":{"total":386547056640,"available":386380529664,"internally_reserved":0,"allocated":2228224,"data_stored":2543657,"data_compressed":90096,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":164233216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.520128"},"pg_stats":[{"pgid":"1.0","version":"11'52","reported_seq":391,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.395277+0000","last_change":"2024-09-15T12:18:42.786240+0000","last_active":"2024-09-15T12:35:19.395277+0000","last_peered":"2024-09-15T12:35:19.395277+0000","last_clean":"2024-09-15T12:35:19.395277+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:35:19.395277+0000","last_undegraded":"2024-09-15T12:35:19.395277+0000","last_fullsized":"2024-09-15T12:35:19.395277+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:41.719581+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":320,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.398383+0000","last_change":"2024-09-15T12:18:46.768957+0000","last_active":"2024-09-15T12:35:19.398383+0000","last_peered":"2024-09-15T12:35:19.398383+0000","last_clean":"2024-09-15T12:35:19.398383+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:35:19.398383+0000","last_undegraded":"2024-09-15T12:35:19.398383+0000","last_fullsized":"2024-09-15T12:35:19.398383+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.399684+0000","last_change":"2024-09-15T12:18:46.770109+0000","last_active":"2024-09-15T12:35:19.399684+0000","last_peered":"2024-09-15T12:35:19.399684+0000","last_clean":"2024-09-15T12:35:19.399684+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:35:19.399684+0000","last_undegraded":"2024-09-15T12:35:19.399684+0000","last_fullsized":"2024-09-15T12:35:19.399684+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.395315+0000","last_change":"2024-09-15T12:18:46.764061+0000","last_active":"2024-09-15T12:35:19.395315+0000","last_peered":"2024-09-15T12:35:19.395315+0000","last_clean":"2024-09-15T12:35:19.395315+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:35:19.395315+0000","last_undegraded":"2024-09-15T12:35:19.395315+0000","last_fullsized":"2024-09-15T12:35:19.395315+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":321,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.395764+0000","last_change":"2024-09-15T12:18:46.765125+0000","last_active":"2024-09-15T12:35:19.395764+0000","last_peered":"2024-09-15T12:35:19.395764+0000","last_clean":"2024-09-15T12:35:19.395764+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:35:19.395764+0000","last_undegraded":"2024-09-15T12:35:19.395764+0000","last_fullsized":"2024-09-15T12:35:19.395764+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.398367+0000","last_change":"2024-09-15T12:18:46.766624+0000","last_active":"2024-09-15T12:35:19.398367+0000","last_peered":"2024-09-15T12:35:19.398367+0000","last_clean":"2024-09-15T12:35:19.398367+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:35:19.398367+0000","last_undegraded":"2024-09-15T12:35:19.398367+0000","last_fullsized":"2024-09-15T12:35:19.398367+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.397594+0000","last_change":"2024-09-15T12:18:46.770544+0000","last_active":"2024-09-15T12:35:19.397594+0000","last_peered":"2024-09-15T12:35:19.397594+0000","last_clean":"2024-09-15T12:35:19.397594+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:35:19.397594+0000","last_undegraded":"2024-09-15T12:35:19.397594+0000","last_fullsized":"2024-09-15T12:35:19.397594+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.397246+0000","last_change":"2024-09-15T12:18:46.766404+0000","last_active":"2024-09-15T12:35:19.397246+0000","last_peered":"2024-09-15T12:35:19.397246+0000","last_clean":"2024-09-15T12:35:19.397246+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:35:19.397246+0000","last_undegraded":"2024-09-15T12:35:19.397246+0000","last_fullsized":"2024-09-15T12:35:19.397246+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":319,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:19.397784+0000","last_change":"2024-09-15T12:18:46.768081+0000","last_active":"2024-09-15T12:35:19.397784+0000","last_peered":"2024-09-15T12:35:19.397784+0000","last_clean":"2024-09-15T12:35:19.397784+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:35:19.397784+0000","last_undegraded":"2024-09-15T12:35:19.397784+0000","last_fullsized":"2024-09-15T12:35:19.397784+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:18:43.729798+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673956,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52988,"kb_used_data":556,"kb_used_omap":0,"kb_used_meta":52416,"kb_avail":94318852,"statfs":{"total":96636764160,"available":96582504448,"internally_reserved":0,"allocated":569344,"data_stored":783492,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":53673984},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706661,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35520,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":34944,"kb_avail":94336320,"statfs":{"total":96636764160,"available":96600391680,"internally_reserved":0,"allocated":573440,"data_stored":783511,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":35782656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706661,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":39300,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":38784,"kb_avail":94332540,"statfs":{"total":96636764160,"available":96596520960,"internally_reserved":0,"allocated":512000,"data_stored":193143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":39714816},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706661,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":34816,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":34240,"kb_avail":94337024,"statfs":{"total":96636764160,"available":96601112576,"internally_reserved":0,"allocated":573440,"data_stored":783511,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":35061760},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:35:28.784 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-15T12:18:41.719581+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=18, tm_sec=41, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=35, tm_sec=25, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:35:28.784 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-15T12:18:43.729798+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=18, tm_sec=43, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=35, tm_sec=25, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:35:28.784 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-15T12:18:43.729798+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=18, tm_sec=43, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=35, tm_sec=25, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:35:28.785 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-15T12:18:43.729798+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=18, tm_sec=43, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=35, tm_sec=25, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:35:28.785 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-15T12:18:43.729798+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=18, tm_sec=43, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=35, tm_sec=25, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:35:28.785 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-15T12:18:43.729798+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=18, tm_sec=43, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=35, tm_sec=25, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:35:28.785 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-15T12:18:43.729798+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=18, tm_sec=43, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=35, tm_sec=25, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:35:28.785 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-15T12:18:43.729798+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=18, tm_sec=43, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=35, tm_sec=25, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:35:28.785 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-15T12:18:43.729798+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=18, tm_sec=43, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=12, tm_min=35, tm_sec=25, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T12:35:28.785 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-15T12:35:48.786 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T12:35:48.904 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:48.898+0000 7f786bc5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:48.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:48.906+0000 7f786bc5a640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:49.099 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T12:35:49.099 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T12:35:49.111 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":622,"stamp":"2024-09-15T12:35:47.907480+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":81,"num_write_kb":1108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":162624,"kb_used_data":2176,"kb_used_omap":0,"kb_used_meta":160384,"kb_avail":377324736,"statfs":{"total":386547056640,"available":386380529664,"internally_reserved":0,"allocated":2228224,"data_stored":2543657,"data_compressed":90096,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":164233216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002839"},"pg_stats":[{"pgid":"1.0","version":"11'52","reported_seq":393,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:28.456625+0000","last_change":"2024-09-15T12:35:28.481912+0000","last_active":"2024-09-15T12:35:28.456625+0000","last_peered":"2024-09-15T12:35:28.456625+0000","last_clean":"2024-09-15T12:35:28.456625+0000","last_became_active":"2024-09-15T12:18:42.778005+0000","last_became_peered":"2024-09-15T12:18:42.778005+0000","last_unstale":"2024-09-15T12:35:28.456625+0000","last_undegraded":"2024-09-15T12:35:28.456625+0000","last_fullsized":"2024-09-15T12:35:28.456625+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"11'52","last_scrub_stamp":"2024-09-15T12:35:28.481523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:35:28.481523+0000","last_clean_scrub_stamp":"2024-09-15T12:18:41.719581+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"13'1","reported_seq":322,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:27.532646+0000","last_change":"2024-09-15T12:35:27.619555+0000","last_active":"2024-09-15T12:35:27.532646+0000","last_peered":"2024-09-15T12:35:27.532646+0000","last_clean":"2024-09-15T12:35:27.532646+0000","last_became_active":"2024-09-15T12:18:44.840877+0000","last_became_peered":"2024-09-15T12:18:44.840877+0000","last_unstale":"2024-09-15T12:35:27.532646+0000","last_undegraded":"2024-09-15T12:35:27.532646+0000","last_fullsized":"2024-09-15T12:35:27.532646+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"13'1","last_scrub_stamp":"2024-09-15T12:35:27.619230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:35:27.619230+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":321,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:27.070456+0000","last_change":"2024-09-15T12:35:27.080732+0000","last_active":"2024-09-15T12:35:27.070456+0000","last_peered":"2024-09-15T12:35:27.070456+0000","last_clean":"2024-09-15T12:35:27.070456+0000","last_became_active":"2024-09-15T12:18:44.811754+0000","last_became_peered":"2024-09-15T12:18:44.811754+0000","last_unstale":"2024-09-15T12:35:27.070456+0000","last_undegraded":"2024-09-15T12:35:27.070456+0000","last_fullsized":"2024-09-15T12:35:27.070456+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:35:27.080563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:35:27.080563+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":321,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:27.531192+0000","last_change":"2024-09-15T12:35:27.576345+0000","last_active":"2024-09-15T12:35:27.531192+0000","last_peered":"2024-09-15T12:35:27.531192+0000","last_clean":"2024-09-15T12:35:27.531192+0000","last_became_active":"2024-09-15T12:18:44.804910+0000","last_became_peered":"2024-09-15T12:18:44.804910+0000","last_unstale":"2024-09-15T12:35:27.531192+0000","last_undegraded":"2024-09-15T12:35:27.531192+0000","last_fullsized":"2024-09-15T12:35:27.531192+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:35:27.576060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:35:27.576060+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"15'2","reported_seq":323,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:27.069393+0000","last_change":"2024-09-15T12:35:27.082772+0000","last_active":"2024-09-15T12:35:27.069393+0000","last_peered":"2024-09-15T12:35:27.069393+0000","last_clean":"2024-09-15T12:35:27.069393+0000","last_became_active":"2024-09-15T12:18:44.811750+0000","last_became_peered":"2024-09-15T12:18:44.811750+0000","last_unstale":"2024-09-15T12:35:27.069393+0000","last_undegraded":"2024-09-15T12:35:27.069393+0000","last_fullsized":"2024-09-15T12:35:27.069393+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"15'2","last_scrub_stamp":"2024-09-15T12:35:27.082587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:35:27.082587+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":321,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:27.997485+0000","last_change":"2024-09-15T12:35:28.008811+0000","last_active":"2024-09-15T12:35:27.997485+0000","last_peered":"2024-09-15T12:35:27.997485+0000","last_clean":"2024-09-15T12:35:27.997485+0000","last_became_active":"2024-09-15T12:18:44.818868+0000","last_became_peered":"2024-09-15T12:18:44.818868+0000","last_unstale":"2024-09-15T12:35:27.997485+0000","last_undegraded":"2024-09-15T12:35:27.997485+0000","last_fullsized":"2024-09-15T12:35:27.997485+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:35:28.008614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:35:28.008614+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":321,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:28.458176+0000","last_change":"2024-09-15T12:35:28.506195+0000","last_active":"2024-09-15T12:35:28.458176+0000","last_peered":"2024-09-15T12:35:28.458176+0000","last_clean":"2024-09-15T12:35:28.458176+0000","last_became_active":"2024-09-15T12:18:44.819701+0000","last_became_peered":"2024-09-15T12:18:44.819701+0000","last_unstale":"2024-09-15T12:35:28.458176+0000","last_undegraded":"2024-09-15T12:35:28.458176+0000","last_fullsized":"2024-09-15T12:35:28.458176+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:35:28.505984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:35:28.505984+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":321,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:27.997481+0000","last_change":"2024-09-15T12:35:28.008132+0000","last_active":"2024-09-15T12:35:27.997481+0000","last_peered":"2024-09-15T12:35:27.997481+0000","last_clean":"2024-09-15T12:35:27.997481+0000","last_became_active":"2024-09-15T12:18:44.818907+0000","last_became_peered":"2024-09-15T12:18:44.818907+0000","last_unstale":"2024-09-15T12:35:27.997481+0000","last_undegraded":"2024-09-15T12:35:27.997481+0000","last_fullsized":"2024-09-15T12:35:27.997481+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:35:28.007916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:35:28.007916+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":321,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-15T12:35:27.532627+0000","last_change":"2024-09-15T12:35:27.604289+0000","last_active":"2024-09-15T12:35:27.532627+0000","last_peered":"2024-09-15T12:35:27.532627+0000","last_clean":"2024-09-15T12:35:27.532627+0000","last_became_active":"2024-09-15T12:18:44.838005+0000","last_became_peered":"2024-09-15T12:18:44.838005+0000","last_unstale":"2024-09-15T12:35:27.532627+0000","last_undegraded":"2024-09-15T12:35:27.532627+0000","last_fullsized":"2024-09-15T12:35:27.532627+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T12:35:27.604115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T12:35:27.604115+0000","last_clean_scrub_stamp":"2024-09-15T12:18:43.729798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":46,"num_write":79,"num_write_kb":1106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":52,"ondisk_log_size":52,"up":3,"acting":3,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673977,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":52988,"kb_used_data":556,"kb_used_omap":0,"kb_used_meta":52416,"kb_avail":94318852,"statfs":{"total":96636764160,"available":96582504448,"internally_reserved":0,"allocated":569344,"data_stored":783492,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":53673984},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706681,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35520,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":34944,"kb_avail":94336320,"statfs":{"total":96636764160,"available":96600391680,"internally_reserved":0,"allocated":573440,"data_stored":783511,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":35782656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706681,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":39300,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":38784,"kb_avail":94332540,"statfs":{"total":96636764160,"available":96596520960,"internally_reserved":0,"allocated":512000,"data_stored":193143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":39714816},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706681,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":34816,"kb_used_data":560,"kb_used_omap":0,"kb_used_meta":34240,"kb_avail":94337024,"statfs":{"total":96636764160,"available":96601112576,"internally_reserved":0,"allocated":573440,"data_stored":783511,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":35061760},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":30032,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T12:35:49.113 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-15T12:35:49.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:49.212+0000 7f1393093640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:49.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T12:35:49.223+0000 7f1393093640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-15T12:35:49.434 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-15T12:35:49.434 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-15T12:35:49.434 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-15T12:35:49.434 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T12:35:49.527 INFO:tasks.ceph.osd.0:Stopped 2024-09-15T12:35:49.527 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-15T12:35:49.528 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T12:35:52.906 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-15T12:35:55.629 INFO:tasks.ceph.osd.1:Stopped 2024-09-15T12:35:55.630 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-15T12:35:55.630 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T12:35:55.726 INFO:tasks.ceph.osd.2:Stopped 2024-09-15T12:35:55.726 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-15T12:35:55.726 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T12:35:55.813 INFO:tasks.ceph.osd.3:Stopped 2024-09-15T12:35:55.813 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-15T12:35:55.813 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-15T12:35:55.813 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T12:35:55.842 INFO:tasks.ceph.mgr.x:Stopped 2024-09-15T12:35:55.842 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-15T12:35:55.842 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-15T12:35:55.842 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T12:35:55.857 INFO:tasks.ceph.mon.a:Stopped 2024-09-15T12:35:55.858 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-15T12:35:55.858 DEBUG:teuthology.orchestra.run.smithi077:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-09-15T12:35:56.000 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-15T12:35:56.000 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-15T12:35:56.195 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-15T12:35:56.196 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-15T12:35:56.285 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-15T12:35:56.285 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-15T12:35:56.390 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-15T12:35:56.390 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-15T12:35:56.480 INFO:tasks.ceph:Archiving mon data... 2024-09-15T12:35:56.481 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905530/data/mon.a.tgz 2024-09-15T12:35:56.481 DEBUG:teuthology.orchestra.run.smithi077:> mktemp 2024-09-15T12:35:56.499 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.ElY5jpTUyR 2024-09-15T12:35:56.499 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ElY5jpTUyR 2024-09-15T12:35:56.618 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0666 /tmp/tmp.ElY5jpTUyR 2024-09-15T12:35:56.703 DEBUG:teuthology.orchestra.remote:smithi077:/tmp/tmp.ElY5jpTUyR is 234KB 2024-09-15T12:35:56.770 DEBUG:teuthology.orchestra.run.smithi077:> rm -fr /tmp/tmp.ElY5jpTUyR 2024-09-15T12:35:56.785 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-15T12:35:56.785 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-15T12:35:56.827 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-15T12:35:56.904 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-15T12:35:56.921 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-15T12:35:56.921 INFO:tasks.ceph:Archiving crash dumps... 2024-09-15T12:35:56.922 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905530/remote/smithi077/crash 2024-09-15T12:35:56.923 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-15T12:35:56.969 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/crash to /home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905530/remote/smithi138/crash 2024-09-15T12:35:56.970 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-15T12:35:57.013 INFO:tasks.ceph:Compressing logs... 2024-09-15T12:35:57.013 DEBUG:teuthology.orchestra.run.smithi077:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T12:35:57.016 DEBUG:teuthology.orchestra.run.smithi138:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T12:35:57.038 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-15T12:35:57.038 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46256.log 2024-09-15T12:35:57.087 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28227.log 2024-09-15T12:35:57.087 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28136.log 2024-09-15T12:35:57.087 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28187.log 2024-09-15T12:35:57.087 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.28227.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28227.log.gz 2024-09-15T12:35:57.088 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.28136.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-15T12:35:57.088 INFO:teuthology.orchestra.run.smithi138.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28136.log.gz 2024-09-15T12:35:57.088 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.28187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28267.log 2024-09-15T12:35:57.088 INFO:teuthology.orchestra.run.smithi138.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28187.log.gz 2024-09-15T12:35:57.088 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-15T12:35:57.088 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.28267.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-15T12:35:57.088 INFO:teuthology.orchestra.run.smithi138.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28267.log.gz 2024-09-15T12:35:57.176 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-osd.3.log: 92.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-15T12:35:57.306 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52777.log 2024-09-15T12:35:57.306 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.46256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63546.log 2024-09-15T12:35:57.306 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46256.log.gz 2024-09-15T12:35:57.306 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35346.log 2024-09-15T12:35:57.306 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52777.log.gz 2024-09-15T12:35:57.306 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63546.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63546.log.gz 2024-09-15T12:35:57.306 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40469.log 2024-09-15T12:35:57.306 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.35346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44222.log 2024-09-15T12:35:57.306 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35346.log.gz 2024-09-15T12:35:57.307 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38614.log 2024-09-15T12:35:57.307 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40469.log.gz 2024-09-15T12:35:57.307 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60904.log 2024-09-15T12:35:57.307 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44222.log.gz 2024-09-15T12:35:57.307 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34193.log 2024-09-15T12:35:57.307 INFO:teuthology.orchestra.run.smithi077.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.38614.log.gz 2024-09-15T12:35:57.307 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.60904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38298.log 2024-09-15T12:35:57.307 INFO:teuthology.orchestra.run.smithi077.stderr: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.60904.log.gz 2024-09-15T12:35:57.307 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65167.log 2024-09-15T12:35:57.307 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34193.log.gz 2024-09-15T12:35:57.307 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50016.log 2024-09-15T12:35:57.307 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38298.log.gz 2024-09-15T12:35:57.307 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40210.log 2024-09-15T12:35:57.307 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65167.log.gz 2024-09-15T12:35:57.307 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44362.log 2024-09-15T12:35:57.308 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50016.log.gz 2024-09-15T12:35:57.308 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58473.log 2024-09-15T12:35:57.308 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40210.log.gz 2024-09-15T12:35:57.308 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45398.log 2024-09-15T12:35:57.308 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44362.log.gz 2024-09-15T12:35:57.308 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.58473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45988.log 2024-09-15T12:35:57.308 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58473.log.gz 2024-09-15T12:35:57.308 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33451.log 2024-09-15T12:35:57.308 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45398.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45398.log.gz 2024-09-15T12:35:57.308 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63966.log 2024-09-15T12:35:57.308 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45988.log.gz 2024-09-15T12:35:57.308 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29767.log 2024-09-15T12:35:57.308 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33451.log.gz 2024-09-15T12:35:57.308 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35754.log 2024-09-15T12:35:57.309 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63966.log.gz 2024-09-15T12:35:57.309 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.29767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70131.log 2024-09-15T12:35:57.309 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29767.log.gz 2024-09-15T12:35:57.309 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.35754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53593.log 2024-09-15T12:35:57.309 INFO:teuthology.orchestra.run.smithi077.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.35754.log.gz 2024-09-15T12:35:57.309 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.70131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67249.log 2024-09-15T12:35:57.309 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.70131.log.gz 2024-09-15T12:35:57.309 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.53593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56830.log 2024-09-15T12:35:57.309 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53593.log.gz 2024-09-15T12:35:57.309 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.67249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38210.log 2024-09-15T12:35:57.309 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67249.log.gz 2024-09-15T12:35:57.309 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.56830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65823.log 2024-09-15T12:35:57.309 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56830.log.gz 2024-09-15T12:35:57.309 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53892.log 2024-09-15T12:35:57.310 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38210.log.gz 2024-09-15T12:35:57.310 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51755.log 2024-09-15T12:35:57.310 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65823.log.gz 2024-09-15T12:35:57.310 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.53892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47458.log 2024-09-15T12:35:57.310 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53892.log.gz 2024-09-15T12:35:57.310 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49387.log 2024-09-15T12:35:57.310 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51755.log.gz 2024-09-15T12:35:57.310 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30541.log 2024-09-15T12:35:57.310 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47458.log.gz 2024-09-15T12:35:57.310 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39244.log 2024-09-15T12:35:57.310 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49387.log.gz 2024-09-15T12:35:57.310 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.30541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43835.log 2024-09-15T12:35:57.310 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30541.log.gz 2024-09-15T12:35:57.310 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.39244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34813.log 2024-09-15T12:35:57.310 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39244.log.gz 2024-09-15T12:35:57.311 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38034.log 2024-09-15T12:35:57.311 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43835.log.gz 2024-09-15T12:35:57.311 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34690.log 2024-09-15T12:35:57.311 INFO:teuthology.orchestra.run.smithi077.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.34813.log.gz 2024-09-15T12:35:57.311 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47862.log 2024-09-15T12:35:57.311 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38034.log.gz 2024-09-15T12:35:57.311 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34060.log 2024-09-15T12:35:57.311 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34690.log.gz 2024-09-15T12:35:57.311 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34710.log 2024-09-15T12:35:57.311 INFO:teuthology.orchestra.run.smithi077.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.47862.log.gz 2024-09-15T12:35:57.311 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31915.log 2024-09-15T12:35:57.311 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34060.log.gz 2024-09-15T12:35:57.311 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69685.log 2024-09-15T12:35:57.311 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34710.log.gz 2024-09-15T12:35:57.312 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29933.log 2024-09-15T12:35:57.312 INFO:teuthology.orchestra.run.smithi077.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.31915.log.gz 2024-09-15T12:35:57.312 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.69685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70887.log 2024-09-15T12:35:57.312 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.69685.log.gz 2024-09-15T12:35:57.312 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.29933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49209.log 2024-09-15T12:35:57.312 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29933.log.gz 2024-09-15T12:35:57.312 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.70887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38168.log 2024-09-15T12:35:57.312 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.70887.log.gz 2024-09-15T12:35:57.312 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44174.log 2024-09-15T12:35:57.312 INFO:teuthology.orchestra.run.smithi077.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.49209.log.gz 2024-09-15T12:35:57.312 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38168.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38168.log.gz 2024-09-15T12:35:57.312 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53104.log 2024-09-15T12:35:57.312 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48862.log 2024-09-15T12:35:57.313 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44174.log.gz 2024-09-15T12:35:57.313 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.53104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69004.log 2024-09-15T12:35:57.313 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53104.log.gz 2024-09-15T12:35:57.313 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45010.log 2024-09-15T12:35:57.313 INFO:teuthology.orchestra.run.smithi077.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.48862.log.gz 2024-09-15T12:35:57.313 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.69004.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.69004.log.gz 2024-09-15T12:35:57.313 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46480.log 2024-09-15T12:35:57.313 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56314.log 2024-09-15T12:35:57.313 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45010.log.gz 2024-09-15T12:35:57.313 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35157.log 2024-09-15T12:35:57.313 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46480.log.gz 2024-09-15T12:35:57.313 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.56314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64315.log 2024-09-15T12:35:57.313 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56314.log.gz 2024-09-15T12:35:57.314 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.35157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68772.log 2024-09-15T12:35:57.314 INFO:teuthology.orchestra.run.smithi077.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.35157.log.gz 2024-09-15T12:35:57.314 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53284.log 2024-09-15T12:35:57.314 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64315.log.gz 2024-09-15T12:35:57.314 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.68772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35604.log 2024-09-15T12:35:57.314 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.68772.log.gz 2024-09-15T12:35:57.314 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.53284.log: gzip 49.6% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.53284.log.gz -- 2024-09-15T12:35:57.314 INFO:teuthology.orchestra.run.smithi077.stderr: /var/log/ceph/ceph-client.admin.45527.log 2024-09-15T12:35:57.314 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.35604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68403.log 2024-09-15T12:35:57.314 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35604.log.gz 2024-09-15T12:35:57.314 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48294.log 2024-09-15T12:35:57.314 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45527.log.gz 2024-09-15T12:35:57.314 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.68403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70509.log 2024-09-15T12:35:57.314 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.68403.log.gz 2024-09-15T12:35:57.314 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48294.log: gzip -5 --verbose -- 50.0% /var/log/ceph/ceph-client.admin.31247.log -- replaced with /var/log/ceph/ceph-client.admin.48294.log.gz 2024-09-15T12:35:57.315 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-09-15T12:35:57.315 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.70509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51148.log 2024-09-15T12:35:57.315 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.70509.log.gz 2024-09-15T12:35:57.315 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31009.log 2024-09-15T12:35:57.315 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31247.log.gz 2024-09-15T12:35:57.315 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66271.log 2024-09-15T12:35:57.315 INFO:teuthology.orchestra.run.smithi077.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.51148.log.gz 2024-09-15T12:35:57.315 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33731.log 2024-09-15T12:35:57.315 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31009.log.gz 2024-09-15T12:35:57.315 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.66271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57706.log 2024-09-15T12:35:57.315 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66271.log.gz 2024-09-15T12:35:57.315 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47988.log 2024-09-15T12:35:57.315 INFO:teuthology.orchestra.run.smithi077.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.33731.log.gz 2024-09-15T12:35:57.315 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.57706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60964.log 2024-09-15T12:35:57.315 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57706.log.gz 2024-09-15T12:35:57.316 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47007.log 2024-09-15T12:35:57.316 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47988.log.gz 2024-09-15T12:35:57.316 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.60964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40984.log 2024-09-15T12:35:57.316 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60964.log.gz 2024-09-15T12:35:57.316 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40612.log 2024-09-15T12:35:57.316 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47007.log.gz 2024-09-15T12:35:57.316 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35818.log 2024-09-15T12:35:57.316 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40984.log.gz 2024-09-15T12:35:57.316 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54760.log 2024-09-15T12:35:57.316 INFO:teuthology.orchestra.run.smithi077.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.40612.log.gz 2024-09-15T12:35:57.316 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.35818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43047.log 2024-09-15T12:35:57.316 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35818.log.gz 2024-09-15T12:35:57.316 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.54760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64671.log 2024-09-15T12:35:57.316 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54760.log.gz 2024-09-15T12:35:57.316 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68544.log 2024-09-15T12:35:57.317 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43047.log.gz 2024-09-15T12:35:57.317 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42040.log 2024-09-15T12:35:57.317 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64671.log.gz 2024-09-15T12:35:57.317 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.68544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43088.log 2024-09-15T12:35:57.317 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.68544.log.gz 2024-09-15T12:35:57.317 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36180.log 2024-09-15T12:35:57.317 INFO:teuthology.orchestra.run.smithi077.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.42040.log.gz 2024-09-15T12:35:57.317 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59410.log 2024-09-15T12:35:57.317 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43088.log.gz 2024-09-15T12:35:57.317 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.36180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52717.log 2024-09-15T12:35:57.317 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36180.log.gz 2024-09-15T12:35:57.317 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.59410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66787.log 2024-09-15T12:35:57.317 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59410.log.gz 2024-09-15T12:35:57.317 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42229.log 2024-09-15T12:35:57.318 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52717.log.gz 2024-09-15T12:35:57.318 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.66787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66976.log 2024-09-15T12:35:57.318 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66787.log.gz 2024-09-15T12:35:57.318 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43005.log 2024-09-15T12:35:57.318 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42229.log.gz 2024-09-15T12:35:57.318 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.66976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67913.log 2024-09-15T12:35:57.318 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66976.log.gz 2024-09-15T12:35:57.318 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59579.log 2024-09-15T12:35:57.318 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43005.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43005.log.gz 2024-09-15T12:35:57.318 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.67913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62443.log 2024-09-15T12:35:57.318 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67913.log.gz 2024-09-15T12:35:57.318 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.59579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46434.log 2024-09-15T12:35:57.318 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59579.log.gz 2024-09-15T12:35:57.318 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.62443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40426.log 2024-09-15T12:35:57.318 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62443.log.gz 2024-09-15T12:35:57.318 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29540.log 2024-09-15T12:35:57.319 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46434.log.gz 2024-09-15T12:35:57.319 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65665.log 2024-09-15T12:35:57.319 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40426.log.gz 2024-09-15T12:35:57.319 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.29540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42418.log 2024-09-15T12:35:57.319 INFO:teuthology.orchestra.run.smithi077.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.29540.log.gz 2024-09-15T12:35:57.319 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70003.log 2024-09-15T12:35:57.319 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65665.log.gz 2024-09-15T12:35:57.319 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39953.log 2024-09-15T12:35:57.319 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42418.log.gz 2024-09-15T12:35:57.319 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.70003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60486.log 2024-09-15T12:35:57.319 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.70003.log.gz 2024-09-15T12:35:57.319 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.39953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33542.log 2024-09-15T12:35:57.319 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39953.log.gz 2024-09-15T12:35:57.319 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.60486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55262.log 2024-09-15T12:35:57.320 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60486.log.gz 2024-09-15T12:35:57.320 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40121.log 2024-09-15T12:35:57.320 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33542.log.gz 2024-09-15T12:35:57.320 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.55262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43613.log 2024-09-15T12:35:57.320 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55262.log.gz 2024-09-15T12:35:57.320 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58244.log 2024-09-15T12:35:57.320 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40121.log.gz 2024-09-15T12:35:57.320 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58971.log 2024-09-15T12:35:57.320 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43613.log.gz 2024-09-15T12:35:57.320 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.58244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30889.log 2024-09-15T12:35:57.320 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58244.log.gz 2024-09-15T12:35:57.320 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.58971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57895.log 2024-09-15T12:35:57.320 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58971.log.gz 2024-09-15T12:35:57.320 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.30889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56136.log 2024-09-15T12:35:57.320 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30889.log.gz 2024-09-15T12:35:57.321 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.57895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39203.log 2024-09-15T12:35:57.321 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57895.log.gz 2024-09-15T12:35:57.321 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.56136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54706.log 2024-09-15T12:35:57.321 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56136.log.gz 2024-09-15T12:35:57.321 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.39203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32771.log 2024-09-15T12:35:57.321 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39203.log.gz 2024-09-15T12:35:57.321 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.54706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57797.log 2024-09-15T12:35:57.321 INFO:teuthology.orchestra.run.smithi077.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.54706.log.gz 2024-09-15T12:35:57.321 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34771.log 2024-09-15T12:35:57.321 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32771.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32771.log.gz 2024-09-15T12:35:57.321 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.57797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33134.log 2024-09-15T12:35:57.321 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57797.log.gz 2024-09-15T12:35:57.321 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55611.log 2024-09-15T12:35:57.321 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34771.log.gz 2024-09-15T12:35:57.322 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64358.log 2024-09-15T12:35:57.322 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33134.log.gz 2024-09-15T12:35:57.322 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69044.log 2024-09-15T12:35:57.322 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.55611.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55611.log.gz 2024-09-15T12:35:57.322 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65872.log 2024-09-15T12:35:57.322 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64358.log.gz 2024-09-15T12:35:57.322 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.69044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64531.log 2024-09-15T12:35:57.322 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.69044.log.gz 2024-09-15T12:35:57.322 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57048.log 2024-09-15T12:35:57.322 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65872.log.gz 2024-09-15T12:35:57.322 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46298.log 2024-09-15T12:35:57.322 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64531.log.gz 2024-09-15T12:35:57.322 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.57048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54864.log 2024-09-15T12:35:57.322 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57048.log.gz 2024-09-15T12:35:57.322 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53144.log 2024-09-15T12:35:57.322 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46298.log.gz 2024-09-15T12:35:57.323 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.54864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50512.log 2024-09-15T12:35:57.323 INFO:teuthology.orchestra.run.smithi077.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.54864.log.gz 2024-09-15T12:35:57.323 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.53144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64880.log 2024-09-15T12:35:57.323 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53144.log.gz 2024-09-15T12:35:57.323 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41606.log 2024-09-15T12:35:57.323 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50512.log.gz 2024-09-15T12:35:57.323 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64880.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-15T12:35:57.323 INFO:teuthology.orchestra.run.smithi077.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.64880.log.gz 2024-09-15T12:35:57.323 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30589.log 2024-09-15T12:35:57.323 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41606.log.gz 2024-09-15T12:35:57.323 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61375.log 2024-09-15T12:35:57.323 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.30589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43180.log 2024-09-15T12:35:57.323 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30589.log.gz 2024-09-15T12:35:57.323 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.61375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50959.log 2024-09-15T12:35:57.323 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61375.log.gz 2024-09-15T12:35:57.323 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52112.log 2024-09-15T12:35:57.324 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43180.log.gz 2024-09-15T12:35:57.324 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38854.log 2024-09-15T12:35:57.324 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50959.log.gz 2024-09-15T12:35:57.324 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52112.log: 48.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.52112.log.gz 2024-09-15T12:35:57.324 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.69682.log 2024-09-15T12:35:57.324 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54508.log 2024-09-15T12:35:57.324 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38854.log.gz 2024-09-15T12:35:57.324 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.69682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59916.log 2024-09-15T12:35:57.324 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.69682.log.gz 2024-09-15T12:35:57.324 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.54508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44452.log 2024-09-15T12:35:57.324 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54508.log.gz 2024-09-15T12:35:57.324 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.59916.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59916.log.gz 2024-09-15T12:35:57.324 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42816.log 2024-09-15T12:35:57.324 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40708.log 2024-09-15T12:35:57.324 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44452.log.gz 2024-09-15T12:35:57.325 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59708.log 2024-09-15T12:35:57.325 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42816.log.gz 2024-09-15T12:35:57.325 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51535.log 2024-09-15T12:35:57.325 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40708.log.gz 2024-09-15T12:35:57.325 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.59708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51426.log 2024-09-15T12:35:57.325 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59708.log.gz 2024-09-15T12:35:57.325 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70170.log 2024-09-15T12:35:57.325 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51535.log.gz 2024-09-15T12:35:57.325 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35395.log 2024-09-15T12:35:57.325 INFO:teuthology.orchestra.run.smithi077.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.51426.log.gz 2024-09-15T12:35:57.325 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.70170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59789.log 2024-09-15T12:35:57.325 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.70170.log.gz 2024-09-15T12:35:57.325 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.35395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41071.log 2024-09-15T12:35:57.325 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35395.log.gz 2024-09-15T12:35:57.326 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.59789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64224.log 2024-09-15T12:35:57.326 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59789.log.gz 2024-09-15T12:35:57.326 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42320.log 2024-09-15T12:35:57.326 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41071.log.gz 2024-09-15T12:35:57.326 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62483.log 2024-09-15T12:35:57.326 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64224.log.gz 2024-09-15T12:35:57.326 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28907.log 2024-09-15T12:35:57.326 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42320.log.gz 2024-09-15T12:35:57.326 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.62483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63268.log 2024-09-15T12:35:57.326 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62483.log.gz 2024-09-15T12:35:57.326 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.28907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69855.log 2024-09-15T12:35:57.326 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28907.log.gz 2024-09-15T12:35:57.326 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63268.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63268.log.gz 2024-09-15T12:35:57.326 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47325.log 2024-09-15T12:35:57.326 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.69855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46560.log 2024-09-15T12:35:57.327 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.69855.log.gz 2024-09-15T12:35:57.327 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68088.log 2024-09-15T12:35:57.327 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47325.log.gz 2024-09-15T12:35:57.327 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31433.log 2024-09-15T12:35:57.327 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46560.log.gz 2024-09-15T12:35:57.327 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.68088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40001.log 2024-09-15T12:35:57.327 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.68088.log.gz 2024-09-15T12:35:57.327 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64482.log 2024-09-15T12:35:57.327 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31433.log.gz 2024-09-15T12:35:57.327 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39826.log 2024-09-15T12:35:57.327 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40001.log.gz 2024-09-15T12:35:57.327 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29624.log 2024-09-15T12:35:57.327 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64482.log.gz 2024-09-15T12:35:57.327 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.39826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54348.log 2024-09-15T12:35:57.327 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39826.log.gz 2024-09-15T12:35:57.327 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.29624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67773.log 2024-09-15T12:35:57.328 INFO:teuthology.orchestra.run.smithi077.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.29624.log.gz 2024-09-15T12:35:57.328 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.54348.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54348.log.gz 2024-09-15T12:35:57.328 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52677.log 2024-09-15T12:35:57.328 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.67773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65992.log 2024-09-15T12:35:57.328 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67773.log.gz 2024-09-15T12:35:57.328 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56790.log 2024-09-15T12:35:57.328 INFO:teuthology.orchestra.run.smithi077.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.52677.log.gz 2024-09-15T12:35:57.328 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60590.log 2024-09-15T12:35:57.328 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65992.log.gz 2024-09-15T12:35:57.328 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.56790.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56790.log.gz 2024-09-15T12:35:57.328 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52132.log 2024-09-15T12:35:57.328 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.60590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65425.log 2024-09-15T12:35:57.328 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60590.log.gz 2024-09-15T12:35:57.328 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37635.log 2024-09-15T12:35:57.329 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52132.log.gz 2024-09-15T12:35:57.329 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34501.log 2024-09-15T12:35:57.329 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65425.log.gz 2024-09-15T12:35:57.329 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67635.log 2024-09-15T12:35:57.329 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37635.log.gz 2024-09-15T12:35:57.329 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60655.log 2024-09-15T12:35:57.329 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34501.log.gz 2024-09-15T12:35:57.329 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.67635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47695.log 2024-09-15T12:35:57.329 INFO:teuthology.orchestra.run.smithi077.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.67635.log.gz 2024-09-15T12:35:57.329 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.60655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63446.log 2024-09-15T12:35:57.329 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60655.log.gz 2024-09-15T12:35:57.329 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61193.log 2024-09-15T12:35:57.329 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47695.log.gz 2024-09-15T12:35:57.329 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60026.log 2024-09-15T12:35:57.329 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63446.log.gz 2024-09-15T12:35:57.330 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.61193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38343.log 2024-09-15T12:35:57.330 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61193.log.gz 2024-09-15T12:35:57.330 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.60026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65467.log 2024-09-15T12:35:57.330 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60026.log.gz 2024-09-15T12:35:57.330 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30044.log 2024-09-15T12:35:57.330 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38343.log.gz 2024-09-15T12:35:57.330 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37754.log 2024-09-15T12:35:57.330 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65467.log.gz 2024-09-15T12:35:57.330 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.30044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57846.log 2024-09-15T12:35:57.330 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30044.log.gz 2024-09-15T12:35:57.330 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.0.37754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67382.log 2024-09-15T12:35:57.330 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.57846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36100.log 2024-09-15T12:35:57.330 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57846.log.gz 2024-09-15T12:35:57.330 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.67382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48687.log 50.0% 2024-09-15T12:35:57.330 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67382.log.gz 2024-09-15T12:35:57.330 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30212.log 2024-09-15T12:35:57.331 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.36100.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36100.log.gz 2024-09-15T12:35:57.331 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65727.log 2024-09-15T12:35:57.331 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48687.log.gz 2024-09-15T12:35:57.331 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.30212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36002.log 2024-09-15T12:35:57.331 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30212.log.gz 2024-09-15T12:35:57.331 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41340.log 2024-09-15T12:35:57.331 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65727.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.65727.log.gz 2024-09-15T12:35:57.331 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.36002.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36002.log.gz 2024-09-15T12:35:57.331 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36882.log 2024-09-15T12:35:57.331 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58922.log 2024-09-15T12:35:57.331 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41340.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41340.log.gz 2024-09-15T12:35:57.331 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.36882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31955.log 2024-09-15T12:35:57.331 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36882.log.gz 2024-09-15T12:35:57.331 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32362.log 2024-09-15T12:35:57.331 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.58922.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58922.log.gz 2024-09-15T12:35:57.331 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29936.log 2024-09-15T12:35:57.332 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31955.log.gz 2024-09-15T12:35:57.332 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49129.log 2024-09-15T12:35:57.332 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32362.log.gz 2024-09-15T12:35:57.332 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33822.log 2024-09-15T12:35:57.332 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.29936.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29936.log.gz 2024-09-15T12:35:57.332 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49129.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49129.log.gz 2024-09-15T12:35:57.332 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66878.log 2024-09-15T12:35:57.332 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40337.log 2024-09-15T12:35:57.332 INFO:teuthology.orchestra.run.smithi077.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.33822.log.gz 2024-09-15T12:35:57.332 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.66878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44591.log 2024-09-15T12:35:57.332 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66878.log.gz 2024-09-15T12:35:57.332 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62087.log 2024-09-15T12:35:57.332 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40337.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40337.log.gz 2024-09-15T12:35:57.332 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44591.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44591.log.gz 2024-09-15T12:35:57.332 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49527.log 2024-09-15T12:35:57.333 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66222.log 2024-09-15T12:35:57.333 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.62087.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62087.log.gz 2024-09-15T12:35:57.333 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55709.log 2024-09-15T12:35:57.333 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49527.log.gz 2024-09-15T12:35:57.333 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.66222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65605.log 2024-09-15T12:35:57.333 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66222.log.gz 2024-09-15T12:35:57.333 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65247.log 2024-09-15T12:35:57.333 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.55709.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55709.log.gz 2024-09-15T12:35:57.333 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60704.log 2024-09-15T12:35:57.333 INFO:teuthology.orchestra.run.smithi077.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.65605.log.gz 2024-09-15T12:35:57.333 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37266.log 2024-09-15T12:35:57.333 INFO:teuthology.orchestra.run.smithi077.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.65247.log.gz 2024-09-15T12:35:57.333 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43754.log 2024-09-15T12:35:57.333 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.60704.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60704.log.gz 2024-09-15T12:35:57.333 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32911.log 2024-09-15T12:35:57.333 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37266.log.gz 2024-09-15T12:35:57.334 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33640.log 2024-09-15T12:35:57.334 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43754.log.gz 2024-09-15T12:35:57.334 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47276.log 2024-09-15T12:35:57.334 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32911.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32911.log.gz 2024-09-15T12:35:57.334 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44642.log 2024-09-15T12:35:57.334 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33640.log.gz 2024-09-15T12:35:57.334 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62789.log 2024-09-15T12:35:57.334 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47276.log.gz 2024-09-15T12:35:57.334 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70677.log 2024-09-15T12:35:57.334 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44642.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44642.log.gz 2024-09-15T12:35:57.334 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.62789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35297.log 2024-09-15T12:35:57.334 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62789.log.gz 2024-09-15T12:35:57.334 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.70677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61778.log 2024-09-15T12:35:57.334 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.70677.log.gz 2024-09-15T12:35:57.334 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70929.log 2024-09-15T12:35:57.335 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.35297.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35297.log.gz 2024-09-15T12:35:57.335 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.61778.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61778.log.gz 2024-09-15T12:35:57.335 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45807.log 2024-09-15T12:35:57.335 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53024.log 2024-09-15T12:35:57.335 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.70929.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.70929.log.gz 2024-09-15T12:35:57.335 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45807.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45807.log.gz 2024-09-15T12:35:57.335 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41522.log 2024-09-15T12:35:57.335 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31476.log 2024-09-15T12:35:57.335 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.53024.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53024.log.gz 2024-09-15T12:35:57.335 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47815.log 2024-09-15T12:35:57.335 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41522.log.gz 2024-09-15T12:35:57.335 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36398.log 2024-09-15T12:35:57.335 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31476.log.gz 2024-09-15T12:35:57.335 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.47815.log: -- /var/log/ceph/ceph-client.admin.61738.log 2024-09-15T12:35:57.335 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47815.log.gz 2024-09-15T12:35:57.336 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.36398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68661.log 2024-09-15T12:35:57.336 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36398.log.gz 2024-09-15T12:35:57.336 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.61738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68483.log 2024-09-15T12:35:57.336 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61738.log.gz 2024-09-15T12:35:57.336 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40802.log 2024-09-15T12:35:57.336 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.68661.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.68661.log.gz 2024-09-15T12:35:57.336 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.68483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43395.log 2024-09-15T12:35:57.336 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.68483.log.gz 2024-09-15T12:35:57.336 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50134.log 2024-09-15T12:35:57.336 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40802.log.gz 2024-09-15T12:35:57.336 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57937.log 2024-09-15T12:35:57.336 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43395.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43395.log.gz 2024-09-15T12:35:57.336 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45439.log 2024-09-15T12:35:57.336 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50134.log.gz 2024-09-15T12:35:57.337 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.57937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37811.log 2024-09-15T12:35:57.337 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57937.log.gz 2024-09-15T12:35:57.337 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29582.log 2024-09-15T12:35:57.337 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45439.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45439.log.gz 2024-09-15T12:35:57.337 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57437.log 2024-09-15T12:35:57.337 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37811.log.gz 2024-09-15T12:35:57.337 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.29582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51050.log 2024-09-15T12:35:57.337 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29582.log.gz 2024-09-15T12:35:57.337 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47766.log 2024-09-15T12:35:57.337 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.57437.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57437.log.gz 2024-09-15T12:35:57.337 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51050.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51050.log.gz 2024-09-15T12:35:57.337 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51853.log 2024-09-15T12:35:57.337 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66131.log 2024-09-15T12:35:57.337 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47766.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47766.log.gz 2024-09-15T12:35:57.337 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42369.log 2024-09-15T12:35:57.338 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51853.log.gz 2024-09-15T12:35:57.338 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.66131.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66131.log.gz 2024-09-15T12:35:57.338 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30358.log 2024-09-15T12:35:57.338 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54468.log 2024-09-15T12:35:57.338 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42369.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42369.log.gz 2024-09-15T12:35:57.338 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.30358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58433.log 2024-09-15T12:35:57.338 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30358.log.gz 2024-09-15T12:35:57.338 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.54468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34101.log 2024-09-15T12:35:57.338 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54468.log.gz 2024-09-15T12:35:57.338 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63308.log 2024-09-15T12:35:57.338 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.58433.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58433.log.gz 2024-09-15T12:35:57.338 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34101.log: gzip -5 --verbose -- 50.4% /var/log/ceph/ceph-client.admin.46829.log 2024-09-15T12:35:57.338 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34101.log.gz 2024-09-15T12:35:57.338 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33052.log 2024-09-15T12:35:57.339 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63308.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63308.log.gz 2024-09-15T12:35:57.339 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64760.log 2024-09-15T12:35:57.339 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46829.log.gz 2024-09-15T12:35:57.339 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31516.log 2024-09-15T12:35:57.339 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33052.log.gz 2024-09-15T12:35:57.339 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52984.log 2024-09-15T12:35:57.339 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64760.log.gz 2024-09-15T12:35:57.339 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68710.log 2024-09-15T12:35:57.339 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31516.log.gz 2024-09-15T12:35:57.339 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42639.log 2024-09-15T12:35:57.339 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52984.log.gz 2024-09-15T12:35:57.339 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33094.log 2024-09-15T12:35:57.339 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.68710.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.68710.log.gz 2024-09-15T12:35:57.339 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58384.log 2024-09-15T12:35:57.339 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42639.log.gz 2024-09-15T12:35:57.339 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62701.log 2024-09-15T12:35:57.340 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33094.log.gz 2024-09-15T12:35:57.340 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.58384.log: 49.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.58384.log.gz 2024-09-15T12:35:57.340 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.64175.log 2024-09-15T12:35:57.340 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30170.log 2024-09-15T12:35:57.340 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.62701.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62701.log.gz 2024-09-15T12:35:57.340 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64720.log 2024-09-15T12:35:57.340 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64175.log.gz 2024-09-15T12:35:57.340 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.30170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49467.log 2024-09-15T12:35:57.340 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30170.log.gz 2024-09-15T12:35:57.340 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30929.log 2024-09-15T12:35:57.340 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64720.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64720.log.gz 2024-09-15T12:35:57.340 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66658.log 2024-09-15T12:35:57.340 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49467.log.gz 2024-09-15T12:35:57.340 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.30929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46600.log 2024-09-15T12:35:57.340 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30929.log.gz 2024-09-15T12:35:57.340 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38734.log 2024-09-15T12:35:57.341 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.66658.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66658.log.gz 2024-09-15T12:35:57.341 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33185.log 2024-09-15T12:35:57.341 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46600.log.gz 2024-09-15T12:35:57.341 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63099.log 2024-09-15T12:35:57.341 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38734.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38734.log.gz 2024-09-15T12:35:57.341 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70803.log 2024-09-15T12:35:57.341 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33185.log.gz 2024-09-15T12:35:57.341 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56434.log 2024-09-15T12:35:57.341 INFO:teuthology.orchestra.run.smithi077.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.63099.log.gz 2024-09-15T12:35:57.341 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47365.log 2024-09-15T12:35:57.341 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.70803.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.70803.log.gz 2024-09-15T12:35:57.341 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.56434.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56434.log.gz 2024-09-15T12:35:57.341 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45235.log 2024-09-15T12:35:57.341 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53984.log 2024-09-15T12:35:57.341 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47365.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47365.log.gz 2024-09-15T12:35:57.341 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56274.log 2024-09-15T12:35:57.342 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45235.log.gz 2024-09-15T12:35:57.342 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.53984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42907.log 2024-09-15T12:35:57.342 INFO:teuthology.orchestra.run.smithi077.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.53984.log.gz 2024-09-15T12:35:57.342 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31646.log 2024-09-15T12:35:57.342 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.56274.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56274.log.gz 2024-09-15T12:35:57.342 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61512.log 2024-09-15T12:35:57.342 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42907.log.gz 2024-09-15T12:35:57.342 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66433.log 2024-09-15T12:35:57.342 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31646.log.gz 2024-09-15T12:35:57.342 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39693.log 2024-09-15T12:35:57.342 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.0.61512.log: /var/log/ceph/ceph-client.admin.66433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63357.log 2024-09-15T12:35:57.342 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66433.log.gz 2024-09-15T12:35:57.342 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.39693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50681.log 2024-09-15T12:35:57.342 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39693.log.gz 2024-09-15T12:35:57.342 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53479.log 2024-09-15T12:35:57.343 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63357.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63357.log.gz 2024-09-15T12:35:57.343 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58115.log 2024-09-15T12:35:57.343 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50681.log.gz 2024-09-15T12:35:57.343 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.53479.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53479.log.gz 2024-09-15T12:35:57.343 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45856.log 2024-09-15T12:35:57.343 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46038.log 2024-09-15T12:35:57.343 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.58115.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58115.log.gz 2024-09-15T12:35:57.343 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68443.log 2024-09-15T12:35:57.343 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45856.log.gz 2024-09-15T12:35:57.343 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46038.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46038.log.gz 2024-09-15T12:35:57.343 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50283.log 2024-09-15T12:35:57.343 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.68443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57986.log 2024-09-15T12:35:57.343 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.68443.log.gz 2024-09-15T12:35:57.343 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50283.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50283.log.gz 2024-09-15T12:35:57.343 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59322.log 2024-09-15T12:35:57.344 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64840.log 2024-09-15T12:35:57.344 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.57986.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.57986.log.gz 2024-09-15T12:35:57.344 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.59322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61511.log 2024-09-15T12:35:57.344 INFO:teuthology.orchestra.run.smithi077.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.59322.log.gz 2024-09-15T12:35:57.344 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30629.log 2024-09-15T12:35:57.344 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64840.log.gz 2024-09-15T12:35:57.344 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.61511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52321.log 2024-09-15T12:35:57.344 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61511.log.gz 2024-09-15T12:35:57.344 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.30629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67553.log 2024-09-15T12:35:57.344 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30629.log.gz 2024-09-15T12:35:57.344 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45317.log 2024-09-15T12:35:57.344 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52321.log.gz 2024-09-15T12:35:57.344 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.67553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29171.log 2024-09-15T12:35:57.344 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67553.log.gz 2024-09-15T12:35:57.345 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42180.log 2024-09-15T12:35:57.345 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45317.log.gz 2024-09-15T12:35:57.345 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.29171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50839.log 2024-09-15T12:35:57.345 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29171.log.gz 2024-09-15T12:35:57.345 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42180.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42180.log.gz 2024-09-15T12:35:57.345 INFO:teuthology.orchestra.run.smithi077.stderr: /var/log/ceph/ceph-client.admin.39378.log 2024-09-15T12:35:57.345 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50839.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50839.log.gz 2024-09-15T12:35:57.345 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46520.log 2024-09-15T12:35:57.345 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.39378.log: gzip -5 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39378.log.gz 2024-09-15T12:35:57.345 INFO:teuthology.orchestra.run.smithi077.stderr: --verbose -- /var/log/ceph/ceph-client.admin.55122.log 2024-09-15T12:35:57.345 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46520.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46520.log.gz 2024-09-15T12:35:57.345 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40041.log 2024-09-15T12:35:57.345 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5/var/log/ceph/ceph-client.admin.55122.log: --verbose -- /var/log/ceph/ceph-client.admin.58642.log 2024-09-15T12:35:57.345 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55122.log.gz 2024-09-15T12:35:57.345 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40041.log: gzip -5 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40041.log.gz 2024-09-15T12:35:57.346 INFO:teuthology.orchestra.run.smithi077.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51893.log 2024-09-15T12:35:57.346 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.58642.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58642.log.gz 2024-09-15T12:35:57.346 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50114.log 2024-09-15T12:35:57.346 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51893.log: gzip -5 --verbose 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51893.log.gz 2024-09-15T12:35:57.346 INFO:teuthology.orchestra.run.smithi077.stderr: -- /var/log/ceph/ceph-client.admin.36260.log 2024-09-15T12:35:57.346 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50114.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50114.log.gz 2024-09-15T12:35:57.346 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56999.log 2024-09-15T12:35:57.346 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58602.log 2024-09-15T12:35:57.346 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.36260.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36260.log.gz 2024-09-15T12:35:57.346 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5/var/log/ceph/ceph-client.admin.56999.log: --verbose -- /var/log/ceph/ceph-client.admin.66173.log 2024-09-15T12:35:57.346 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56999.log.gz 2024-09-15T12:35:57.346 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.58602.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58602.log.gz 2024-09-15T12:35:57.346 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32402.log 2024-09-15T12:35:57.346 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61996.log 2024-09-15T12:35:57.347 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.66173.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66173.log.gz 2024-09-15T12:35:57.347 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43655.log 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32402.log.gz 2024-09-15T12:35:57.347 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-09-15T12:35:57.347 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.61996.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61996.log.gz 2024-09-15T12:35:57.347 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52757.log 2024-09-15T12:35:57.347 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43655.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43655.log.gz 2024-09-15T12:35:57.347 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.60446.log 2024-09-15T12:35:57.347 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42458.log 2024-09-15T12:35:57.347 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52757.log.gz 2024-09-15T12:35:57.347 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.60446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66618.log 2024-09-15T12:35:57.347 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60446.log.gz 2024-09-15T12:35:57.347 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43222.log 2024-09-15T12:35:57.347 INFO:teuthology.orchestra.run.smithi077.stderr: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.42458.log.gz 2024-09-15T12:35:57.347 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.66618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61858.log 2024-09-15T12:35:57.347 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66618.log.gz 2024-09-15T12:35:57.348 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31338.log 2024-09-15T12:35:57.348 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43222.log.gz 2024-09-15T12:35:57.348 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.61858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61291.log 2024-09-15T12:35:57.348 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61858.log.gz 2024-09-15T12:35:57.348 INFO:teuthology.orchestra.run.smithi077.stderr:gzip/var/log/ceph/ceph-client.admin.31338.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.57517.log 2024-09-15T12:35:57.348 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31338.log.gz 2024-09-15T12:35:57.348 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.61291.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61291.log.gz 2024-09-15T12:35:57.348 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61598.log 2024-09-15T12:35:57.348 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.57517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33682.log 2024-09-15T12:35:57.348 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57517.log.gz 2024-09-15T12:35:57.348 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.61598.log: gzip 50.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.64402.log 2024-09-15T12:35:57.348 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61598.log.gz 2024-09-15T12:35:57.348 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65069.log 2024-09-15T12:35:57.348 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33682.log.gz 2024-09-15T12:35:57.348 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49249.log 2024-09-15T12:35:57.349 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64402.log.gz 2024-09-15T12:35:57.349 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65069.log: gzip -5 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65069.log.gz 2024-09-15T12:35:57.349 INFO:teuthology.orchestra.run.smithi077.stderr: --verbose -- /var/log/ceph/ceph-client.admin.30800.log 2024-09-15T12:35:57.349 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61005.log 2024-09-15T12:35:57.349 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49249.log.gz 2024-09-15T12:35:57.349 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.30800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63826.log 2024-09-15T12:35:57.349 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30800.log.gz 2024-09-15T12:35:57.349 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.61005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53851.log 2024-09-15T12:35:57.349 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61005.log.gz 2024-09-15T12:35:57.349 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64800.log 2024-09-15T12:35:57.349 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63826.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63826.log.gz 2024-09-15T12:35:57.349 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.53851.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53851.log.gz 2024-09-15T12:35:57.349 INFO:teuthology.orchestra.run.smithi077.stderr: /var/log/ceph/ceph-client.admin.41782.log 2024-09-15T12:35:57.349 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64800.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.64800.log.gz 2024-09-15T12:35:57.350 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60306.log 2024-09-15T12:35:57.350 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41782.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41782.log.gz 2024-09-15T12:35:57.350 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57755.log 2024-09-15T12:35:57.350 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.60306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34275.log 2024-09-15T12:35:57.350 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60306.log.gz 2024-09-15T12:35:57.350 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.57755.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57755.log.gz 2024-09-15T12:35:57.350 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-15T12:35:57.350 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69963.log 2024-09-15T12:35:57.350 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34275.log.gz 2024-09-15T12:35:57.350 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58740.log 2024-09-15T12:35:57.350 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.69963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30456.log 50.0% 2024-09-15T12:35:57.350 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69963.log.gz 2024-09-15T12:35:57.350 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.58740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70761.log 2024-09-15T12:35:57.350 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58740.log.gz 2024-09-15T12:35:57.350 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34948.log 2024-09-15T12:35:57.351 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.30456.log: /var/log/ceph/ceph-client.admin.70761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67998.log 2024-09-15T12:35:57.351 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.70761.log.gz 2024-09-15T12:35:57.351 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30456.log.gz 2024-09-15T12:35:57.351 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34948.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34948.log.gz 2024-09-15T12:35:57.351 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34326.log 2024-09-15T12:35:57.351 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-15T12:35:57.351 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37415.log 2024-09-15T12:35:57.351 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.67998.log: /var/log/ceph/ceph-client.admin.34326.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67998.log.gz 2024-09-15T12:35:57.351 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36438.log 2024-09-15T12:35:57.351 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34326.log.gz 2024-09-15T12:35:57.351 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56672.log 2024-09-15T12:35:57.351 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37415.log.gz 2024-09-15T12:35:57.351 INFO:teuthology.orchestra.run.smithi077.stderr:gzip/var/log/ceph/ceph-client.admin.36438.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.60348.log 2024-09-15T12:35:57.351 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36438.log.gz 2024-09-15T12:35:57.352 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.56672.log: gzip -5 --verbose 49.6% -- /var/log/ceph/ceph-client.admin.57177.log -- replaced with /var/log/ceph/ceph-client.admin.56672.log.gz 2024-09-15T12:35:57.352 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-09-15T12:35:57.352 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57615.log 2024-09-15T12:35:57.352 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.60348.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60348.log.gz 2024-09-15T12:35:57.352 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.57177.log: gzip 49.6% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.57177.log.gz -- 2024-09-15T12:35:57.352 INFO:teuthology.orchestra.run.smithi077.stderr: /var/log/ceph/ceph-client.admin.44053.log 2024-09-15T12:35:57.352 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.57615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46640.log 2024-09-15T12:35:57.352 INFO:teuthology.orchestra.run.smithi077.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.57615.log.gz 2024-09-15T12:35:57.352 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44053.log: gzip -5 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44053.log.gz 2024-09-15T12:35:57.352 INFO:teuthology.orchestra.run.smithi077.stderr: --verbose -- /var/log/ceph/ceph-client.admin.56008.log 2024-09-15T12:35:57.352 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46640.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46640.log.gz 2024-09-15T12:35:57.352 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.34590.log 2024-09-15T12:35:57.352 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.56008.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56008.log.gz 2024-09-15T12:35:57.352 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36478.log 2024-09-15T12:35:57.353 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41565.log 2024-09-15T12:35:57.353 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34590.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34590.log.gz 2024-09-15T12:35:57.353 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.36478.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36478.log.gz 2024-09-15T12:35:57.353 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.41249.log 2024-09-15T12:35:57.353 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64135.log 2024-09-15T12:35:57.353 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41565.log.gz 2024-09-15T12:35:57.353 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41249.log: gzip -5 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41249.log.gz 2024-09-15T12:35:57.353 INFO:teuthology.orchestra.run.smithi077.stderr: --verbose -- /var/log/ceph/ceph-client.admin.61689.log 2024-09-15T12:35:57.353 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64135.log: gzip -5 49.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.64135.log.gz 2024-09-15T12:35:57.353 INFO:teuthology.orchestra.run.smithi077.stderr: /var/log/ceph/ceph-client.admin.66698.log 2024-09-15T12:35:57.353 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.61689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67954.log 2024-09-15T12:35:57.353 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61689.log.gz 2024-09-15T12:35:57.353 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43875.log 2024-09-15T12:35:57.353 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.66698.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66698.log.gz 2024-09-15T12:35:57.353 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.67954.log: gzip -5 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67954.log.gz 2024-09-15T12:35:57.354 INFO:teuthology.orchestra.run.smithi077.stderr: --verbose -- /var/log/ceph/ceph-client.admin.70024.log 2024-09-15T12:35:57.354 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59837.log 2024-09-15T12:35:57.354 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43875.log.gz 2024-09-15T12:35:57.354 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.70024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45667.log 2024-09-15T12:35:57.354 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.70024.log.gz 2024-09-15T12:35:57.354 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.59837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31267.log 2024-09-15T12:35:57.354 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59837.log.gz 2024-09-15T12:35:57.354 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50641.log 2024-09-15T12:35:57.354 INFO:teuthology.orchestra.run.smithi077.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.45667.log.gz 2024-09-15T12:35:57.354 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52281.log 2024-09-15T12:35:57.354 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31267.log.gz 2024-09-15T12:35:57.354 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56054.log 2024-09-15T12:35:57.354 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50641.log.gz 2024-09-15T12:35:57.354 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69084.log 2024-09-15T12:35:57.354 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52281.log.gz 2024-09-15T12:35:57.355 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.56054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52539.log 2024-09-15T12:35:57.355 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56054.log.gz 2024-09-15T12:35:57.355 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.69084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47047.log 2024-09-15T12:35:57.355 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.69084.log.gz 2024-09-15T12:35:57.355 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52579.log 2024-09-15T12:35:57.355 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52539.log.gz 2024-09-15T12:35:57.355 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49876.log 2024-09-15T12:35:57.355 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47047.log.gz 2024-09-15T12:35:57.355 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70341.log 2024-09-15T12:35:57.355 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52579.log.gz 2024-09-15T12:35:57.355 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33227.log 2024-09-15T12:35:57.355 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49876.log.gz 2024-09-15T12:35:57.355 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.70341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62265.log 2024-09-15T12:35:57.355 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.70341.log.gz 2024-09-15T12:35:57.355 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42089.log 2024-09-15T12:35:57.356 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33227.log.gz 2024-09-15T12:35:57.356 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.62265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53633.log 2024-09-15T12:35:57.356 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62265.log.gz 2024-09-15T12:35:57.356 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47136.log 2024-09-15T12:35:57.356 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42089.log.gz 2024-09-15T12:35:57.356 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.53633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32820.log 2024-09-15T12:35:57.356 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53633.log.gz 2024-09-15T12:35:57.356 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.47136.log: /var/log/ceph/ceph-client.admin.32540.log 2024-09-15T12:35:57.356 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47136.log.gz 2024-09-15T12:35:57.356 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32820.log: gzip -5 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32820.log.gz 2024-09-15T12:35:57.356 INFO:teuthology.orchestra.run.smithi077.stderr: --verbose -- /var/log/ceph/ceph-client.admin.34368.log 2024-09-15T12:35:57.356 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50065.log 2024-09-15T12:35:57.356 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32540.log.gz 2024-09-15T12:35:57.356 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34368.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48423.log 2024-09-15T12:35:57.357 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34368.log.gz 2024-09-15T12:35:57.357 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60844.log 2024-09-15T12:35:57.357 INFO:teuthology.orchestra.run.smithi077.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.50065.log.gz 2024-09-15T12:35:57.357 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30296.log 2024-09-15T12:35:57.357 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48423.log.gz 2024-09-15T12:35:57.357 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.60844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57257.log 2024-09-15T12:35:57.357 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60844.log.gz 2024-09-15T12:35:57.357 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.30296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63686.log 2024-09-15T12:35:57.357 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30296.log.gz 2024-09-15T12:35:57.357 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.57257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40565.log 2024-09-15T12:35:57.357 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57257.log.gz 2024-09-15T12:35:57.357 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60257.log 2024-09-15T12:35:57.357 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63686.log.gz 2024-09-15T12:35:57.357 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42598.log 2024-09-15T12:35:57.358 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40565.log.gz 2024-09-15T12:35:57.358 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.60257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60884.log 2024-09-15T12:35:57.358 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60257.log.gz 2024-09-15T12:35:57.358 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44013.log 2024-09-15T12:35:57.358 INFO:teuthology.orchestra.run.smithi077.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42598.log.gz 2024-09-15T12:35:57.358 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.60884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55967.log 2024-09-15T12:35:57.358 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60884.log.gz 2024-09-15T12:35:57.358 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51491.log 2024-09-15T12:35:57.358 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44013.log.gz 2024-09-15T12:35:57.358 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.55967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54101.log 2024-09-15T12:35:57.358 INFO:teuthology.orchestra.run.smithi077.stderr: 50.8% -- replaced with /var/log/ceph/ceph-client.admin.55967.log.gz 2024-09-15T12:35:57.358 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41027.log 2024-09-15T12:35:57.358 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51491.log.gz 2024-09-15T12:35:57.358 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.0.54101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37057.log 2024-09-15T12:35:57.358 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41027.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41027.log.gz 2024-09-15T12:35:57.359 INFO:teuthology.orchestra.run.smithi077.stderr: /var/log/ceph/ceph-client.admin.53193.log 2024-09-15T12:35:57.359 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37057.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.37057.log.gz 2024-09-15T12:35:57.359 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53673.log 2024-09-15T12:35:57.359 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.53193.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53193.log.gz 2024-09-15T12:35:57.359 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58493.log 2024-09-15T12:35:57.359 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33920.log 2024-09-15T12:35:57.359 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.53673.log: /var/log/ceph/ceph-client.admin.58493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69686.log 2024-09-15T12:35:57.359 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58493.log.gz 2024-09-15T12:35:57.359 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53673.log.gz 2024-09-15T12:35:57.359 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33920.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33920.log.gz 2024-09-15T12:35:57.359 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48513.log 2024-09-15T12:35:57.359 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.69686.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40300.log 2024-09-15T12:35:57.359 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69686.log.gz 2024-09-15T12:35:57.359 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46689.log 2024-09-15T12:35:57.360 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48513.log.gz 2024-09-15T12:35:57.360 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59151.log 2024-09-15T12:35:57.360 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40300.log: /var/log/ceph/ceph-client.admin.46689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41111.log 2024-09-15T12:35:57.360 INFO:teuthology.orchestra.run.smithi077.stderr: 49.2% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46689.log.gz 2024-09-15T12:35:57.360 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40300.log.gz 2024-09-15T12:35:57.360 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.59151.log: 48.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31058.log 2024-09-15T12:35:57.360 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59151.log.gz 2024-09-15T12:35:57.360 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39733.log 2024-09-15T12:35:57.360 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41111.log.gz 2024-09-15T12:35:57.360 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48472.log 2024-09-15T12:35:57.360 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31058.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31058.log.gz 2024-09-15T12:35:57.360 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37504.log 2024-09-15T12:35:57.360 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.39733.log: /var/log/ceph/ceph-client.admin.48472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35911.log 2024-09-15T12:35:57.360 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48472.log.gz 2024-09-15T12:35:57.361 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39733.log.gz 2024-09-15T12:35:57.361 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37504.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37504.log.gz 2024-09-15T12:35:57.361 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38983.log 2024-09-15T12:35:57.361 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69375.log 2024-09-15T12:35:57.361 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.35911.log: /var/log/ceph/ceph-client.admin.38983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64273.log 2024-09-15T12:35:57.361 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35911.log.gz 2024-09-15T12:35:57.361 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38983.log.gz 2024-09-15T12:35:57.361 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.69375.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.69375.log.gz 2024-09-15T12:35:57.361 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.57135.log 2024-09-15T12:35:57.361 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64273.log: 49.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31556.log 2024-09-15T12:35:57.361 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64273.log.gz 2024-09-15T12:35:57.361 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.57135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53551.log 2024-09-15T12:35:57.361 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57135.log.gz 2024-09-15T12:35:57.361 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43435.log 2024-09-15T12:35:57.361 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31556.log: /var/log/ceph/ceph-client.admin.53551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56612.log 2024-09-15T12:35:57.362 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53551.log.gz 2024-09-15T12:35:57.362 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31556.log.gz 2024-09-15T12:35:57.362 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43435.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37455.log 2024-09-15T12:35:57.362 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43435.log.gz 2024-09-15T12:35:57.362 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.56612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36051.log 2024-09-15T12:35:57.362 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56612.log.gz 2024-09-15T12:35:57.362 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61878.log 2024-09-15T12:35:57.362 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37455.log: /var/log/ceph/ceph-client.admin.36051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29765.log 2024-09-15T12:35:57.362 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37455.log.gz 2024-09-15T12:35:57.362 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36051.log.gz 2024-09-15T12:35:57.362 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.61878.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61878.log.gz 2024-09-15T12:35:57.362 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46898.log 2024-09-15T12:35:57.362 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.29765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70171.log 2024-09-15T12:35:57.362 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29765.log.gz 2024-09-15T12:35:57.362 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46898.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46898.log.gz 2024-09-15T12:35:57.363 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39400.log 2024-09-15T12:35:57.363 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68920.log 2024-09-15T12:35:57.363 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.70171.log: /var/log/ceph/ceph-client.admin.39400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39161.log 2024-09-15T12:35:57.363 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39400.log.gz 2024-09-15T12:35:57.363 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70171.log.gz 2024-09-15T12:35:57.363 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.68920.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41880.log 2024-09-15T12:35:57.363 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68920.log.gz 2024-09-15T12:35:57.363 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.39161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69459.log 2024-09-15T12:35:57.363 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39161.log.gz 2024-09-15T12:35:57.363 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68878.log 2024-09-15T12:35:57.363 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41880.log: /var/log/ceph/ceph-client.admin.69459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47547.log 2024-09-15T12:35:57.363 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41880.log.gz 49.6% -- replaced with /var/log/ceph/ceph-client.admin.69459.log.gz 2024-09-15T12:35:57.363 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-09-15T12:35:57.364 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.68878.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.68878.log.gz 2024-09-15T12:35:57.364 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33962.log 2024-09-15T12:35:57.364 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48605.log 2024-09-15T12:35:57.364 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47547.log: gzip/var/log/ceph/ceph-client.admin.33962.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.55213.log 2024-09-15T12:35:57.364 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47547.log.gz 2024-09-15T12:35:57.364 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33962.log.gz 2024-09-15T12:35:57.364 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62225.log 2024-09-15T12:35:57.364 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48605.log.gz 2024-09-15T12:35:57.364 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.55213.log: gzip -5 --verbose -- 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55213.log.gz 2024-09-15T12:35:57.364 INFO:teuthology.orchestra.run.smithi077.stderr: /var/log/ceph/ceph-client.admin.56394.log 2024-09-15T12:35:57.364 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.62225.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62225.log.gz 2024-09-15T12:35:57.364 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34993.log 2024-09-15T12:35:57.364 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.56394.log: gzip -5 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56394.log.gz 2024-09-15T12:35:57.364 INFO:teuthology.orchestra.run.smithi077.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48163.log 2024-09-15T12:35:57.364 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34993.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34993.log.gz 2024-09-15T12:35:57.365 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54686.log 2024-09-15T12:35:57.365 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68752.log 2024-09-15T12:35:57.365 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48163.log: /var/log/ceph/ceph-client.admin.54686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67162.log 2024-09-15T12:35:57.365 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54686.log.gz 2024-09-15T12:35:57.365 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48163.log.gz 2024-09-15T12:35:57.365 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.68752.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.68752.log.gz 2024-09-15T12:35:57.365 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37860.log 2024-09-15T12:35:57.365 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.67162.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52886.log 2024-09-15T12:35:57.365 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67162.log.gz 2024-09-15T12:35:57.365 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58075.log 2024-09-15T12:35:57.365 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37860.log.gz 2024-09-15T12:35:57.365 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29935.log 2024-09-15T12:35:57.365 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52886.log: /var/log/ceph/ceph-client.admin.58075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69501.log 2024-09-15T12:35:57.365 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52886.log.gz 2024-09-15T12:35:57.366 INFO:teuthology.orchestra.run.smithi077.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.58075.log.gz 2024-09-15T12:35:57.366 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30455.log 2024-09-15T12:35:57.366 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.29935.log: /var/log/ceph/ceph-client.admin.69501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41831.log 2024-09-15T12:35:57.366 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29935.log.gz -- replaced with /var/log/ceph/ceph-client.admin.69501.log.gz 2024-09-15T12:35:57.366 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-09-15T12:35:57.366 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.30455.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30455.log.gz 2024-09-15T12:35:57.366 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66033.log 2024-09-15T12:35:57.366 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41831.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41831.log.gz 2024-09-15T12:35:57.366 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55831.log 2024-09-15T12:35:57.366 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.66033.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66033.log.gz 2024-09-15T12:35:57.366 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35555.log 2024-09-15T12:35:57.366 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60066.log 2024-09-15T12:35:57.366 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.55831.log: gzip/var/log/ceph/ceph-client.admin.35555.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.55171.log 2024-09-15T12:35:57.366 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55831.log.gz 2024-09-15T12:35:57.367 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35555.log.gz 2024-09-15T12:35:57.367 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.60066.log: gzip -5 --verbose 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60066.log.gz 2024-09-15T12:35:57.367 INFO:teuthology.orchestra.run.smithi077.stderr: -- /var/log/ceph/ceph-client.admin.34011.log 2024-09-15T12:35:57.367 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.55171.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60556.log 2024-09-15T12:35:57.367 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55171.log.gz 2024-09-15T12:35:57.367 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71011.log 2024-09-15T12:35:57.367 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34011.log.gz 2024-09-15T12:35:57.367 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49645.log 2024-09-15T12:35:57.367 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.60556.log: /var/log/ceph/ceph-client.admin.71011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65287.log 2024-09-15T12:35:57.367 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.71011.log.gz 2024-09-15T12:35:57.367 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60556.log.gz 2024-09-15T12:35:57.367 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49645.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49645.log.gz 2024-09-15T12:35:57.367 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35255.log 2024-09-15T12:35:57.367 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65287.log: gzip -5 --verbose -- 49.2% -- replaced with /var/log/ceph/ceph-client.admin.65287.log.gz 2024-09-15T12:35:57.367 INFO:teuthology.orchestra.run.smithi077.stderr: /var/log/ceph/ceph-client.admin.41698.log 2024-09-15T12:35:57.368 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.35255.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35255.log.gz 2024-09-15T12:35:57.368 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37722.log 2024-09-15T12:35:57.368 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41698.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41698.log.gz 2024-09-15T12:35:57.368 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49834.log 2024-09-15T12:35:57.368 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47499.log 2024-09-15T12:35:57.368 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37722.log: /var/log/ceph/ceph-client.admin.49834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70299.log 2024-09-15T12:35:57.368 INFO:teuthology.orchestra.run.smithi077.stderr: 50.4% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49834.log.gz 2024-09-15T12:35:57.368 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37722.log.gz 2024-09-15T12:35:57.368 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47499.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47499.log.gz 2024-09-15T12:35:57.368 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46967.log 2024-09-15T12:35:57.368 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.70299.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.70299.log.gz 2024-09-15T12:35:57.368 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39291.log 2024-09-15T12:35:57.368 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46967.log: gzip -5 --verbose 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46967.log.gz 2024-09-15T12:35:57.368 INFO:teuthology.orchestra.run.smithi077.stderr: -- /var/log/ceph/ceph-client.admin.36309.log 2024-09-15T12:35:57.368 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.39291.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39291.log.gz 2024-09-15T12:35:57.369 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.41431.log 2024-09-15T12:35:57.369 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.36309.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36309.log.gz 2024-09-15T12:35:57.369 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40521.log 2024-09-15T12:35:57.369 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41431.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41431.log.gz 2024-09-15T12:35:57.369 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55769.log 2024-09-15T12:35:57.369 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44961.log 2024-09-15T12:35:57.369 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40521.log: /var/log/ceph/ceph-client.admin.55769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68836.log 2024-09-15T12:35:57.369 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55769.log.gz 2024-09-15T12:35:57.369 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40521.log.gz 2024-09-15T12:35:57.369 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44961.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44961.log.gz 2024-09-15T12:35:57.369 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69795.log 2024-09-15T12:35:57.369 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.68836.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.68836.log.gz 2024-09-15T12:35:57.369 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60795.log 2024-09-15T12:35:57.369 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.69795.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.69795.log.gz 2024-09-15T12:35:57.370 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67595.log 2024-09-15T12:35:57.370 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5/var/log/ceph/ceph-client.admin.60795.log: --verbose -- /var/log/ceph/ceph-client.admin.30713.log 2024-09-15T12:35:57.370 INFO:teuthology.orchestra.run.smithi077.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.60795.log.gz 2024-09-15T12:35:57.370 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.67595.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.67595.log.gz 2024-09-15T12:35:57.370 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58880.log 2024-09-15T12:35:57.370 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.30713.log: -- /var/log/ceph/ceph-client.admin.64978.log 2024-09-15T12:35:57.370 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30713.log.gz 2024-09-15T12:35:57.370 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.58880.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58880.log.gz 2024-09-15T12:35:57.370 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32442.log 2024-09-15T12:35:57.370 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64978.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64978.log.gz 2024-09-15T12:35:57.370 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49694.log 2024-09-15T12:35:57.370 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58313.log 2024-09-15T12:35:57.370 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32442.log: /var/log/ceph/ceph-client.admin.49694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58196.log 2024-09-15T12:35:57.370 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32442.log.gz 2024-09-15T12:35:57.370 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49694.log.gz 2024-09-15T12:35:57.371 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43262.log 2024-09-15T12:35:57.371 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.58313.log: /var/log/ceph/ceph-client.admin.58196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29876.log 2024-09-15T12:35:57.371 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58313.log.gz 2024-09-15T12:35:57.371 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58196.log.gz 2024-09-15T12:35:57.371 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43262.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43262.log.gz 2024-09-15T12:35:57.371 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60397.log 2024-09-15T12:35:57.371 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36567.log 2024-09-15T12:35:57.371 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.29876.log: /var/log/ceph/ceph-client.admin.60397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46738.log 2024-09-15T12:35:57.371 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29876.log.gz 2024-09-15T12:35:57.371 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60397.log.gz 2024-09-15T12:35:57.371 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.36567.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36567.log.gz 2024-09-15T12:35:57.371 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53242.log 2024-09-15T12:35:57.371 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56951.log 2024-09-15T12:35:57.371 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46738.log: /var/log/ceph/ceph-client.admin.53242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62959.log 2024-09-15T12:35:57.371 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53242.log.gz 2024-09-15T12:35:57.372 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46738.log.gz 2024-09-15T12:35:57.372 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.56951.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56951.log.gz 2024-09-15T12:35:57.372 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58782.log 2024-09-15T12:35:57.372 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.62959.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62959.log.gz 2024-09-15T12:35:57.372 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46142.log 2024-09-15T12:35:57.372 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.58782.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33269.log 2024-09-15T12:35:57.372 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58782.log.gz 2024-09-15T12:35:57.372 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53912.log 2024-09-15T12:35:57.372 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46142.log.gz 2024-09-15T12:35:57.372 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67864.log 2024-09-15T12:35:57.372 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33269.log: /var/log/ceph/ceph-client.admin.53912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35037.log 2024-09-15T12:35:57.372 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53912.log.gz 2024-09-15T12:35:57.372 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33269.log.gz 2024-09-15T12:35:57.372 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.67864.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.67864.log.gz 2024-09-15T12:35:57.373 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46878.log 2024-09-15T12:35:57.373 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43895.log 2024-09-15T12:35:57.373 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.35037.log: /var/log/ceph/ceph-client.admin.46878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66480.log 2024-09-15T12:35:57.373 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35037.log.gz 2024-09-15T12:35:57.373 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46878.log.gz 2024-09-15T12:35:57.373 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32093.log 2024-09-15T12:35:57.373 INFO:teuthology.orchestra.run.smithi077.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.43895.log.gz 2024-09-15T12:35:57.373 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43704.log 2024-09-15T12:35:57.373 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.66480.log: /var/log/ceph/ceph-client.admin.32093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66738.log 2024-09-15T12:35:57.373 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66480.log.gz 2024-09-15T12:35:57.373 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32093.log.gz 2024-09-15T12:35:57.373 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68305.log 2024-09-15T12:35:57.373 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43704.log: /var/log/ceph/ceph-client.admin.66738.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34235.log 2024-09-15T12:35:57.374 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43704.log.gz 2024-09-15T12:35:57.374 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66738.log.gz 2024-09-15T12:35:57.374 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.68305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51228.log 2024-09-15T12:35:57.374 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.68305.log.gz 2024-09-15T12:35:57.374 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34235.log: gzip -5 --verbose -- 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34235.log.gz 2024-09-15T12:35:57.374 INFO:teuthology.orchestra.run.smithi077.stderr: /var/log/ceph/ceph-client.admin.47906.log 2024-09-15T12:35:57.374 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51228.log: 50.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67067.log 2024-09-15T12:35:57.374 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51228.log.gz 2024-09-15T12:35:57.374 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53802.log 2024-09-15T12:35:57.374 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47906.log.gz 2024-09-15T12:35:57.374 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67486.log 2024-09-15T12:35:57.374 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.67067.log: /var/log/ceph/ceph-client.admin.53802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29766.log 2024-09-15T12:35:57.374 INFO:teuthology.orchestra.run.smithi077.stderr: 47.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53802.log.gz 2024-09-15T12:35:57.374 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67067.log.gz 2024-09-15T12:35:57.374 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.67486.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42682.log 2024-09-15T12:35:57.375 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67486.log.gz 2024-09-15T12:35:57.375 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.29766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49169.log 2024-09-15T12:35:57.375 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29766.log.gz 2024-09-15T12:35:57.375 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56532.log 2024-09-15T12:35:57.375 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42682.log: /var/log/ceph/ceph-client.admin.49169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50910.log 2024-09-15T12:35:57.375 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42682.log.gz 2024-09-15T12:35:57.375 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49169.log.gz/var/log/ceph/ceph-client.admin.56532.log: 2024-09-15T12:35:57.375 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56532.log.gz 2024-09-15T12:35:57.375 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67675.log 2024-09-15T12:35:57.375 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50910.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50910.log.gz 2024-09-15T12:35:57.375 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59062.log 2024-09-15T12:35:57.375 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41151.log 2024-09-15T12:35:57.375 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.67675.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.59062.log: /var/log/ceph/ceph-client.admin.54815.log 2024-09-15T12:35:57.375 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67675.log.gz 2024-09-15T12:35:57.375 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59062.log.gz 2024-09-15T12:35:57.376 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36707.log 2024-09-15T12:35:57.376 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.54815.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41151.log.gz 2024-09-15T12:35:57.376 INFO:teuthology.orchestra.run.smithi077.stderr:gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54815.log.gz 2024-09-15T12:35:57.376 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42278.log 2024-09-15T12:35:57.376 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.36707.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36707.log.gz 2024-09-15T12:35:57.376 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69585.log 2024-09-15T12:35:57.376 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42278.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31975.log 2024-09-15T12:35:57.376 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42278.log.gz 2024-09-15T12:35:57.376 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.69585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49080.log 2024-09-15T12:35:57.376 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.69585.log.gz 2024-09-15T12:35:57.376 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55402.log 2024-09-15T12:35:57.376 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56870.log/var/log/ceph/ceph-client.admin.49080.log: 2024-09-15T12:35:57.376 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31975.log.gz 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49080.log.gz 2024-09-15T12:35:57.376 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-09-15T12:35:57.377 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.55402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66372.log 2024-09-15T12:35:57.377 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55402.log.gz 2024-09-15T12:35:57.377 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.56870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29768.log 2024-09-15T12:35:57.377 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56870.log.gz 2024-09-15T12:35:57.377 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59748.log 2024-09-15T12:35:57.377 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.66372.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66372.log.gz 2024-09-15T12:35:57.377 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58136.log 2024-09-15T12:35:57.377 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.29768.log: /var/log/ceph/ceph-client.admin.59748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54884.log 2024-09-15T12:35:57.377 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59748.log.gz 2024-09-15T12:35:57.377 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29768.log.gz 2024-09-15T12:35:57.377 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.58136.log: 49.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65645.log 2024-09-15T12:35:57.377 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58136.log.gz 2024-09-15T12:35:57.377 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.54884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63777.log 2024-09-15T12:35:57.378 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54884.log.gz 2024-09-15T12:35:57.378 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68128.log 2024-09-15T12:35:57.378 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65645.log: /var/log/ceph/ceph-client.admin.63777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63406.log 2024-09-15T12:35:57.378 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63777.log.gz 2024-09-15T12:35:57.378 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65645.log.gz 2024-09-15T12:35:57.378 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.68128.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.68128.log.gz 2024-09-15T12:35:57.378 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40661.log 2024-09-15T12:35:57.378 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63406.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63406.log.gz 2024-09-15T12:35:57.378 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.69164.log 2024-09-15T12:35:57.378 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40661.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40661.log.gz 2024-09-15T12:35:57.378 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49974.log 2024-09-15T12:35:57.378 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33311.log 2024-09-15T12:35:57.378 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.69164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30671.log 2024-09-15T12:35:57.379 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49974.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.69164.log.gz 2024-09-15T12:35:57.379 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49974.log.gz 2024-09-15T12:35:57.379 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62830.log 2024-09-15T12:35:57.379 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.30671.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33311.log.gz 2024-09-15T12:35:57.379 INFO:teuthology.orchestra.run.smithi077.stderr:gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30671.log.gz 2024-09-15T12:35:57.379 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44869.log 2024-09-15T12:35:57.379 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.62830.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62830.log.gz 2024-09-15T12:35:57.379 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37595.log 2024-09-15T12:35:57.379 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5/var/log/ceph/ceph-client.admin.44869.log: --verbose -- /var/log/ceph/ceph-client.admin.55660.log 2024-09-15T12:35:57.379 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44869.log.gz/var/log/ceph/ceph-client.admin.37595.log: 2024-09-15T12:35:57.379 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31875.log 2024-09-15T12:35:57.379 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37595.log.gz 2024-09-15T12:35:57.379 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39602.log 2024-09-15T12:35:57.379 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.55660.log: /var/log/ceph/ceph-client.admin.31875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50421.log 2024-09-15T12:35:57.379 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55660.log.gz 2024-09-15T12:35:57.380 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31875.log.gz 2024-09-15T12:35:57.380 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.39602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63875.log 2024-09-15T12:35:57.380 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39602.log.gz 2024-09-15T12:35:57.380 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32282.log 2024-09-15T12:35:57.380 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50421.log.gz 2024-09-15T12:35:57.380 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45470.log 2024-09-15T12:35:57.380 INFO:teuthology.orchestra.run.smithi077.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.63875.log.gz 2024-09-15T12:35:57.380 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70193.log 2024-09-15T12:35:57.380 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32282.log: /var/log/ceph/ceph-client.0.45470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43130.log 2024-09-15T12:35:57.380 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32282.log.gz 2024-09-15T12:35:57.380 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.70193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47675.log 2024-09-15T12:35:57.380 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.70193.log.gz 2024-09-15T12:35:57.380 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63188.log 2024-09-15T12:35:57.380 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47675.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43130.log.gz 2024-09-15T12:35:57.381 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47675.log.gz 2024-09-15T12:35:57.381 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-15T12:35:57.381 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65376.log 2024-09-15T12:35:57.381 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63188.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63188.log.gz 2024-09-15T12:35:57.381 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37327.log 2024-09-15T12:35:57.381 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65376.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65376.log.gz 2024-09-15T12:35:57.381 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57477.log 2024-09-15T12:35:57.381 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37327.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37327.log.gz 2024-09-15T12:35:57.381 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61242.log 2024-09-15T12:35:57.381 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.57477.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57477.log.gz 2024-09-15T12:35:57.381 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42767.log 2024-09-15T12:35:57.381 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.61242.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61242.log.gz 2024-09-15T12:35:57.381 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45905.log 2024-09-15T12:35:57.381 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42767.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42767.log.gz 2024-09-15T12:35:57.382 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61469.log 2024-09-15T12:35:57.382 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45905.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45905.log.gz 2024-09-15T12:35:57.382 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48254.log 2024-09-15T12:35:57.382 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.61469.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61469.log.gz 2024-09-15T12:35:57.382 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55918.log 2024-09-15T12:35:57.382 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48254.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48254.log.gz 2024-09-15T12:35:57.382 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35693.log 2024-09-15T12:35:57.382 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.55918.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55918.log.gz 2024-09-15T12:35:57.382 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32322.log 2024-09-15T12:35:57.382 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.35693.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35693.log.gz 2024-09-15T12:35:57.382 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36220.log 2024-09-15T12:35:57.382 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32322.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32322.log.gz 2024-09-15T12:35:57.382 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41740.log 2024-09-15T12:35:57.382 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.36220.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36220.log.gz 2024-09-15T12:35:57.382 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63497.log 2024-09-15T12:35:57.382 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41740.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41740.log.gz 2024-09-15T12:35:57.383 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59020.log 2024-09-15T12:35:57.383 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63497.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.63497.log.gz 2024-09-15T12:35:57.383 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34641.log 2024-09-15T12:35:57.383 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.59020.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59020.log.gz 2024-09-15T12:35:57.383 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50819.log 2024-09-15T12:35:57.383 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34641.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34641.log.gz 2024-09-15T12:35:57.383 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59977.log 2024-09-15T12:35:57.383 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50819.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50819.log.gz 2024-09-15T12:35:57.383 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47416.log 2024-09-15T12:35:57.383 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.59977.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59977.log.gz 2024-09-15T12:35:57.383 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62185.log 2024-09-15T12:35:57.383 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47416.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47416.log.gz 2024-09-15T12:35:57.383 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36616.log 2024-09-15T12:35:57.384 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.62185.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.62185.log.gz 2024-09-15T12:35:57.384 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47185.log 2024-09-15T12:35:57.384 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.36616.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36616.log.gz 2024-09-15T12:35:57.384 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50561.log 2024-09-15T12:35:57.384 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47185.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47185.log.gz 2024-09-15T12:35:57.384 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46214.log 2024-09-15T12:35:57.384 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50561.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50561.log.gz 2024-09-15T12:35:57.384 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59450.log 2024-09-15T12:35:57.384 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46214.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.46214.log.gz 2024-09-15T12:35:57.384 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64929.log 2024-09-15T12:35:57.384 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.59450.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59450.log.gz 2024-09-15T12:35:57.384 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29666.log 2024-09-15T12:35:57.384 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64929.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64929.log.gz 2024-09-15T12:35:57.384 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48081.log 2024-09-15T12:35:57.385 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.29666.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29666.log.gz 2024-09-15T12:35:57.385 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38805.log 2024-09-15T12:35:57.385 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48081.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.48081.log.gz 2024-09-15T12:35:57.385 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63228.log 2024-09-15T12:35:57.385 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38805.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.38805.log.gz 2024-09-15T12:35:57.385 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62039.log 2024-09-15T12:35:57.385 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63228.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63228.log.gz 2024-09-15T12:35:57.385 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45716.log 2024-09-15T12:35:57.385 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.62039.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62039.log.gz 2024-09-15T12:35:57.385 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69124.log 2024-09-15T12:35:57.385 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45716.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45716.log.gz 2024-09-15T12:35:57.385 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47087.log 2024-09-15T12:35:57.385 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.69124.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.69124.log.gz 2024-09-15T12:35:57.385 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48882.log 2024-09-15T12:35:57.385 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47087.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47087.log.gz 2024-09-15T12:35:57.386 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35954.log 2024-09-15T12:35:57.386 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48882.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48882.log.gz 2024-09-15T12:35:57.386 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34149.log 2024-09-15T12:35:57.386 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.35954.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35954.log.gz 2024-09-15T12:35:57.386 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50721.log 2024-09-15T12:35:57.386 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34149.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34149.log.gz 2024-09-15T12:35:57.386 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56652.log 2024-09-15T12:35:57.386 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50721.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50721.log.gz 2024-09-15T12:35:57.386 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32140.log 2024-09-15T12:35:57.386 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.56652.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56652.log.gz 2024-09-15T12:35:57.386 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70002.log 2024-09-15T12:35:57.386 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32140.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32140.log.gz 2024-09-15T12:35:57.386 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37682.log 2024-09-15T12:35:57.386 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.70002.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.70002.log.gz 2024-09-15T12:35:57.386 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30969.log 2024-09-15T12:35:57.386 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37682.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.37682.log.gz 2024-09-15T12:35:57.387 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55873.log 2024-09-15T12:35:57.387 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.30969.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30969.log.gz 2024-09-15T12:35:57.387 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68263.log 2024-09-15T12:35:57.387 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.55873.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55873.log.gz 2024-09-15T12:35:57.387 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30086.log 2024-09-15T12:35:57.387 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.68263.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.68263.log.gz 2024-09-15T12:35:57.387 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44411.log 2024-09-15T12:35:57.387 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.30086.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30086.log.gz 2024-09-15T12:35:57.387 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38525.log 2024-09-15T12:35:57.387 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44411.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44411.log.gz 2024-09-15T12:35:57.387 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39868.log 2024-09-15T12:35:57.387 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38525.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38525.log.gz 2024-09-15T12:35:57.387 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41960.log 2024-09-15T12:35:57.387 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.39868.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39868.log.gz 2024-09-15T12:35:57.387 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59257.log 2024-09-15T12:35:57.388 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41960.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41960.log.gz 2024-09-15T12:35:57.388 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67207.log 2024-09-15T12:35:57.388 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.59257.log: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.59257.log.gz 2024-09-15T12:35:57.388 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65952.log 2024-09-15T12:35:57.388 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.67207.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67207.log.gz 2024-09-15T12:35:57.388 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46389.log 2024-09-15T12:35:57.388 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65952.log: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.65952.log.gz 2024-09-15T12:35:57.388 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51268.log 2024-09-15T12:35:57.388 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46389.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46389.log.gz 2024-09-15T12:35:57.388 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67116.log 2024-09-15T12:35:57.388 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51268.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51268.log.gz 2024-09-15T12:35:57.388 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60166.log 2024-09-15T12:35:57.388 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.67116.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.67116.log.gz 2024-09-15T12:35:57.388 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38076.log 2024-09-15T12:35:57.388 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.60166.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.60166.log.gz 2024-09-15T12:35:57.388 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42558.log 2024-09-15T12:35:57.389 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38076.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38076.log.gz 2024-09-15T12:35:57.389 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70467.log 2024-09-15T12:35:57.389 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42558.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42558.log.gz 2024-09-15T12:35:57.389 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57657.log 2024-09-15T12:35:57.389 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.70467.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.70467.log.gz 2024-09-15T12:35:57.389 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30743.log 2024-09-15T12:35:57.389 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.57657.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.57657.log.gz 2024-09-15T12:35:57.389 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36770.log 2024-09-15T12:35:57.389 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.0.30743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70719.log 2024-09-15T12:35:57.389 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.36770.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36770.log.gz 2024-09-15T12:35:57.389 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66529.log 2024-09-15T12:35:57.389 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.70719.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.70719.log.gz 2024-09-15T12:35:57.391 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66311.log 2024-09-15T12:35:57.391 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.66529.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66529.log.gz 2024-09-15T12:35:57.392 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67340.log 2024-09-15T12:35:57.392 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.66311.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.66311.log.gz 2024-09-15T12:35:57.392 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52419.log 2024-09-15T12:35:57.392 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.67340.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67340.log.gz 2024-09-15T12:35:57.392 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48780.log 2024-09-15T12:35:57.392 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52419.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52419.log.gz 2024-09-15T12:35:57.392 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54946.log 2024-09-15T12:35:57.392 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48780.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48780.log.gz 2024-09-15T12:35:57.392 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42859.log 2024-09-15T12:35:57.392 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.54946.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.54946.log.gz 2024-09-15T12:35:57.392 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56176.log 2024-09-15T12:35:57.393 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42859.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42859.log.gz 2024-09-15T12:35:57.401 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40081.log 2024-09-15T12:35:57.402 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.56176.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56176.log.gz 2024-09-15T12:35:57.402 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34899.log 2024-09-15T12:35:57.402 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40081.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40081.log.gz 2024-09-15T12:35:57.413 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59237.log 2024-09-15T12:35:57.413 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34899.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34899.log.gz 2024-09-15T12:35:57.422 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62652.log 2024-09-15T12:35:57.422 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.59237.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59237.log.gz 2024-09-15T12:35:57.435 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32680.log 2024-09-15T12:35:57.435 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.62652.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62652.log.gz 2024-09-15T12:35:57.444 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65118.log 2024-09-15T12:35:57.444 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32680.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.32680.log.gz 2024-09-15T12:35:57.453 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49736.log 2024-09-15T12:35:57.465 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65118.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65118.log.gz 2024-09-15T12:35:57.469 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54428.log 2024-09-15T12:35:57.470 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49736.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49736.log.gz 2024-09-15T12:35:57.479 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37008.log 2024-09-15T12:35:57.492 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.54428.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54428.log.gz 2024-09-15T12:35:57.492 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51615.log 2024-09-15T12:35:57.493 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37008.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37008.log.gz 2024-09-15T12:35:57.504 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27843.log 2024-09-15T12:35:57.505 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51615.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51615.log.gz 2024-09-15T12:35:57.513 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69687.log 2024-09-15T12:35:57.523 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph.tmp-client.admin.27843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45576.log 2024-09-15T12:35:57.527 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.69687.log: 66.7% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27843.log.gz 2024-09-15T12:35:57.531 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66577.log 2024-09-15T12:35:57.536 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45576.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.69687.log.gz 2024-09-15T12:35:57.544 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45576.log.gz 2024-09-15T12:35:57.550 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44311.log 2024-09-15T12:35:57.551 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.66577.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66577.log.gz 2024-09-15T12:35:57.560 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35733.log 2024-09-15T12:35:57.569 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35117.log 2024-09-15T12:35:57.573 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.35733.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44311.log.gz 2024-09-15T12:35:57.582 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35733.log.gz 2024-09-15T12:35:57.582 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49785.log 2024-09-15T12:35:57.582 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.35117.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35117.log.gz 2024-09-15T12:35:57.589 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62523.log 2024-09-15T12:35:57.602 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49785.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49785.log.gz 2024-09-15T12:35:57.609 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48647.log 2024-09-15T12:35:57.609 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.62523.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62523.log.gz 2024-09-15T12:35:57.617 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58691.log 2024-09-15T12:35:57.620 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48647.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48647.log.gz 2024-09-15T12:35:57.626 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47633.log 2024-09-15T12:35:57.636 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.58691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54158.log 2024-09-15T12:35:57.636 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47633.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47633.log.gz 2024-09-15T12:35:57.639 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58691.log.gz 2024-09-15T12:35:57.644 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68046.log 2024-09-15T12:35:57.658 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.54158.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54158.log.gz 2024-09-15T12:35:57.661 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39063.log 2024-09-15T12:35:57.662 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.68046.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.68046.log.gz 2024-09-15T12:35:57.670 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64580.log 2024-09-15T12:35:57.680 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.39063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70425.log 2024-09-15T12:35:57.680 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64580.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.64580.log.gz 2024-09-15T12:35:57.684 INFO:teuthology.orchestra.run.smithi077.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.39063.log.gz 2024-09-15T12:35:57.688 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38392.log 2024-09-15T12:35:57.702 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.70425.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.70425.log.gz 2024-09-15T12:35:57.709 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64015.log 2024-09-15T12:35:57.709 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38392.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38392.log.gz 2024-09-15T12:35:57.724 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51973.log 2024-09-15T12:35:57.724 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64015.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.64015.log.gz 2024-09-15T12:35:57.733 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39463.log 2024-09-15T12:35:57.746 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51973.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.51973.log.gz 2024-09-15T12:35:57.751 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35515.log 2024-09-15T12:35:57.752 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.39463.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39463.log.gz 2024-09-15T12:35:57.760 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61818.log 2024-09-15T12:35:57.770 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.35515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49427.log 2024-09-15T12:35:57.770 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.61818.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61818.log.gz 2024-09-15T12:35:57.773 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35515.log.gz 2024-09-15T12:35:57.778 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57306.log 2024-09-15T12:35:57.788 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32860.log 2024-09-15T12:35:57.788 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.57306.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57306.log.gz 2024-09-15T12:35:57.792 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49427.log.gz 2024-09-15T12:35:57.801 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63008.log 2024-09-15T12:35:57.802 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32860.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32860.log.gz 2024-09-15T12:35:57.811 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42725.log 2024-09-15T12:35:57.812 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63008.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.63008.log.gz 2024-09-15T12:35:57.820 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58035.log 2024-09-15T12:35:57.833 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59668.log 2024-09-15T12:35:57.834 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.58035.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58035.log.gz 2024-09-15T12:35:57.834 INFO:teuthology.orchestra.run.smithi077.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42725.log.gz 2024-09-15T12:35:57.842 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36964.log 2024-09-15T12:35:57.855 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.59668.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59668.log.gz 2024-09-15T12:35:57.860 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48991.log 2024-09-15T12:35:57.860 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.36964.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36964.log.gz 2024-09-15T12:35:57.868 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48039.log 2024-09-15T12:35:57.878 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43475.log 2024-09-15T12:35:57.878 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48039.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48039.log.gz 2024-09-15T12:35:57.881 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48991.log.gz 2024-09-15T12:35:57.886 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32722.log 2024-09-15T12:35:57.899 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51575.log 2024-09-15T12:35:57.900 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32722.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32722.log.gz 2024-09-15T12:35:57.900 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43475.log.gz 2024-09-15T12:35:57.907 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-09-15T12:35:57.907 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33780.log 2024-09-15T12:35:57.917 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51575.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-15T12:35:57.917 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33780.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33780.log.gz 2024-09-15T12:35:57.921 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51575.log.gz 2024-09-15T12:35:57.929 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31596.log 2024-09-15T12:35:57.932 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph.log: 88.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-15T12:35:57.944 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60744.log 2024-09-15T12:35:57.944 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31596.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31596.log.gz 2024-09-15T12:35:57.954 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69207.log 2024-09-15T12:35:57.954 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.60744.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60744.log.gz 2024-09-15T12:35:57.974 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40942.log 2024-09-15T12:35:57.974 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.69207.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.69207.log.gz 2024-09-15T12:35:57.992 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52935.log 2024-09-15T12:35:57.992 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40942.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40942.log.gz 2024-09-15T12:35:58.001 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51406.log 2024-09-15T12:35:58.001 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52935.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52935.log.gz 2024-09-15T12:35:58.020 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29489.log 2024-09-15T12:35:58.020 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51406.log: 89.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-15T12:35:58.021 INFO:teuthology.orchestra.run.smithi077.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51406.log.gz 2024-09-15T12:35:58.021 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55451.log 2024-09-15T12:35:58.021 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.29489.log: 65.6% -- replaced with /var/log/ceph/ceph-client.admin.29489.log.gz 2024-09-15T12:35:58.021 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47948.log 2024-09-15T12:35:58.024 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.55451.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55451.log.gz 2024-09-15T12:35:58.024 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69853.log 2024-09-15T12:35:58.024 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47948.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47948.log.gz 2024-09-15T12:35:58.024 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44271.log 2024-09-15T12:35:58.024 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.69853.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.69853.log.gz 2024-09-15T12:35:58.024 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47227.log 2024-09-15T12:35:58.026 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44271.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44271.log.gz 2024-09-15T12:35:58.026 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61640.log 2024-09-15T12:35:58.026 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47227.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47227.log.gz 2024-09-15T12:35:58.026 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69333.log 2024-09-15T12:35:58.027 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.61640.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61640.log.gz 2024-09-15T12:35:58.029 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52062.log 2024-09-15T12:35:58.030 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.69333.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.69333.log.gz 2024-09-15T12:35:58.030 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42000.log 2024-09-15T12:35:58.030 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52062.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52062.log.gz 2024-09-15T12:35:58.030 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64055.log 2024-09-15T12:35:58.030 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42000.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42000.log.gz 2024-09-15T12:35:58.033 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37993.log 2024-09-15T12:35:58.033 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64055.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64055.log.gz 2024-09-15T12:35:58.033 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62742.log 2024-09-15T12:35:58.033 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37993.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37993.log.gz 2024-09-15T12:35:58.033 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49507.log 2024-09-15T12:35:58.033 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.62742.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62742.log.gz 2024-09-15T12:35:58.036 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36924.log 2024-09-15T12:35:58.036 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49507.log: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.49507.log.gz 2024-09-15T12:35:58.036 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67724.log 2024-09-15T12:35:58.036 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.36924.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36924.log.gz 2024-09-15T12:35:58.036 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33498.log 2024-09-15T12:35:58.038 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.67724.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67724.log.gz 2024-09-15T12:35:58.038 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69543.log 2024-09-15T12:35:58.039 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33498.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.33498.log.gz 2024-09-15T12:35:58.039 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44502.log 2024-09-15T12:35:58.039 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.69543.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.69543.log.gz 2024-09-15T12:35:58.041 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34857.log 2024-09-15T12:35:58.042 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44502.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44502.log.gz 2024-09-15T12:35:58.042 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62345.log 2024-09-15T12:35:58.042 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34857.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34857.log.gz 2024-09-15T12:35:58.042 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60208.log 2024-09-15T12:35:58.042 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.62345.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62345.log.gz 2024-09-15T12:35:58.044 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33331.log 2024-09-15T12:35:58.045 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.60208.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60208.log.gz 2024-09-15T12:35:58.045 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45052.log 2024-09-15T12:35:58.045 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33331.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33331.log.gz 2024-09-15T12:35:58.045 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32491.log 2024-09-15T12:35:58.047 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45052.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45052.log.gz 2024-09-15T12:35:58.047 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31387.log 2024-09-15T12:35:58.047 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32491.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32491.log.gz 2024-09-15T12:35:58.047 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63637.log 2024-09-15T12:35:58.065 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31387.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31387.log.gz 2024-09-15T12:35:58.065 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31835.log 2024-09-15T12:35:58.065 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63637.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63637.log.gz 2024-09-15T12:35:58.065 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39651.log 2024-09-15T12:35:58.065 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31835.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31835.log.gz 2024-09-15T12:35:58.066 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50196.log 2024-09-15T12:35:58.066 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.39651.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39651.log.gz 2024-09-15T12:35:58.066 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31107.log 2024-09-15T12:35:58.066 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50196.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50196.log.gz 2024-09-15T12:35:58.066 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36749.log 2024-09-15T12:35:58.066 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31107.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31107.log.gz 2024-09-15T12:35:58.066 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56572.log 2024-09-15T12:35:58.066 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.36749.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36749.log.gz 2024-09-15T12:35:58.066 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65565.log 2024-09-15T12:35:58.066 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.56572.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56572.log.gz 2024-09-15T12:35:58.066 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53375.log 2024-09-15T12:35:58.066 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65565.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65565.log.gz 2024-09-15T12:35:58.066 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44777.log 2024-09-15T12:35:58.066 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.53375.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53375.log.gz 2024-09-15T12:35:58.066 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30457.log 2024-09-15T12:35:58.067 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44777.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44777.log.gz 2024-09-15T12:35:58.067 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70593.log 2024-09-15T12:35:58.067 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.30457.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30457.log.gz 2024-09-15T12:35:58.067 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35653.log 2024-09-15T12:35:58.067 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.70593.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.70593.log.gz 2024-09-15T12:35:58.067 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59103.log 2024-09-15T12:35:58.067 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.35653.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35653.log.gz 2024-09-15T12:35:58.067 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70635.log 2024-09-15T12:35:58.067 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.59103.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59103.log.gz 2024-09-15T12:35:58.067 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37197.log 2024-09-15T12:35:58.067 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.70635.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.70635.log.gz 2024-09-15T12:35:58.067 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35206.log 2024-09-15T12:35:58.067 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37197.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37197.log.gz 2024-09-15T12:35:58.067 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69249.log 2024-09-15T12:35:58.075 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.35206.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35206.log.gz 2024-09-15T12:35:58.075 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54207.log 2024-09-15T12:35:58.076 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.69249.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.69249.log.gz 2024-09-15T12:35:58.076 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61102.log 2024-09-15T12:35:58.076 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.54207.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54207.log.gz 2024-09-15T12:35:58.076 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50372.log 2024-09-15T12:35:58.076 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.61102.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61102.log.gz 2024-09-15T12:35:58.076 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53417.log 2024-09-15T12:35:58.076 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50372.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50372.log.gz 2024-09-15T12:35:58.076 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40893.log 2024-09-15T12:35:58.076 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.53417.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53417.log.gz 2024-09-15T12:35:58.076 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50239.log 2024-09-15T12:35:58.076 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40893.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40893.log.gz 2024-09-15T12:35:58.076 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55033.log 2024-09-15T12:35:58.076 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50239.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50239.log.gz 2024-09-15T12:35:58.076 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44551.log 2024-09-15T12:35:58.076 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.55033.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55033.log.gz 2024-09-15T12:35:58.077 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52499.log 2024-09-15T12:35:58.077 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44551.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44551.log.gz 2024-09-15T12:35:58.082 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54606.log 2024-09-15T12:35:58.082 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52499.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52499.log.gz 2024-09-15T12:35:58.082 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52838.log 2024-09-15T12:35:58.082 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.54606.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54606.log.gz 2024-09-15T12:35:58.082 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29143.log 2024-09-15T12:35:58.082 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52838.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52838.log.gz 2024-09-15T12:35:58.082 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62136.log 2024-09-15T12:35:58.082 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.29143.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.29143.log.gz 2024-09-15T12:35:58.083 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58559.log 2024-09-15T12:35:58.083 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.62136.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62136.log.gz 2024-09-15T12:35:58.083 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40383.log 2024-09-15T12:35:58.083 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.58559.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58559.log.gz 2024-09-15T12:35:58.086 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39553.log 2024-09-15T12:35:58.086 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40383.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40383.log.gz 2024-09-15T12:35:58.087 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54070.log 2024-09-15T12:35:58.087 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.39553.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39553.log.gz 2024-09-15T12:35:58.087 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62603.log 2024-09-15T12:35:58.087 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.54070.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54070.log.gz 2024-09-15T12:35:58.087 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50463.log 2024-09-15T12:35:58.087 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.62603.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62603.log.gz 2024-09-15T12:35:58.091 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39112.log 2024-09-15T12:35:58.091 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50463.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50463.log.gz 2024-09-15T12:35:58.091 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70845.log 2024-09-15T12:35:58.091 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.39112.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39112.log.gz 2024-09-15T12:35:58.091 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35475.log 2024-09-15T12:35:58.091 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.70845.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.70845.log.gz 2024-09-15T12:35:58.091 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40752.log 2024-09-15T12:35:58.091 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.35475.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35475.log.gz 2024-09-15T12:35:58.094 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42956.log 2024-09-15T12:35:58.094 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40752.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40752.log.gz 2024-09-15T12:35:58.094 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51099.log 2024-09-15T12:35:58.094 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42956.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42956.log.gz 2024-09-15T12:35:58.094 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46780.log 2024-09-15T12:35:58.094 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51099.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.51099.log.gz 2024-09-15T12:35:58.099 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43355.log 2024-09-15T12:35:58.099 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46780.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46780.log.gz 2024-09-15T12:35:58.099 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50601.log 2024-09-15T12:35:58.100 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43355.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43355.log.gz 2024-09-15T12:35:58.100 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47591.log 2024-09-15T12:35:58.100 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50601.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.50601.log.gz 2024-09-15T12:35:58.100 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32233.log 2024-09-15T12:35:58.100 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47591.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47591.log.gz 2024-09-15T12:35:58.100 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57217.log 2024-09-15T12:35:58.100 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32233.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32233.log.gz 2024-09-15T12:35:58.104 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68962.log 2024-09-15T12:35:58.104 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.57217.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.57217.log.gz 2024-09-15T12:35:58.104 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34410.log 2024-09-15T12:35:58.104 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.68962.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.68962.log.gz 2024-09-15T12:35:58.104 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31198.log 2024-09-15T12:35:58.104 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34410.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34410.log.gz 2024-09-15T12:35:58.104 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50770.log 2024-09-15T12:35:58.104 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31198.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31198.log.gz 2024-09-15T12:35:58.108 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68612.log 2024-09-15T12:35:58.108 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50770.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.50770.log.gz 2024-09-15T12:35:58.108 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38230.log 2024-09-15T12:35:58.108 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.68612.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.68612.log.gz 2024-09-15T12:35:58.108 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44821.log 2024-09-15T12:35:58.108 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38230.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38230.log.gz 2024-09-15T12:35:58.108 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61142.log 2024-09-15T12:35:58.111 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44821.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44821.log.gz 2024-09-15T12:35:58.111 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35862.log 2024-09-15T12:35:58.111 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.61142.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61142.log.gz 2024-09-15T12:35:58.111 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36358.log 2024-09-15T12:35:58.111 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.35862.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.35862.log.gz 2024-09-15T12:35:58.111 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54557.log 2024-09-15T12:35:58.114 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.36358.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36358.log.gz 2024-09-15T12:35:58.114 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46080.log 2024-09-15T12:35:58.114 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.54557.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54557.log.gz 2024-09-15T12:35:58.114 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65327.log 2024-09-15T12:35:58.114 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46080.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46080.log.gz 2024-09-15T12:35:58.116 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59530.log 2024-09-15T12:35:58.116 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65327.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65327.log.gz 2024-09-15T12:35:58.117 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39511.log 2024-09-15T12:35:58.117 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.59530.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59530.log.gz 2024-09-15T12:35:58.117 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57397.log 2024-09-15T12:35:58.119 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.39511.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39511.log.gz 2024-09-15T12:35:58.119 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46122.log 2024-09-15T12:35:58.119 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.57397.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57397.log.gz 2024-09-15T12:35:58.119 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38574.log 2024-09-15T12:35:58.119 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46122.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46122.log.gz 2024-09-15T12:35:58.121 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38875.log 2024-09-15T12:35:58.121 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38574.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38574.log.gz 2024-09-15T12:35:58.121 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41648.log 2024-09-15T12:35:58.121 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38875.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38875.log.gz 2024-09-15T12:35:58.123 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36140.log 2024-09-15T12:35:58.124 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41648.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41648.log.gz 2024-09-15T12:35:58.124 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52199.log 2024-09-15T12:35:58.124 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.36140.log: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.36140.log.gz 2024-09-15T12:35:58.126 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67466.log 2024-09-15T12:35:58.126 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52199.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52199.log.gz 2024-09-15T12:35:58.126 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56890.log 2024-09-15T12:35:58.126 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.67466.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67466.log.gz 2024-09-15T12:35:58.128 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32631.log 2024-09-15T12:35:58.128 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.56890.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56890.log.gz 2024-09-15T12:35:58.128 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55531.log 2024-09-15T12:35:58.128 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32631.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32631.log.gz 2024-09-15T12:35:58.130 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67289.log 2024-09-15T12:35:58.130 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.55531.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55531.log.gz 2024-09-15T12:35:58.130 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45947.log 2024-09-15T12:35:58.130 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.67289.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67289.log.gz 2024-09-15T12:35:58.133 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70551.log 2024-09-15T12:35:58.133 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45947.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45947.log.gz 2024-09-15T12:35:58.133 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51713.log 2024-09-15T12:35:58.133 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.70551.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.70551.log.gz 2024-09-15T12:35:58.134 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44912.log 2024-09-15T12:35:58.134 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51713.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51713.log.gz 2024-09-15T12:35:58.136 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49925.log 2024-09-15T12:35:58.136 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44912.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44912.log.gz 2024-09-15T12:35:58.136 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67424.log 2024-09-15T12:35:58.136 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49925.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49925.log.gz 2024-09-15T12:35:58.136 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33591.log 2024-09-15T12:35:58.139 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.67424.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.67424.log.gz 2024-09-15T12:35:58.139 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61053.log 2024-09-15T12:35:58.139 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33591.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33591.log.gz 2024-09-15T12:35:58.139 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45132.log 2024-09-15T12:35:58.139 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.61053.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61053.log.gz 2024-09-15T12:35:58.142 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45338.log 2024-09-15T12:35:58.142 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45132.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45132.log.gz 2024-09-15T12:35:58.142 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54299.log 2024-09-15T12:35:58.142 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45338.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45338.log.gz 2024-09-15T12:35:58.142 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45765.log 2024-09-15T12:35:58.142 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.54299.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54299.log.gz 2024-09-15T12:35:58.145 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54993.log 2024-09-15T12:35:58.145 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45765.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45765.log.gz 2024-09-15T12:35:58.145 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51664.log 2024-09-15T12:35:58.145 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.54993.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.54993.log.gz 2024-09-15T12:35:58.145 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51804.log 2024-09-15T12:35:58.146 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51664.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51664.log.gz 2024-09-15T12:35:58.147 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52628.log 2024-09-15T12:35:58.147 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51804.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51804.log.gz 2024-09-15T12:35:58.148 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52241.log 2024-09-15T12:35:58.148 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52628.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.52628.log.gz 2024-09-15T12:35:58.149 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44711.log 2024-09-15T12:35:58.150 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52241.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52241.log.gz 2024-09-15T12:35:58.150 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55571.log 2024-09-15T12:35:58.150 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44711.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44711.log.gz 2024-09-15T12:35:58.152 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29400.log 2024-09-15T12:35:58.152 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.55571.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55571.log.gz 2024-09-15T12:35:58.152 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37106.log 2024-09-15T12:35:58.152 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.29400.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29400.log.gz 2024-09-15T12:35:58.154 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56096.log 2024-09-15T12:35:58.154 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37106.log: 48.4% -- replaced with /var/log/ceph/ceph-client.admin.37106.log.gz 2024-09-15T12:35:58.154 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66082.log 2024-09-15T12:35:58.154 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.56096.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56096.log.gz 2024-09-15T12:35:58.157 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38939.log 2024-09-15T12:35:58.157 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.66082.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66082.log.gz 2024-09-15T12:35:58.157 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64998.log 2024-09-15T12:35:58.157 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38939.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38939.log.gz 2024-09-15T12:35:58.158 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56483.log 2024-09-15T12:35:58.158 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64998.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.64998.log.gz 2024-09-15T12:35:58.161 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30849.log 2024-09-15T12:35:58.161 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.56483.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56483.log.gz 2024-09-15T12:35:58.161 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34550.log 2024-09-15T12:35:58.161 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.30849.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30849.log.gz 2024-09-15T12:35:58.161 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55073.log 2024-09-15T12:35:58.162 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34550.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34550.log.gz 2024-09-15T12:35:58.162 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63917.log 2024-09-15T12:35:58.164 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.55073.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.55073.log.gz 2024-09-15T12:35:58.164 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38434.log 2024-09-15T12:35:58.164 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63917.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63917.log.gz 2024-09-15T12:35:58.164 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37951.log 2024-09-15T12:35:58.164 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38434.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38434.log.gz 2024-09-15T12:35:58.167 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48374.log 2024-09-15T12:35:58.167 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37951.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37951.log.gz 2024-09-15T12:35:58.167 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35077.log 2024-09-15T12:35:58.167 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48374.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48374.log.gz 2024-09-15T12:35:58.167 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58831.log 2024-09-15T12:35:58.169 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.35077.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35077.log.gz 2024-09-15T12:35:58.169 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54250.log 2024-09-15T12:35:58.169 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.58831.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.58831.log.gz 2024-09-15T12:35:58.170 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68503.log 2024-09-15T12:35:58.170 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.54250.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54250.log.gz 2024-09-15T12:35:58.171 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65516.log 2024-09-15T12:35:58.172 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.68503.log: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.68503.log.gz 2024-09-15T12:35:58.172 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48738.log 2024-09-15T12:35:58.172 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65516.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.65516.log.gz 2024-09-15T12:35:58.174 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62910.log 2024-09-15T12:35:58.174 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48738.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48738.log.gz 2024-09-15T12:35:58.174 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30128.log 2024-09-15T12:35:58.174 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.62910.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62910.log.gz 2024-09-15T12:35:58.176 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53459.log 2024-09-15T12:35:58.176 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.30128.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30128.log.gz 2024-09-15T12:35:58.177 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45101.log 2024-09-15T12:35:58.177 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.53459.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53459.log.gz 2024-09-15T12:35:58.177 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44093.log 2024-09-15T12:35:58.179 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45101.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45101.log.gz 2024-09-15T12:35:58.179 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51308.log 2024-09-15T12:35:58.179 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44093.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44093.log.gz 2024-09-15T12:35:58.179 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59195.log 2024-09-15T12:35:58.179 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51308.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51308.log.gz 2024-09-15T12:35:58.182 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32184.log 2024-09-15T12:35:58.182 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.59195.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59195.log.gz 2024-09-15T12:35:58.182 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39023.log 2024-09-15T12:35:58.183 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32184.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32184.log.gz 2024-09-15T12:35:58.183 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41200.log 2024-09-15T12:35:58.183 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.39023.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39023.log.gz 2024-09-15T12:35:58.185 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40161.log 2024-09-15T12:35:58.185 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41200.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.41200.log.gz 2024-09-15T12:35:58.185 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62394.log 2024-09-15T12:35:58.185 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40161.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40161.log.gz 2024-09-15T12:35:58.187 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68221.log 2024-09-15T12:35:58.188 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.62394.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62394.log.gz 2024-09-15T12:35:58.188 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64095.log 2024-09-15T12:35:58.188 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.68221.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.68221.log.gz 2024-09-15T12:35:58.188 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44691.log 2024-09-15T12:35:58.191 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64095.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64095.log.gz 2024-09-15T12:35:58.191 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45621.log 2024-09-15T12:35:58.191 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44691.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44691.log.gz 2024-09-15T12:35:58.191 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49596.log 2024-09-15T12:35:58.191 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45621.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45621.log.gz 2024-09-15T12:35:58.191 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52459.log 2024-09-15T12:35:58.193 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49596.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.49596.log.gz 2024-09-15T12:35:58.193 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50323.log 2024-09-15T12:35:58.193 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52459.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52459.log.gz 2024-09-15T12:35:58.194 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63735.log 2024-09-15T12:35:58.194 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50323.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.50323.log.gz 2024-09-15T12:35:58.196 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55749.log 2024-09-15T12:35:58.197 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63735.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63735.log.gz 2024-09-15T12:35:58.197 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48334.log 2024-09-15T12:35:58.197 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.55749.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55749.log.gz 2024-09-15T12:35:58.197 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40260.log 2024-09-15T12:35:58.197 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48334.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48334.log.gz 2024-09-15T12:35:58.200 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56741.log 2024-09-15T12:35:58.201 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40260.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40260.log.gz 2024-09-15T12:35:58.201 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52370.log 2024-09-15T12:35:58.201 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.56741.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.56741.log.gz 2024-09-15T12:35:58.201 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38126.log 2024-09-15T12:35:58.201 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52370.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52370.log.gz 2024-09-15T12:35:58.201 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55311.log 2024-09-15T12:35:58.205 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38126.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38126.log.gz 2024-09-15T12:35:58.205 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62305.log 2024-09-15T12:35:58.205 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.55311.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55311.log.gz 2024-09-15T12:35:58.206 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32044.log 2024-09-15T12:35:58.206 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.62305.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62305.log.gz 2024-09-15T12:35:58.206 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43515.log 2024-09-15T12:35:58.206 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32044.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32044.log.gz 2024-09-15T12:35:58.206 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61331.log 2024-09-15T12:35:58.206 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43515.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43515.log.gz 2024-09-15T12:35:58.209 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67016.log 2024-09-15T12:35:58.210 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.61331.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61331.log.gz 2024-09-15T12:35:58.210 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48822.log 2024-09-15T12:35:58.210 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.67016.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.67016.log.gz 2024-09-15T12:35:58.210 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68179.log 2024-09-15T12:35:58.210 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48822.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.48822.log.gz 2024-09-15T12:35:58.210 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68354.log 2024-09-15T12:35:58.210 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.68179.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.68179.log.gz 2024-09-15T12:35:58.213 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41291.log 2024-09-15T12:35:58.214 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.68354.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.68354.log.gz 2024-09-15T12:35:58.214 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64442.log 2024-09-15T12:35:58.214 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41291.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41291.log.gz 2024-09-15T12:35:58.214 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69417.log 2024-09-15T12:35:58.214 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64442.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64442.log.gz 2024-09-15T12:35:58.214 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37246.log 2024-09-15T12:35:58.216 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.69417.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.69417.log.gz 2024-09-15T12:35:58.216 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39908.log 2024-09-15T12:35:58.216 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37246.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37246.log.gz 2024-09-15T12:35:58.216 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57566.log 2024-09-15T12:35:58.216 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.39908.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39908.log.gz 2024-09-15T12:35:58.219 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65207.log 2024-09-15T12:35:58.219 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.57566.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.57566.log.gz 2024-09-15T12:35:58.220 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30254.log 2024-09-15T12:35:58.220 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65207.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65207.log.gz 2024-09-15T12:35:58.220 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63050.log 2024-09-15T12:35:58.220 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.30254.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30254.log.gz 2024-09-15T12:35:58.222 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36498.log 2024-09-15T12:35:58.222 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63050.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.63050.log.gz 2024-09-15T12:35:58.222 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37544.log 2024-09-15T12:35:58.222 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.36498.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36498.log.gz 2024-09-15T12:35:58.225 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37126.log 2024-09-15T12:35:58.225 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37544.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37544.log.gz 2024-09-15T12:35:58.225 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70383.log 2024-09-15T12:35:58.225 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37126.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37126.log.gz 2024-09-15T12:35:58.225 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36840.log 2024-09-15T12:35:58.225 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.70383.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.70383.log.gz 2024-09-15T12:35:58.228 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64622.log 2024-09-15T12:35:58.228 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.36840.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36840.log.gz 2024-09-15T12:35:58.228 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61418.log 2024-09-15T12:35:58.228 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64622.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.64622.log.gz 2024-09-15T12:35:58.228 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56225.log 2024-09-15T12:35:58.230 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.61418.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.61418.log.gz 2024-09-15T12:35:58.230 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66836.log 2024-09-15T12:35:58.230 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.56225.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56225.log.gz 2024-09-15T12:35:58.230 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66927.log 2024-09-15T12:35:58.231 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.66836.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66836.log.gz 2024-09-15T12:35:58.232 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51933.log 2024-09-15T12:35:58.233 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.66927.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.66927.log.gz 2024-09-15T12:35:58.233 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32960.log 2024-09-15T12:35:58.233 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51933.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51933.log.gz 2024-09-15T12:35:58.235 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51357.log 2024-09-15T12:35:58.235 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32960.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32960.log.gz 2024-09-15T12:35:58.235 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31149.log 2024-09-15T12:35:58.235 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51357.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51357.log.gz 2024-09-15T12:35:58.237 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37373.log 2024-09-15T12:35:58.237 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31149.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31149.log.gz 2024-09-15T12:35:58.237 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28986.log 2024-09-15T12:35:58.237 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37373.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37373.log.gz 2024-09-15T12:35:58.239 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34452.log 2024-09-15T12:35:58.239 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.28986.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.28986.log.gz 2024-09-15T12:35:58.239 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63148.log 2024-09-15T12:35:58.239 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.34452.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34452.log.gz 2024-09-15T12:35:58.241 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61947.log 2024-09-15T12:35:58.241 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63148.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.63148.log.gz 2024-09-15T12:35:58.241 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54388.log 2024-09-15T12:35:58.241 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.61947.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.61947.log.gz 2024-09-15T12:35:58.243 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55353.log 2024-09-15T12:35:58.243 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.54388.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54388.log.gz 2024-09-15T12:35:58.244 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62870.log 2024-09-15T12:35:58.244 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.55353.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.55353.log.gz 2024-09-15T12:35:58.246 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48206.log 2024-09-15T12:35:58.246 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.62870.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.62870.log.gz 2024-09-15T12:35:58.246 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38714.log 2024-09-15T12:35:58.246 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48206.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48206.log.gz 2024-09-15T12:35:58.248 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53753.log 2024-09-15T12:35:58.248 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38714.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38714.log.gz 2024-09-15T12:35:58.248 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49338.log 2024-09-15T12:35:58.248 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.53753.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53753.log.gz 2024-09-15T12:35:58.250 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58293.log 2024-09-15T12:35:58.250 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49338.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.49338.log.gz 2024-09-15T12:35:58.250 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51188.log 2024-09-15T12:35:58.250 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.58293.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.58293.log.gz 2024-09-15T12:35:58.252 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31695.log 2024-09-15T12:35:58.252 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51188.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.51188.log.gz 2024-09-15T12:35:58.252 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36636.log 2024-09-15T12:35:58.252 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31695.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31695.log.gz 2024-09-15T12:35:58.266 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31737.log 2024-09-15T12:35:58.266 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.36636.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36636.log.gz 2024-09-15T12:35:58.266 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56354.log 2024-09-15T12:35:58.266 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31737.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31737.log.gz 2024-09-15T12:35:58.266 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43964.log 2024-09-15T12:35:58.266 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.56354.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.56354.log.gz 2024-09-15T12:35:58.266 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62563.log 2024-09-15T12:35:58.266 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43964.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43964.log.gz 2024-09-15T12:35:58.267 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54646.log 2024-09-15T12:35:58.267 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.62563.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.62563.log.gz 2024-09-15T12:35:58.267 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70971.log 2024-09-15T12:35:58.267 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.54646.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.54646.log.gz 2024-09-15T12:35:58.267 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43795.log 2024-09-15T12:35:58.267 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.70971.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.70971.log.gz 2024-09-15T12:35:58.267 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43564.log 2024-09-15T12:35:58.267 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43795.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.43795.log.gz 2024-09-15T12:35:58.267 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59490.log 2024-09-15T12:35:58.267 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43564.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.43564.log.gz 2024-09-15T12:35:58.267 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32582.log 2024-09-15T12:35:58.267 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.59490.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59490.log.gz 2024-09-15T12:35:58.267 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38476.log 2024-09-15T12:35:58.267 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32582.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32582.log.gz 2024-09-15T12:35:58.267 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33871.log 2024-09-15T12:35:58.268 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38476.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38476.log.gz 2024-09-15T12:35:58.268 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53064.log 2024-09-15T12:35:58.274 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33871.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33871.log.gz 2024-09-15T12:35:58.275 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67815.log 2024-09-15T12:35:58.275 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.53064.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.53064.log.gz 2024-09-15T12:35:58.275 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63595.log 2024-09-15T12:35:58.275 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.67815.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.67815.log.gz 2024-09-15T12:35:58.275 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46340.log 2024-09-15T12:35:58.275 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63595.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.63595.log.gz 2024-09-15T12:35:58.275 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45275.log 2024-09-15T12:35:58.275 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46340.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46340.log.gz 2024-09-15T12:35:58.275 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41389.log 2024-09-15T12:35:58.275 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45275.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45275.log.gz 2024-09-15T12:35:58.275 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45192.log 2024-09-15T12:35:58.275 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41389.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41389.log.gz 2024-09-15T12:35:58.275 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44113.log 2024-09-15T12:35:58.275 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45192.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45192.log.gz 2024-09-15T12:35:58.276 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29464.log 2024-09-15T12:35:58.280 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44113.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44113.log.gz 2024-09-15T12:35:58.280 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48945.log 2024-09-15T12:35:58.280 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.29464.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29464.log.gz 2024-09-15T12:35:58.281 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52013.log 2024-09-15T12:35:58.281 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48945.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.48945.log.gz 2024-09-15T12:35:58.281 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43310.log 2024-09-15T12:35:58.281 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52013.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.52013.log.gz 2024-09-15T12:35:58.281 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39782.log 2024-09-15T12:35:58.281 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43310.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43310.log.gz 2024-09-15T12:35:58.281 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60117.log 2024-09-15T12:35:58.281 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.39782.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.39782.log.gz 2024-09-15T12:35:58.285 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55491.log 2024-09-15T12:35:58.285 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.60117.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60117.log.gz 2024-09-15T12:35:58.285 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41470.log 2024-09-15T12:35:58.285 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.55491.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.55491.log.gz 2024-09-15T12:35:58.285 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35435.log 2024-09-15T12:35:58.285 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41470.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41470.log.gz 2024-09-15T12:35:58.285 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49031.log 2024-09-15T12:35:58.285 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.35435.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35435.log.gz 2024-09-15T12:35:58.289 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40847.log 2024-09-15T12:35:58.289 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49031.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49031.log.gz 2024-09-15T12:35:58.289 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65912.log 2024-09-15T12:35:58.289 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40847.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40847.log.gz 2024-09-15T12:35:58.289 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48556.log 2024-09-15T12:35:58.289 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65912.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65912.log.gz 2024-09-15T12:35:58.289 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57356.log 2024-09-15T12:35:58.292 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48556.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.48556.log.gz 2024-09-15T12:35:58.292 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69854.log 2024-09-15T12:35:58.292 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.57356.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.57356.log.gz 2024-09-15T12:35:58.292 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53713.log 2024-09-15T12:35:58.292 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.69854.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.69854.log.gz 2024-09-15T12:35:58.292 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32980.log 2024-09-15T12:35:58.295 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.53713.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53713.log.gz 2024-09-15T12:35:58.295 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60526.log 2024-09-15T12:35:58.295 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32980.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32980.log.gz 2024-09-15T12:35:58.295 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69291.log 2024-09-15T12:35:58.295 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.60526.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.60526.log.gz 2024-09-15T12:35:58.298 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59886.log 2024-09-15T12:35:58.298 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.69291.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.69291.log.gz 2024-09-15T12:35:58.298 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41920.log 2024-09-15T12:35:58.298 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.59886.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59886.log.gz 2024-09-15T12:35:58.298 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37900.log 2024-09-15T12:35:58.298 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41920.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41920.log.gz 2024-09-15T12:35:58.301 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38665.log 2024-09-15T12:35:58.301 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37900.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37900.log.gz 2024-09-15T12:35:58.301 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53324.log 2024-09-15T12:35:58.301 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38665.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.38665.log.gz 2024-09-15T12:35:58.301 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59370.log 2024-09-15T12:35:58.301 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.53324.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.53324.log.gz 2024-09-15T12:35:58.304 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51008.log 2024-09-15T12:35:58.304 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.59370.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.59370.log.gz 2024-09-15T12:35:58.304 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49289.log 2024-09-15T12:35:58.304 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51008.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.51008.log.gz 2024-09-15T12:35:58.304 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66351.log 2024-09-15T12:35:58.307 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49289.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.49289.log.gz 2024-09-15T12:35:58.307 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48123.log 2024-09-15T12:35:58.307 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.66351.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.66351.log.gz 2024-09-15T12:35:58.307 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59628.log 2024-09-15T12:35:58.307 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48123.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.48123.log.gz 2024-09-15T12:35:58.308 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39336.log 2024-09-15T12:35:58.310 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.59628.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.59628.log.gz 2024-09-15T12:35:58.310 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33402.log 2024-09-15T12:35:58.310 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.39336.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39336.log.gz 2024-09-15T12:35:58.310 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54029.log 2024-09-15T12:35:58.310 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.33402.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33402.log.gz 2024-09-15T12:35:58.312 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42509.log 2024-09-15T12:35:58.312 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.54029.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.54029.log.gz 2024-09-15T12:35:58.312 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65774.log 2024-09-15T12:35:58.312 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42509.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42509.log.gz 2024-09-15T12:35:58.314 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42138.log 2024-09-15T12:35:58.314 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65774.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.65774.log.gz 2024-09-15T12:35:58.314 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57089.log 2024-09-15T12:35:58.314 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42138.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42138.log.gz 2024-09-15T12:35:58.315 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31786.log 2024-09-15T12:35:58.316 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.57089.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.57089.log.gz 2024-09-15T12:35:58.316 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.31786.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31786.log.gz 2024-09-15T12:35:58.360 INFO:teuthology.orchestra.run.smithi077.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.0.61512.log.gz 2024-09-15T12:35:58.512 INFO:teuthology.orchestra.run.smithi077.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.0.30743.log.gz 2024-09-15T12:35:58.571 INFO:teuthology.orchestra.run.smithi077.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.0.37754.log.gz 2024-09-15T12:35:58.600 INFO:teuthology.orchestra.run.smithi077.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.0.54101.log.gz 2024-09-15T12:35:58.653 INFO:teuthology.orchestra.run.smithi077.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.0.45470.log.gz 2024-09-15T12:36:29.346 INFO:teuthology.orchestra.run.smithi138.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-15T12:36:29.784 INFO:teuthology.orchestra.run.smithi138.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-15T12:36:29.786 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-15T12:36:29.787 INFO:teuthology.orchestra.run.smithi138.stderr:real 0m32.714s 2024-09-15T12:36:29.787 INFO:teuthology.orchestra.run.smithi138.stderr:user 1m2.670s 2024-09-15T12:36:29.787 INFO:teuthology.orchestra.run.smithi138.stderr:sys 0m2.199s 2024-09-15T12:36:29.871 INFO:teuthology.orchestra.run.smithi077.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-15T12:36:31.551 INFO:teuthology.orchestra.run.smithi077.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-15T12:36:31.553 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-09-15T12:36:31.553 INFO:teuthology.orchestra.run.smithi077.stderr:real 0m34.525s 2024-09-15T12:36:31.553 INFO:teuthology.orchestra.run.smithi077.stderr:user 1m12.577s 2024-09-15T12:36:31.553 INFO:teuthology.orchestra.run.smithi077.stderr:sys 0m2.929s 2024-09-15T12:36:31.553 INFO:tasks.ceph:Archiving logs... 2024-09-15T12:36:31.554 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/log/ceph to /home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905530/remote/smithi077/log 2024-09-15T12:36:31.555 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T12:36:43.698 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/log/ceph to /home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905530/remote/smithi138/log 2024-09-15T12:36:43.699 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T12:36:53.898 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-15T12:36:53.907 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-15T12:36:53.907 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T12:36:53.910 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T12:36:53.989 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-15T12:36:54.000 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-15T12:36:54.000 DEBUG:teuthology.orchestra.run.smithi077:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T12:36:54.003 DEBUG:teuthology.orchestra.run.smithi138:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T12:36:54.017 INFO:teuthology.orchestra.run.smithi138.stderr:bash: line 1: ntpq: command not found 2024-09-15T12:36:54.018 INFO:teuthology.orchestra.run.smithi077.stderr:bash: line 1: ntpq: command not found 2024-09-15T12:36:54.021 INFO:teuthology.orchestra.run.smithi138.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T12:36:54.021 INFO:teuthology.orchestra.run.smithi138.stdout:=============================================================================== 2024-09-15T12:36:54.021 INFO:teuthology.orchestra.run.smithi138.stdout:^* hv01.front.sepia.ceph.com 3 6 377 60 +463us[ +465us] +/- 44ms 2024-09-15T12:36:54.021 INFO:teuthology.orchestra.run.smithi138.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 61 -634us[ -631us] +/- 54ms 2024-09-15T12:36:54.021 INFO:teuthology.orchestra.run.smithi138.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 59 +20us[ +20us] +/- 78ms 2024-09-15T12:36:54.021 INFO:teuthology.orchestra.run.smithi138.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T12:36:54.023 INFO:teuthology.orchestra.run.smithi077.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T12:36:54.023 INFO:teuthology.orchestra.run.smithi077.stdout:=============================================================================== 2024-09-15T12:36:54.023 INFO:teuthology.orchestra.run.smithi077.stdout:^* hv01.front.sepia.ceph.com 3 6 377 58 +473us[ +502us] +/- 44ms 2024-09-15T12:36:54.023 INFO:teuthology.orchestra.run.smithi077.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 57 -620us[ -620us] +/- 54ms 2024-09-15T12:36:54.023 INFO:teuthology.orchestra.run.smithi077.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 57 +22us[ +22us] +/- 78ms 2024-09-15T12:36:54.023 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T12:36:54.024 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-15T12:36:54.079 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-15T12:36:54.080 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-15T12:36:54.088 DEBUG:teuthology.orchestra.run.smithi077:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-15T12:36:54.175 DEBUG:teuthology.orchestra.run.smithi138:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-15T12:36:54.235 DEBUG:teuthology.orchestra.run.smithi077:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T12:36:54.265 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T12:36:54.265 DEBUG:teuthology.orchestra.run.smithi138:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T12:36:54.291 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T12:36:54.292 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-15T12:36:54.300 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-15T12:36:54.313 INFO:teuthology.task.internal:Duration was 1610.610667 seconds 2024-09-15T12:36:54.313 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-15T12:36:54.326 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-15T12:36:54.326 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T12:36:54.329 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T12:36:54.366 INFO:teuthology.orchestra.run.smithi077.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T12:36:54.370 INFO:teuthology.orchestra.run.smithi138.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T12:36:54.687 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-15T12:36:54.687 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi077.front.sepia.ceph.com 2024-09-15T12:36:54.687 DEBUG:teuthology.orchestra.run.smithi077:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T12:36:54.707 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi138.front.sepia.ceph.com 2024-09-15T12:36:54.707 DEBUG:teuthology.orchestra.run.smithi138:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T12:36:54.756 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-15T12:36:54.756 DEBUG:teuthology.orchestra.run.smithi077:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T12:36:54.758 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T12:36:54.822 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-15T12:36:54.823 DEBUG:teuthology.orchestra.run.smithi077:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T12:36:54.825 DEBUG:teuthology.orchestra.run.smithi138:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T12:36:54.961 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-15T12:36:54.971 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-15T12:36:54.971 DEBUG:teuthology.orchestra.run.smithi077:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T12:36:54.996 DEBUG:teuthology.orchestra.run.smithi138:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T12:36:55.021 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-15T12:36:55.029 DEBUG:teuthology.orchestra.run.smithi077:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T12:36:55.038 DEBUG:teuthology.orchestra.run.smithi138:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T12:36:55.059 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = core 2024-09-15T12:36:55.083 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = core 2024-09-15T12:36:55.104 DEBUG:teuthology.orchestra.run.smithi077:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T12:36:55.154 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T12:36:55.154 DEBUG:teuthology.orchestra.run.smithi138:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T12:36:55.168 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T12:36:55.169 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-15T12:36:55.177 INFO:teuthology.task.internal:Transferring archived files... 2024-09-15T12:36:55.178 DEBUG:teuthology.misc:Transferring archived files from smithi077:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905530/remote/smithi077 2024-09-15T12:36:55.178 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T12:36:55.232 DEBUG:teuthology.misc:Transferring archived files from smithi138:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/matan-2024-09-15_11:59:21-crimson-rados-wip-matanb-crimson-testing-59543-distro-crimson-smithi/7905530/remote/smithi138 2024-09-15T12:36:55.233 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T12:36:55.265 INFO:teuthology.task.internal:Removing archive directory... 2024-09-15T12:36:55.265 DEBUG:teuthology.orchestra.run.smithi077:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T12:36:55.267 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T12:36:55.315 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-15T12:36:55.324 INFO:teuthology.task.internal:Not uploading archives. 2024-09-15T12:36:55.324 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-15T12:36:55.334 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-15T12:36:55.334 DEBUG:teuthology.orchestra.run.smithi077:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T12:36:55.336 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T12:36:55.349 INFO:teuthology.orchestra.run.smithi077.stdout: 265970 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 12:36 /home/ubuntu/cephtest 2024-09-15T12:36:55.369 INFO:teuthology.orchestra.run.smithi138.stdout: 266063 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 12:36 /home/ubuntu/cephtest 2024-09-15T12:36:55.370 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-15T12:36:55.380 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-15T12:36:55.406 INFO:teuthology.run:Summary data: description: crimson-rados/thrash_simple/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/simple thrashosds-health workloads/radosbench} duration: 1610.6106672286987 flavor: crimson owner: scheduled_matan@teuthology success: true 2024-09-15T12:36:55.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T12:36:55.485 INFO:teuthology.run:pass